What is the best queue system?

(written by lawrence krubner, however indented passages are often quotes). You can contact lawrence at: lawrence@krubner.com

Github has a summary of queue systems that they have used and then abandoned:

SQS,

ActiveMessaging

BackgroundJob

DelayedJob

beanstalkd

They go over this history to explain why they are creating Resque:

Persistence

See what’s pending

Modify pending jobs in-place

Tags

Priorities

Fast pushing and popping

See what workers are doing

See what workers have done

See failed jobs

Kill fat workers

Kill stale workers

Kill workers that are running too long

Keep Rails loaded / persistent workers

Distributed workers (run them on multiple machines)

Workers can watch multiple (or all) tags

Don’t retry failed jobs

Don’t “release” failed jobs

Source