Workers

Dark v1 problems

  • Queues should be processed with QoS. If someone puts 100k items in the queue, the user with just 1 should still go immediately.
  • V1 doesn't have the ability to fanout, or do any patterns except emit
  • We dont have a good understanding of the currently implemented retry logic, or what the retry logic should be
  • users dont have a good way to get warnings if their queues are failing
    • maybe add a dead-letter queue
  • no way to introspect queues using code, barely any way to introspect them without code
  • sometimes queues take too long or fail, and items build up. should they be rerun? Should there be an expiry time?
  • Queues don't autoscale
    • perhaps we shouldn't be using built-in queues and should istead of cloud-y queues