Ordering tasks by a key

[ericsouza]

Hey 👋🏻

Is it possible to have an ordering mechanism that uses a "key" as a lock id? I have a requirement where I need to process tasks ordered by a key.

Currently I am using python procrastinate library which has a cool ordering mechanism that works perfectly, but this forces me to use python and all my other system are typescript based.

My context:
The system process 5 min video segments generated from a livestream server, these videos need to be processed in order for the same livestream id.

[GiovaniGuizzo]

Hey Eric. No, unfortunately, there is no way to guarantee that with Sidequest using keys or specific mechanisms.

What you can do is schedule a job from within another job, something like this:

export class ProcessClipJob extends Job {
  async run(id: number) {
    // Process job here
    if (success) {
      await Sidequest.build(ProcessClipJob).enqueue(id + 1);
    }
  }
}

This way you will be sure that they are processed in sequence.

[ericsouza]

@GiovaniGuizzo thanks for the quick reply!!

Unfortunately this will not work for me as my tasks are scheduled inside a gcp pubsub queue consumer.

Btw, thanks for this amazing project!!