§ Durable Execution
- I learnt of this concept from absurd.sql , and is precisely the vocabulary that I have been looking for.
- I am considering using SQLite for this, as it's the perfect simple backend for the scale of tasks that I have (~60,000 to 100,000 jobs, each taking a minute or two).
- However, SQLite doesn't seem to be able to represent queues as well as postgres does, which is a bit unfortunate.
§ Queues Via Postgres