§ Experimental Evaluation Setup I'm Happy With

• Use python as a lightweight scripting language, with asyncio for spawning many processes.
• Use logging to log info, and use python's inbuilt logger to write to a log file as well as stdout/stderr.
• Write all data into sqlite database files, and use sqlite database file to be crash-tolerant, to keep track of how many tasks have finished.
• View sqlite database quickly using visidata in the command line, and load into further processing scripts via duckdb.