Move the software to flow-based programming

[lawrennd]

The idea would be to change the data specificaitons so that they are in the form of the interface files used by e.g. referia (see e.g. https://github.com/lawrennd/referia/blob/main/referia/config/interface.py).

Then the processing of each data set would be two stage.

The first stage is to create a relevant interface file of the form

input:
# Specify the input files here

output:
# specify the output files here

compute: 
# Specify the computations that are done on the two

Write that file, register it with the publish and subscribe service and then execute the command line on the file directly.