Convert_on_campus shouldn't need a holding_dir to perform conversions, if distribute_borealis_data operates correctly and executes after it finishes. Conversions should be able to occur in-place, simplifying the data flow.
To change this:
- convert_on_campus can be changed from operating within
RADARID_holding_dir to just the RADARID_data dir. This removes the need to have logic to choose the dest directory within rsync_to_campus, and simplifies convert_on_campus.
- To ensure this works, a check should be added to distribute_borealis_data to ensure that if rawacf_array files are being distributed, rawacf_dmap files should as well. If only array files are found, then the convert_on_campus script failed, and the files shouldn't be distributed. We should also be notified of this error.
NOTE: This should be implemented after sites that utilize convert_on_campus are implemented with the inotify data flow (i.e. RKN or CLY), and then tested with the same sites.
Convert_on_campus shouldn't need a holding_dir to perform conversions, if distribute_borealis_data operates correctly and executes after it finishes. Conversions should be able to occur in-place, simplifying the data flow.
To change this:
RADARID_holding_dirto just theRADARID_datadir. This removes the need to have logic to choose the dest directory within rsync_to_campus, and simplifies convert_on_campus.NOTE: This should be implemented after sites that utilize convert_on_campus are implemented with the inotify data flow (i.e. RKN or CLY), and then tested with the same sites.