Intergrated Data Workflow using HELIPORT at TELBE

At the High-Field High-Repetition-Rate Terahertz facility @ ELBE (TELBE)[1],
ultrafast terahertz-induced dynamics can be probed in various states of matter with highest precision. The TELBE sources offer both, stable and tunable narrowband THz radiation with pulse energies of several microjoules at high repetition rates and a synchronized coherent diffraction radiator,that provides broadband single-cycle pulses. The measurements at TELBE are data intensive, which can be as high as 20GB per experiment, that can lasts up to several minutes. As a result, the current data aquisition and data analysis stages are decoupled, where in the first step the primary data is processed and stored at HZDR and in a later step, restricted data access is made available to the user for post-processing.

In this poster contribution, we present an integrated workflow for post-processing of the experimental data at TELBE with in-built exchange of metadata between the experiment control software LabView and the workflow execution engine UNICORE[2]. We also present the guidance system HELIPORT[3] which manages the metadata of the associated project proposal and job information from UNICORE, and integrates with the electronic lab notebook (MediaWiki[4]), providing a user-friendly interface for monitoring the actively running experiments at TELBE.

[1] https://doi.org/10.1063/1.4978042
[2] https://doi.org/10.1109/HPCSim.2016.7568392
[3] https://doi.org/10.1145/3456287.3465477
[4] https://www.mediawiki.org/wiki/Project:About