Workflow Catalogue

The EXA4MIND Workflow Catalogue provides modules for Extreme Data processing and transfer workflows in Airflow, Dask/Python or a combination of these.

We present the catalog in two categories:

• workflow-catalogue-airflow
• workflow-catalogue-dask

This catalogue provides you with examples on how to use the AQIS engine and submodules.

Workflow Catalogue - Airflow

The submodule is available under Workflow-Catalogue-Airflow, with further documentation in README.md and LICENSE files.

The public version currently offers cache manager workflow for the industry use case for Terraview, health data processing workflow to ingest CSV dataset to derive age-based features and provides demographic visualizations, data streaming experiments, staging workflows and time series analysis for airline passenger forecasting use case.

Workflow Catalogue - Dask

The submodule is available under Workflow-Catalogue-Dask, with further documentation in README.md and LICENSE files.

We have already released the modules containing a molecular dynamics example, public health data processing workflow (in Dask) and a staging workflow. The module also contains a AQIS engine basic usage guide for starting with AQIS.