Autosubmit Workflow Manager#

Autosubmit

Autosubmit is an open source Python experiment and workflow manager used to manage complex workflows on Cloud and HPC platforms.

$ pip install autosubmit
Illustration of a person and workflows running on a platform.

Autosubmit is a lightweight workflow manager designed to meet climate research necessities. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application.

It is a Python package available at PyPI. The source code in Git contains a Dockerfile used in cloud environments with Kubernetes, and there are examples of how to install Autosubmit with Conda.

Automation

Management of job submission and dependencies without user intervention.

Data Provenance

Experiments with unique PIDs, use of open standards for data provenance in the experiments and workflows.

Fault Tolerance

Automatic retrials and ability to re-run specific parts of the experiment in case of failure.

Resource Management

Individual platform configuration, allowing users to run their experiments without having to modify job scripts.

Multiplatform

Widely used to run experiments on different platforms simultaneously, using batch schedulers such as Slurm, PBS, LSF. It is deployed and used on various HPC and cloud systems.

Open Source

Autosubmit code is hosted at BSC Earth Sciences' GitLab, licensed under the GPLv3 License, and under active development.

Contact Us#