Autosubmit Workflow Manager#
Autosubmit
Autosubmit is an open source Python experiment and workflow manager used to manage complex workflows on Cloud and HPC platforms.
Autosubmit is a lightweight workflow manager designed to meet climate research necessities. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application.
It is a Python package available at PyPI. The source code in Git contains a Dockerfile used in cloud environments with Kubernetes, and there are examples of how to install Autosubmit with Conda.
What Autosubmit Does#
Management of job submission and dependencies without user intervention.
Experiments with unique PIDs, use of open standards for data provenance in the experiments and workflows.
Automatic retries and ability to re-run specific parts of the experiment in case of failure.
Individual platform configuration, allowing users to run their experiments without having to modify job scripts.
Widely used to run experiments on different platforms simultaneously, using batch schedulers such as Slurm. It is deployed and used on various HPC and cloud systems.
Autosubmit code is hosted on GitHub, licensed under the GPLv3 License, and under active development.
Where Autosubmit Is Used#
Autosubmit runs the workflows behind these research centres, projects and operational services.
The Autosubmit Ecosystem#
Two companion tools extend Autosubmit with monitoring and a graphical interface. Both are open source and documented separately.
A Python web application that monitors, analyses and controls workflows created and managed with Autosubmit. It exposes experiment state over HTTP and is what the GUI reads from.
A graphical interface that presents workflow execution in the browser, with job trees, run history and log inspection for experiments managed by Autosubmit.
Citing Autosubmit#
If you use Autosubmit, please cite it using these metadata.
Contact Us#
Browse the code, read the changelog, or open a pull request.
Found a bug or want to request a feature? Open an issue on the tracker.
Ask questions, share workflows, and see how other centres use Autosubmit.
Questions about running Autosubmit at your centre, or anything the docs do not answer.
Media and Press Kit#
Logos in SVG and PNG, and slide decks — everything you need to include Autosubmit in your own materials.