Add endpoint to start workflow execution from arbitrary git repository
Only available if the environment variable DEV_SYSTEM
is set to True
.
POST /workflow_executions/arbitrary
Permission workflow:create
- Client send workflow version id and config to WFS
- Input
- Repository URL
- Git Commit Hash
- Parameters
- Report Output Bucket (Optional)
- WFS asks AS if user is allowed to start workflow
- Check active workflow limit
- Check if necessary files are in the repository
- Check config with json schema of workflow and user has access to referenced buckets
- Save workflow execution to database with unique ID
- Copy config into separate s3 bucket
- Start nextflow via Slurm REST API (python library through openapi-generator)
- Tower Tracing enabled -> point to WLS
- workflow execution ID as workspace ID (somehow inject workflow execution id)
- Save Slurm job Id to database to enable canceling the job
- Return Workflow execution instance with status pending
Edited by Daniel Göbel