[ RUST V2 / OPERATOR CONTROL PLANE ]

beampipe

Turn archive metadata and project policy into observable, recoverable DALiuGE execution on local or HPC infrastructure.

Start safely Open operator handbook

INPUT CASDA + project YAML TRUTH PostgreSQL ledger EFFECT workers + DALiuGE

Start in five minutes

This path runs the real control plane and console against PostgreSQL while keeping archive, scheduler, and DALiuGE side effects disabled.

docker compose up -d postgres
mkdir -p operator-local
beampipe init --directory operator-local
cd operator-local
beampipe setup --yes \
  --admin-password 'replace-this-local-password' \
  --project-config ../config/wallaby_hires.v2.yaml
beampipe doctor
beampipe start

Open the annotated local walkthrough

The control-plane boundary

FACTSCASDAarchive metadata

-->

POLICYproject YAMLversioned intent

-->

TRUTHBeampipeledger + artifacts

-->

LEASEworkersfenced effects

-->

RUNSlurm + DALiuGEscience runtime

Beampipe does not replace the science graph. It owns source registration, discovery, manifest and graph preparation, admission, backend submission intent, reconciliation, provenance, and operator-facing diagnostics. External systems retain authority over archive facts and scientific execution.

Explore each boundary

Choose your working context

operator project author integrator on-call

RUN

Install, verify, observe, and act

Choose a setup path -> complete one workflow -> open the handbook.

Documentation map

[01] StartInstall and cross from mock operation to real infrastructure deliberately. [02] OperateRun shifts, scale workers, inspect backends, recover, and promote releases. [03] Configure projectsDefine typed discovery, transforms, manifests, graph patches, and extensions. [04] UnderstandLearn the control-plane boundary, lifecycle, state axes, and adapter contracts. [05] ReferenceFind CLI commands, vocabulary, API workflow, and generated schemas.