Welcome to the CFA Dagster Adoption Guide¶

The purpose of this website is to provide an overview of Dagster and how teams within CFA have adopted Dagster in their workflow. Dagster is an orchestration platform that provides observability into your workflows as they are transparently executed in either local or cloud environments. Dagster unifies logic that is often distributed between GitHub Actions workflows, Makefiles, Bash and Python Scripts, and configured in the Azure Portal.

Key Benefits¶

• Dagster allows you to run the same code on your machine, in Docker, on Azure Batch, or on Azure Container App Jobs with a simple configuration change.
• Dagster provides a clear user interface to expose events, metadata, standard output (stdout), and standard input (stdin) logs for your workload regardless of the compute environment.
• Dagster has built-in schedulers and event-based triggers to run your workload when you want.
• The platform is designed to provide visibility across the entire data ecosystem, not just individual jobs.