CFA DataOps Documentation¶

Welcome to the CFA DataOps system - a catalog-based approach to data management and ETL.

Getting Started¶

1. Managing Catalogs - Create and manage multiple catalog repositories
2. Catalog Creation - Detailed guide for creating new catalogs with dataops_catalog_init

Using the System¶

1. CLI Tools Reference - Command-line tools for exploring and downloading datasets
2. Data User Guide - Access and work with datasets using datacat
3. Data Developer Guide - Add datasets and ETL processes to catalogs

Quick Reference¶

# Essential imports
from cfa.dataops import datacat

# List available resources
print("Datasets:", datacat.__namespace_list__)

# Access data (example)
df = datacat.private.scenarios.covid19vax_trends.load.get_dataframe()

When you need to preview the version that a dataframe load will use, call resolve_version() on the same dataset endpoint with the same version_spec and selection values you plan to pass to get_dataframe().