Write nowcast results to partitioned parquet files — write_nowcast

Writes summarized nowcast results to a partitioned parquet dataset, partitioned by location. This enables efficient querying of results for specific states using arrow::open_dataset().

Usage

write_nowcast_parquet(
  nowcast_results,
  output_dir,
  summarize = FALSE,
  overwrite = TRUE
)

Arguments

nowcast_results: A data frame as returned by run_state_nowcasts() or run_single_nowcast().
output_dir: Character. Directory path for output. Will be created if it doesn't exist.
summarize: Logical. If TRUE, summarize draws into quantiles before writing. If FALSE (default), write raw draws.
overwrite: Logical. If TRUE, overwrite existing partitions. Default is TRUE.

Value

Invisibly returns the path to the output directory.

Examples

if (FALSE) { # \dontrun{
results <- run_state_nowcasts(data, config)

# Write summarized results
write_nowcast_parquet(results, "output/nowcasts", summarize = TRUE)

# Write raw draws
write_nowcast_parquet(results, "output/nowcasts_draws", summarize = FALSE)

# Read back with arrow
library(arrow)
ds <- open_dataset("output/nowcasts")
ds |> filter(location == "ca") |> collect()
} # }