Skip to contents

Pull hub submissions and create a scorable table as the output of scoringutils::as_forecast_quantile().

Usage

pull_hub_forecasts(
  model_name,
  dates,
  eval_data,
  locations = NULL,
  hub_subdir = NA,
  pull_from_github = TRUE,
  submissions_path =
    "https://raw.githubusercontent.com/reichlab/covid19-forecast-hub/master/data-processed/"
)

Arguments

model_name

a vector of character strings indicating the names of the models to score.

dates

a vector of dates indicating the dates of the submissions to score.

eval_data

Table of evaluation data, as the output of get_input_hosp_data()

locations

a vector of character strings indicating the locations to score

hub_subdir

path where the retrospective hub submissions are saved locally since these are not on COVIDHub github

pull_from_github

boolean indicating whether or not to pull from github

submissions_path

url pointing to the "data-processed" folder on the COVIDhub github, which is where team's submissions are located

Value

a dataframe containing all of the scores for all models, forecast dates (indicated by dates), locations, target end dates, and quantiles