Skip to contents

Score hub submissions

Usage

score_hub_submissions(
  model_name,
  dates,
  locations = NULL,
  hub_subdir = NA,
  pull_from_github = TRUE,
  submissions_path =
    "https://raw.githubusercontent.com/reichlab/covid19-forecast-hub/master/data-processed/",
  truth_data_path =
    "https://media.githubusercontent.com/media/reichlab/covid19-forecast-hub/master/data-truth/truth-Incident%20Hospitalizations.csv"
)

Arguments

model_name

a vector of character strings indicating the names of the models to scores

dates

a vector of dates indicating the dates of the submissions to score

locations

a vector of character strings indicating the locations to score

hub_subdir

path where the retrospective hub submissions are saved locally since these are not on COVID hub github

pull_from_github

boolean indicating whether or not to pull from github

submissions_path

url pointing to the "data-processed" folder on the COVIDhub github, which is where team's submissions are located

truth_data_path

the path to the truth data used by the hub for evaluation

Value

a dataframe containing all of the scores for all models, forecast dates (indicated by dates), locations, target end dates, and quantiles