VTechWorks staff will be away for the winter holidays starting Tuesday, December 24, 2024, through Wednesday, January 1, 2025, and will not be replying to requests during this time. Thank you for your patience, and happy holidays!
 

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Simple item page
dc.contributor.authorHolcomb, Karen M.en
dc.contributor.authorMathis, Sarabethen
dc.contributor.authorStaples, J. Erinen
dc.contributor.authorFischer, Marcen
dc.contributor.authorBarker, Christopher M.en
dc.contributor.authorBeard, Charles B.en
dc.contributor.authorNett, Randall J.en
dc.contributor.authorKeyel, Alexander C.en
dc.contributor.authorMarcantonio, Matteoen
dc.contributor.authorChilds, Marissa L.en
dc.contributor.authorGorris, Morgan E.en
dc.contributor.authorRochlin, Iliaen
dc.contributor.authorHamins-Puértolas, Marcoen
dc.contributor.authorRay, Evan L.en
dc.contributor.authorUelmen, Johnny A.en
dc.contributor.authorDeFelice, Nicholasen
dc.contributor.authorFreedman, Andrew S.en
dc.contributor.authorHollingsworth, Brandon D.en
dc.contributor.authorDas, Praachien
dc.contributor.authorOsthus, Daveen
dc.contributor.authorHumphreys, John M.en
dc.contributor.authorNova, Nicoleen
dc.contributor.authorMordecai, Erin A.en
dc.contributor.authorCohnstaedt, Lee W.en
dc.contributor.authorKirk, Devinen
dc.contributor.authorKramer, Laura D.en
dc.contributor.authorHarris, Mallory J.en
dc.contributor.authorKain, Morgan P.en
dc.contributor.authorReed, Emily M. X.en
dc.contributor.authorJohansson, Michael A.en
dc.date.accessioned2023-01-17T13:07:53Zen
dc.date.available2023-01-17T13:07:53Zen
dc.date.issued2023-01-12en
dc.date.updated2023-01-15T04:09:40Zen
dc.description.abstractBackground West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases).en
dc.description.versionPublished versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationParasites & Vectors. 2023 Jan 12;16(1):11en
dc.identifier.doihttps://doi.org/10.1186/s13071-022-05630-yen
dc.identifier.urihttp://hdl.handle.net/10919/113190en
dc.language.isoenen
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.holderThis is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may applyen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.titleEvaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease predictionen
dc.title.serialParasites & Vectorsen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
13071_2022_Article_5630.pdf
Size:
1.85 MB
Format:
Adobe Portable Document Format
Description:
Published version
Download
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
0 B
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Journal Articles, BioMed Central and SpringerOpen
Scholarly Works, Global Change Center