Big Science, Big Data and Big Computing for
Advanced Hurricane Monitoring & Prediction
Fuqing Zhang
Director, Center for Advanced Data Assimilation and Predictability Techniques
Professor, Department of Meteorology and Atmospheric Science
Pennsylvania State University
Research sponsored by NSF, ONR, NOAA and NASA
FROM RESEARCH TO INDUSTRY:
How Earth system science enables private sector innovation
Track forecasts have improved drastically over past 25 years: a 3-
day forecast today is as accurate as a 1-day forecast was in 1989.
Intensity forecast accuracy has remained generally stagnant over
that same period, except for the last few years, thanks to the
Hurricane Forecast Improvement Program (HFIP) led by NOAA.
National Hurricane Center Official TC Forecast Errors
NSF HPC Computing
At Texas Advanced
Computing Center
System Name: Ranger
Operating System: Linux
Number of Cores: 62,976
Total Memory: 123TB
Peak Performance: 579.4TFlops
Total Disk: 1.73PB (shared)
HFIP Allocation : 30M SUs
(July 1, 2008- 31 March 2009)
Goals of NOAA’s Hurricane Forecast
Improvement Project (HFIP)
•  Reduce average track and intensity forecast error by
half for days 1 through 5
•  Significantly increase the probability of detection for
rapid intensity change and decrease false alarm ratio
•  Extend lead time for hurricane forecasts out to Day 7
My team’s HFIP effort co-funded by ONR, NSF and NASA
How to make better input to the hurricane models?
High-resolution observations from Hurricane Hunters and UAVs: Provide
crucial airborne inflight measurements, dropsondes, Doppler Radar Winds, …
50°
~ 3 km
Data assimilation: The process of generating initial conditions for weather prediction models
through combining the background model estimate, and all applicable up-to-date observations.
NOAA P3 NASA
Global
Hawk
PSU WRF-EnKF Hurricane Analysis & Prediction System
with advanced assimilation of airborne Doppler Radar Vr
Evaluated for all 100+ P3 TDR missions during 2008-2012
The PSU system uses the NCAR’s WRF model; TDR Methodology now adopted by NOAA .
(F. Zhang and Y. Weng 2015, Bulletin of the American Meteorological Society)
PSU WRF-EnKF Hurricane Intensity error (knots)
Penn	State	hurricane	research	in	NSF	“Big	Data”	rollout
ext Frontier: Geostationary Satellite GOES-R
from NASA to NOAA
Assimilating All-sky GOES-R Radiances: Harvey (2017)
Independent observations vs. EnKF analysis of channel 10
PSU WRF-EnKF assimilates channel 8 radiances every 1 hour
Research Funding Provided by ONR, NASA, NOAA and NSF
Independent Observations vs. EnKF analysis
Assimilating All-sky Satellite Radiances: Harvey (2017)
PSU WRF-EnKF Harvey Forecast with GOES-R Assimilation
in comparison with WRF(NoDA), operational HWRF & best track
Research Supported by ONR, NASA, NOAA and NSF
Research Supported by ONR, NASA, NOAA and NSF
FV3 Prediction of Hurricane Harvey with a 3-km nested domain
PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex
FV3 3km-nest simulated radar reflectivity (left) vs. observations (right) at Landfall
KCRPKCRP
KHGXKHGXKEWX KEWX
KGRKKGRK
Research Supported by ONR, NASA, NOAA and NSF
FV3 Prediction of Hurricane Harvey with a 3-km nested domain
PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex
FV3-forecasted (left) vs. observed event total rainfall (right) with 6-day lead time
KCRP
KHGX
KEWX
KGRK
KLCH
KPOE
KSHV
KLIX
KCRP
KHGX
KEWX
KGRK
KLCH
KPOE
KSHV
KLIX
Point maximum of 40+ inches Point maximum of 50+ inches
Promises of US’s Next-Generation Global Prediction System: FV3
Comparison with EC model on 1-year-mean 10-day-forecast 500mb anomaly correlations
Forecast lead time (h)
FV3 model with EC model initial condition (IC) comparable to	EC	day	1-7	but better thereafter;
FV3 model with current GFS initial condition is considerably worse than either run with EC IC;
US forecast is inferior due mostly to poorer IC, inferior data assimilation ingesting less data
Courtesy of Linus Magnusson at ECMWF
and SJ Lin at NOAA/GFDL
AnomalyCorrelationCoefficient(ACC)
From Research to Industry
Concluding Remarks: Invest on big data hurricane science
•  There are great potentials and needs for improving hurricane prediction through
collaborative research and sustained federal investment on data, science and personnel
•  Future hurricane prediction advances may come from the following areas:
•  Observations: advanced observing systems such as those from airborne dropsondes,
Doppler radar and weather satellites
•  Model: cutting-edge higher-resolution weather prediction models with more accurate
numerics and physics
•  Data assimilation: comprehensive algorithms and methodologies that that can more
effectively ingest existing and future observations into state-of-science models
•  Computing: high-performance computing facilities that can perform advanced analysis
and forecasting in a timely manner.
+ 3 kts initial intensity error
Shear only
Initial V + shear
Track
Initial + track
Initial inner core
moisture error
Predictability and Error Sources of Hurricane Intensity Forecast
(Emanuel and Zhang 2016, Journal of Atmospheric Sciences)
With realtime EnKF assimilation of airborne Doppler winds
(Zhang and Weng, 2015 BAMS)
What	“big	data”	means	for	hurricane	research:	ensembles
Research Supported by ONR, NASA, NOAA and NSF
FV3 Prediction of Hurricane Harvey with a 3-km nested domain
PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex
in comparison with FV3(GFS), operational GFS, EC & best track
Ongoing PSU collaboration with NOAA/GFDL

More Related Content

PDF
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
PPTX
NOAA's Climate Data Record (CDR) Program
PDF
WP Technical Paper - Inter-annual variability of wind speed in South Africa
PPTX
kellndorfer_WE3.T05.4.pptx
PDF
Reanalysis Datasets for Solar Resource Assessment - 2014 SPI
PPTX
Hong Liu CanWEA presentation
PPT
Poster Nov19 V1
PPT
Poster Nov19 V2
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
NOAA's Climate Data Record (CDR) Program
WP Technical Paper - Inter-annual variability of wind speed in South Africa
kellndorfer_WE3.T05.4.pptx
Reanalysis Datasets for Solar Resource Assessment - 2014 SPI
Hong Liu CanWEA presentation
Poster Nov19 V1
Poster Nov19 V2

What's hot (19)

PDF
1 1 kankiewicz_sandia_epri_pv_perf_wrk_shp_presentation_2016
PDF
Reanalysis Datasets for Solar Resource Assessment Presented at ASES 2014
PDF
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
PDF
Estimating Fire Weather Indices Via Semantic Reasoning Over Wireless Sensor N...
PDF
15 sengupta next_generation_satellite_modelling
PDF
IRJET - Intelligent Weather Forecasting using Machine Learning Techniques
PPTX
A PHYSICAL METHOD TO COMPUTE SURFACE RADIATION FROM GEOSTATIONARY SATELLITES
PDF
Short-term solar forecasting based on sky images
PDF
The Use of HPC to Model the California Wildfires
PPTX
Weather Forecasting using Deep Learning A lgorithm for the Ethiopian Context
PPTX
Air quality challenges and business opportunities in China: Fusion of environ...
PDF
CSP Training series : solar resource assessment 2/2
PDF
Adaptive Methane Detection
PPT
Skole Carbon Benefits Seminar
PPT
Cliff Mass: Big Data and Weather Prediction - Seattle Interactive 2015
PPTX
GPS Presentation
PDF
summer-studentship-report-PDF
PDF
CSP Training series : solar resource assessment 1/2
1 1 kankiewicz_sandia_epri_pv_perf_wrk_shp_presentation_2016
Reanalysis Datasets for Solar Resource Assessment Presented at ASES 2014
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Estimating Fire Weather Indices Via Semantic Reasoning Over Wireless Sensor N...
15 sengupta next_generation_satellite_modelling
IRJET - Intelligent Weather Forecasting using Machine Learning Techniques
A PHYSICAL METHOD TO COMPUTE SURFACE RADIATION FROM GEOSTATIONARY SATELLITES
Short-term solar forecasting based on sky images
The Use of HPC to Model the California Wildfires
Weather Forecasting using Deep Learning A lgorithm for the Ethiopian Context
Air quality challenges and business opportunities in China: Fusion of environ...
CSP Training series : solar resource assessment 2/2
Adaptive Methane Detection
Skole Carbon Benefits Seminar
Cliff Mass: Big Data and Weather Prediction - Seattle Interactive 2015
GPS Presentation
summer-studentship-report-PDF
CSP Training series : solar resource assessment 1/2
Ad

Similar to Big Science, Big Data, and Big Computing for Advanced Hurricane Prediction (20)

PDF
Small Satellites Systems and Services CL24_2327.pdf
PPTX
MO3.L10 - STATUS OF PRE-LAUNCH ACTIVITIES FOR THE NPOESS COMMUNITY COLLABORAT...
PPT
One–day wave forecasts based on artificial neural networks
PDF
Research Frontiers in Space Weather, Part I
PPT
TU2.L10 - NEXT-GENERATION GLOBAL PRECIPITATION PRODUCTS AND THEIR APPLICATIONS
PPTX
C5.05: Fit for Purpose Marine Observations - Boris Kelly-Gerreyn
PDF
Solar output power forecast using an ensemble framework with neural predictor...
PDF
CFD down-scaling and online measurements for short-term wind power forecasting
PPTX
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
PPTX
CAMS GS Global Analyses
PPTX
Using the Pacific Research Platform for Earth Sciences Big Data
PDF
2202.11214.pdf
PPT
13-Fcst-NWP.ppt
PDF
From Dark to Light: Hydrogen and the First Stars
PDF
Goal andga oct01
PPTX
IGARSS2011_radarvolcanology.pptx
PPTX
NPOESS Transition to the Joint Polar Satellite System (JPSS) and Defense Weat...
PDF
Buckles_research
PDF
TRACKING ANALYSIS OF HURRICANE GONZALO USING AIRBORNE MICROWAVE RADIOMETER
PDF
TRACKING ANALYSIS OF HURRICANE GONZALO USING AIRBORNE MICROWAVE RADIOMETER
Small Satellites Systems and Services CL24_2327.pdf
MO3.L10 - STATUS OF PRE-LAUNCH ACTIVITIES FOR THE NPOESS COMMUNITY COLLABORAT...
One–day wave forecasts based on artificial neural networks
Research Frontiers in Space Weather, Part I
TU2.L10 - NEXT-GENERATION GLOBAL PRECIPITATION PRODUCTS AND THEIR APPLICATIONS
C5.05: Fit for Purpose Marine Observations - Boris Kelly-Gerreyn
Solar output power forecast using an ensemble framework with neural predictor...
CFD down-scaling and online measurements for short-term wind power forecasting
The Pacific Research Platform: A Regional-Scale Big Data Analytics Cyberinfra...
CAMS GS Global Analyses
Using the Pacific Research Platform for Earth Sciences Big Data
2202.11214.pdf
13-Fcst-NWP.ppt
From Dark to Light: Hydrogen and the First Stars
Goal andga oct01
IGARSS2011_radarvolcanology.pptx
NPOESS Transition to the Joint Polar Satellite System (JPSS) and Defense Weat...
Buckles_research
TRACKING ANALYSIS OF HURRICANE GONZALO USING AIRBORNE MICROWAVE RADIOMETER
TRACKING ANALYSIS OF HURRICANE GONZALO USING AIRBORNE MICROWAVE RADIOMETER
Ad

More from UCAR - Atmospheric & Earth System Science (19)

PDF
Computer Modeling Capabilities + Challenges for Earth System Predictions
PDF
The Role of the Oceans in Seamless Prediction, from Days to Seasons
PDF
How Subseasonal to Seasonal Forecasts Drive Analytics in the Cattle Industry
PDF
Research + Private Sector Partnerships - Climate information for social and e...
PDF
Advancing Weather Prediction to Address Critical Societal Needs
PDF
Science Enabling Industry: Federal Investment Propels the Economy
PPTX
Wildfires past, present, and future
PPTX
Fire Modeling - Understanding Wildland Fires
PPTX
Decision Support for Wildland Fire Management
PDF
Transforming NOAA Water Prediction for a Water-Prepared Nation
PDF
Community WRF-Hydro & Its Implementaton as the NOAA National Water Model
PDF
National Water Model: First Comprehensive Framework for Predicting Streamflow
PDF
Water for Ecosystems & Society: Mutual Benefits of the National Water Model &...
PDF
Using National Water Model Results to Benefit Industry
PDF
Research Frontiers in Space Weather, Part II
PDF
Space Weather Prediction - Next Steps: An industry and military perspective
PDF
Quick History and Notable Successes in Aviation Weather Safety
PDF
Forecasting Changing Sea Ice Conditions, Months to Years in Advance - State o...
PDF
Challenges, Risks & Opportunities in a Changing Arctic Environment - State of...
Computer Modeling Capabilities + Challenges for Earth System Predictions
The Role of the Oceans in Seamless Prediction, from Days to Seasons
How Subseasonal to Seasonal Forecasts Drive Analytics in the Cattle Industry
Research + Private Sector Partnerships - Climate information for social and e...
Advancing Weather Prediction to Address Critical Societal Needs
Science Enabling Industry: Federal Investment Propels the Economy
Wildfires past, present, and future
Fire Modeling - Understanding Wildland Fires
Decision Support for Wildland Fire Management
Transforming NOAA Water Prediction for a Water-Prepared Nation
Community WRF-Hydro & Its Implementaton as the NOAA National Water Model
National Water Model: First Comprehensive Framework for Predicting Streamflow
Water for Ecosystems & Society: Mutual Benefits of the National Water Model &...
Using National Water Model Results to Benefit Industry
Research Frontiers in Space Weather, Part II
Space Weather Prediction - Next Steps: An industry and military perspective
Quick History and Notable Successes in Aviation Weather Safety
Forecasting Changing Sea Ice Conditions, Months to Years in Advance - State o...
Challenges, Risks & Opportunities in a Changing Arctic Environment - State of...

Recently uploaded (20)

PPTX
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
PDF
Is Earendel a Star Cluster?: Metal-poor Globular Cluster Progenitors at z ∼ 6
PPTX
congenital heart diseases of burao university.pptx
PPTX
HAEMATOLOGICAL DISEASES lack of red blood cells, which carry oxygen throughou...
PPTX
endocrine - management of adrenal incidentaloma.pptx
PPTX
Platelet disorders - thrombocytopenia.pptx
PDF
Integrative Oncology: Merging Conventional and Alternative Approaches (www.k...
PPTX
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
PDF
Cosmology using numerical relativity - what hapenned before big bang?
PDF
Social preventive and pharmacy. Pdf
PPTX
02_OpenStax_Chemistry_Slides_20180406 copy.pptx
PPTX
LIPID & AMINO ACID METABOLISM UNIT-III, B PHARM II SEMESTER
PPT
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
PPTX
2currentelectricity1-201006102815 (1).pptx
PDF
Metabolic Acidosis. pa,oakw,llwla,wwwwqw
PDF
Science Form five needed shit SCIENEce so
PDF
CuO Nps photocatalysts 15156456551564161
PDF
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
PPT
Enhancing Laboratory Quality Through ISO 15189 Compliance
PDF
The Future of Telehealth: Engineering New Platforms for Care (www.kiu.ac.ug)
SCIENCE 4 Q2W5 PPT.pptx Lesson About Plnts and animals and their habitat
Is Earendel a Star Cluster?: Metal-poor Globular Cluster Progenitors at z ∼ 6
congenital heart diseases of burao university.pptx
HAEMATOLOGICAL DISEASES lack of red blood cells, which carry oxygen throughou...
endocrine - management of adrenal incidentaloma.pptx
Platelet disorders - thrombocytopenia.pptx
Integrative Oncology: Merging Conventional and Alternative Approaches (www.k...
GREEN FIELDS SCHOOL PPT ON HOLIDAY HOMEWORK
Cosmology using numerical relativity - what hapenned before big bang?
Social preventive and pharmacy. Pdf
02_OpenStax_Chemistry_Slides_20180406 copy.pptx
LIPID & AMINO ACID METABOLISM UNIT-III, B PHARM II SEMESTER
THE CELL THEORY AND ITS FUNDAMENTALS AND USE
2currentelectricity1-201006102815 (1).pptx
Metabolic Acidosis. pa,oakw,llwla,wwwwqw
Science Form five needed shit SCIENEce so
CuO Nps photocatalysts 15156456551564161
Worlds Next Door: A Candidate Giant Planet Imaged in the Habitable Zone of ↵ ...
Enhancing Laboratory Quality Through ISO 15189 Compliance
The Future of Telehealth: Engineering New Platforms for Care (www.kiu.ac.ug)

Big Science, Big Data, and Big Computing for Advanced Hurricane Prediction

  • 1. Big Science, Big Data and Big Computing for Advanced Hurricane Monitoring & Prediction Fuqing Zhang Director, Center for Advanced Data Assimilation and Predictability Techniques Professor, Department of Meteorology and Atmospheric Science Pennsylvania State University Research sponsored by NSF, ONR, NOAA and NASA FROM RESEARCH TO INDUSTRY: How Earth system science enables private sector innovation
  • 2. Track forecasts have improved drastically over past 25 years: a 3- day forecast today is as accurate as a 1-day forecast was in 1989. Intensity forecast accuracy has remained generally stagnant over that same period, except for the last few years, thanks to the Hurricane Forecast Improvement Program (HFIP) led by NOAA. National Hurricane Center Official TC Forecast Errors
  • 3. NSF HPC Computing At Texas Advanced Computing Center System Name: Ranger Operating System: Linux Number of Cores: 62,976 Total Memory: 123TB Peak Performance: 579.4TFlops Total Disk: 1.73PB (shared) HFIP Allocation : 30M SUs (July 1, 2008- 31 March 2009) Goals of NOAA’s Hurricane Forecast Improvement Project (HFIP) •  Reduce average track and intensity forecast error by half for days 1 through 5 •  Significantly increase the probability of detection for rapid intensity change and decrease false alarm ratio •  Extend lead time for hurricane forecasts out to Day 7 My team’s HFIP effort co-funded by ONR, NSF and NASA
  • 4. How to make better input to the hurricane models? High-resolution observations from Hurricane Hunters and UAVs: Provide crucial airborne inflight measurements, dropsondes, Doppler Radar Winds, … 50° ~ 3 km Data assimilation: The process of generating initial conditions for weather prediction models through combining the background model estimate, and all applicable up-to-date observations. NOAA P3 NASA Global Hawk
  • 5. PSU WRF-EnKF Hurricane Analysis & Prediction System with advanced assimilation of airborne Doppler Radar Vr Evaluated for all 100+ P3 TDR missions during 2008-2012 The PSU system uses the NCAR’s WRF model; TDR Methodology now adopted by NOAA . (F. Zhang and Y. Weng 2015, Bulletin of the American Meteorological Society) PSU WRF-EnKF Hurricane Intensity error (knots)
  • 7. ext Frontier: Geostationary Satellite GOES-R from NASA to NOAA
  • 8. Assimilating All-sky GOES-R Radiances: Harvey (2017) Independent observations vs. EnKF analysis of channel 10 PSU WRF-EnKF assimilates channel 8 radiances every 1 hour Research Funding Provided by ONR, NASA, NOAA and NSF
  • 9. Independent Observations vs. EnKF analysis Assimilating All-sky Satellite Radiances: Harvey (2017)
  • 10. PSU WRF-EnKF Harvey Forecast with GOES-R Assimilation in comparison with WRF(NoDA), operational HWRF & best track Research Supported by ONR, NASA, NOAA and NSF
  • 11. Research Supported by ONR, NASA, NOAA and NSF FV3 Prediction of Hurricane Harvey with a 3-km nested domain PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex FV3 3km-nest simulated radar reflectivity (left) vs. observations (right) at Landfall KCRPKCRP KHGXKHGXKEWX KEWX KGRKKGRK
  • 12. Research Supported by ONR, NASA, NOAA and NSF FV3 Prediction of Hurricane Harvey with a 3-km nested domain PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex FV3-forecasted (left) vs. observed event total rainfall (right) with 6-day lead time KCRP KHGX KEWX KGRK KLCH KPOE KSHV KLIX KCRP KHGX KEWX KGRK KLCH KPOE KSHV KLIX Point maximum of 40+ inches Point maximum of 50+ inches
  • 13. Promises of US’s Next-Generation Global Prediction System: FV3 Comparison with EC model on 1-year-mean 10-day-forecast 500mb anomaly correlations Forecast lead time (h) FV3 model with EC model initial condition (IC) comparable to EC day 1-7 but better thereafter; FV3 model with current GFS initial condition is considerably worse than either run with EC IC; US forecast is inferior due mostly to poorer IC, inferior data assimilation ingesting less data Courtesy of Linus Magnusson at ECMWF and SJ Lin at NOAA/GFDL AnomalyCorrelationCoefficient(ACC)
  • 14. From Research to Industry Concluding Remarks: Invest on big data hurricane science •  There are great potentials and needs for improving hurricane prediction through collaborative research and sustained federal investment on data, science and personnel •  Future hurricane prediction advances may come from the following areas: •  Observations: advanced observing systems such as those from airborne dropsondes, Doppler radar and weather satellites •  Model: cutting-edge higher-resolution weather prediction models with more accurate numerics and physics •  Data assimilation: comprehensive algorithms and methodologies that that can more effectively ingest existing and future observations into state-of-science models •  Computing: high-performance computing facilities that can perform advanced analysis and forecasting in a timely manner.
  • 15. + 3 kts initial intensity error Shear only Initial V + shear Track Initial + track Initial inner core moisture error Predictability and Error Sources of Hurricane Intensity Forecast (Emanuel and Zhang 2016, Journal of Atmospheric Sciences)
  • 16. With realtime EnKF assimilation of airborne Doppler winds (Zhang and Weng, 2015 BAMS) What “big data” means for hurricane research: ensembles
  • 17. Research Supported by ONR, NASA, NOAA and NSF FV3 Prediction of Hurricane Harvey with a 3-km nested domain PSU WRF-EnKF GOES-R assimilation used for FV3 initial vortex in comparison with FV3(GFS), operational GFS, EC & best track Ongoing PSU collaboration with NOAA/GFDL