DeepHyper: A Python Package for Massively Parallel Hyperparameter Optimization in Machine Learning.

Romain Egele Romain Égelé https://orcid.org/0000-0002-8992-8192

Romain Egele Prasanna Balaprakash Gavin M. Wiggins Brett Eiffert DeepHyper: A Python Package for Massively Parallel Hyperparameter Optimization in Machine Learning. 7975 2025 June 10 J. Open Source Softw. 110 https://doi.org/10.21105/joss.07975 db/journals/jossw/jossw10.html#EgeleBWE25 streams/journals/jossw

Romain Egele Prasanna Balaprakash Gavin M. Wiggins Brett Eiffert DeepHyper: Massively Parallel Hyperparameter Optimization for Machine Learning. 2025 May https://doi.org/10.5281/zenodo.15387374 Zenodo streams/repo/zenodo

Yixuan Sun Romain Egele Sri Hari Krishna Narayanan Luke Van Roekel Carmelo Gonzales Steven Brus Balu Nadiga Sandeep Madireddy Prasanna Balaprakash Ensembles of Neural Surrogates for Parametric Sensitivity in Ocean Modeling. 2025 August abs/2508.16489 CoRR https://doi.org/10.48550/arXiv.2508.16489 db/journals/corr/corr2508.html#abs-2508-16489 streams/journals/corr

Romain Egele Optimization of Learning Workflows at Large Scale on High-Performance Computing Systems. (Optimisation de Processus d'Apprentissage à Grande Échelle sur des Systèmes de Calcul Haute-Performance). 2024 University of Paris-Saclay, France https://tel.archives-ouvertes.fr/tel-04636586

Xin Liu Mario Rüttgers Alessio Quercia Romain Egele Elisabeth Pfaehler Rushikesh Shende Marcel Aach Wolfgang Schröder 0001 Prasanna Balaprakash Andreas Lintermann Refining computer tomography data with super-resolution networks to increase the accuracy of respiratory flow simulations. 474-488 2024 159 Future Gener. Comput. Syst. https://doi.org/10.1016/j.future.2024.05.020 db/journals/fgcs/fgcs159.html#LiuRQEPSASBL24 streams/journals/fgcs

Romain Egele Felix Mohr Tom J. Viering Prasanna Balaprakash The unreasonable effectiveness of early discarding after one epoch in neural network hyperparameter optimization. 127964 2024 597 Neurocomputing https://doi.org/10.1016/j.neucom.2024.127964 db/journals/ijon/ijon597.html#EgeleMVB24

Birhanu Hailu Belay Isabelle Guyon Tadele Mengiste Bezawork Tilahun Marcus Liwicki Tesfa Tegegne Romain Egele A Historical Handwritten Dataset for Ethiopic OCR with Baseline Models and Human-Level Performance. 23-38 2024 ICDAR (3) https://doi.org/10.1007/978-3-031-70543-4_2 conf/icdar/2024-3 db/conf/icdar/icdar2024-3.html#BelayGMTLTE24 streams/conf/icdar Sajal Dash Isaac Lyngaas Junqi Yin Xiao Wang 0004 Romain Egele J. Austin Ellis Matthias Maiterth Guojing Cong Feiyi Wang Prasanna Balaprakash Optimizing Distributed Training on Frontier for Large Language Models. 1-11 2024 ISC High Performance https://doi.org/10.23919/ISC.2024.10528939 conf/supercomputer/2024 db/conf/supercomputer/isc2024.html#DashLYWEEMCWB24

Romain Egele Felix Mohr Tom J. Viering Prasanna Balaprakash The Unreasonable Effectiveness Of Early Discarding After One Epoch In Neural Network Hyperparameter Optimization. 2024 abs/2404.04111 CoRR https://doi.org/10.48550/arXiv.2404.04111 db/journals/corr/corr2404.html#abs-2404-04111

Yixuan Sun Olaperi Yeside Sowunmi Romain Egele Sri Hari Krishna Narayanan Luke Van Roekel Prasanna Balaprakash Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach. 2024 abs/2404.05768 CoRR https://doi.org/10.48550/arXiv.2404.05768 db/journals/corr/corr2404.html#abs-2404-05768

Romain Egele Júlio C. S. Jacques Júnior Jan N. van Rijn Isabelle Guyon Xavier Baró Albert Clapés Prasanna Balaprakash Sergio Escalera Thomas B. Moeslund Jun Wan 0001 AI Competitions and Benchmarks: Dataset Development. 2024 abs/2404.09703 CoRR https://doi.org/10.48550/arXiv.2404.09703 db/journals/corr/corr2404.html#abs-2404-09703

Romain Égelé Isabelle Guyon Venkatram Vishwanath Prasanna Balaprakash Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization. 1-10 2023 e-Science https://doi.org/10.1109/e-Science58273.2023.10254839 conf/eScience/2023 db/conf/eScience/eScience2023.html#EgeleGVB23 Romain Egele Isabelle Guyon Yixuan Sun Prasanna Balaprakash Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization? 2023 ESANN https://doi.org/10.14428/esann/2023.ES2023-84 conf/esann/2023 db/conf/esann/esann2023.html#EgeleGSB23

Romit Maulik Romain Egele Krishnan Raghavan Prasanna Balaprakash Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles. 2023 abs/2302.09748 CoRR https://doi.org/10.48550/arXiv.2302.09748 db/journals/corr/corr2302.html#abs-2302-09748

Romain Egele Isabelle Guyon Yixuan Sun Prasanna Balaprakash Is One Epoch All You Need For Multi-Fidelity Hyperparameter Optimization? 2023 abs/2307.15422 CoRR https://doi.org/10.48550/arXiv.2307.15422 db/journals/corr/corr2307.html#abs-2307-15422

Romain Egele Tyler H. Chang Yixuan Sun Venkatram Vishwanath Prasanna Balaprakash Parallel Multi-Objective Hyperparameter Optimization with Uniform Normalization and Bounded Objectives. 2023 abs/2309.14936 CoRR https://doi.org/10.48550/arXiv.2309.14936 db/journals/corr/corr2309.html#abs-2309-14936

Sajal Dash Isaac Lyngaas Junqi Yin Xiao Wang 0004 Romain Egele Guojing Cong Feiyi Wang Prasanna Balaprakash Optimizing Distributed Training on Frontier for Large Language Models. 2023 abs/2312.12705 CoRR https://doi.org/10.48550/arXiv.2312.12705 db/journals/corr/corr2312.html#abs-2312-12705

Matthieu Dorier Romain Egele Prasanna Balaprakash Jaehoon Koo Sandeep Madireddy Srinivasan Ramesh Allen D. Malony Robert B. Ross HPC Storage Service Autotuning Using Variational- Autoencoder -Guided Asynchronous Bayesian Optimization. 381-393 2022 CLUSTER https://doi.org/10.1109/CLUSTER51413.2022.00049 conf/cluster/2022 db/conf/cluster/cluster2022.html#DorierEBKMRMR22 Romain Egele Romit Maulik Krishnan Raghavan Bethany Lusch Isabelle Guyon Prasanna Balaprakash AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification. 1908-1914 2022 ICPR https://doi.org/10.1109/ICPR56361.2022.9956231 conf/icpr/2022 db/conf/icpr/icpr2022.html#EgeleMRLGB22

Romain Egele Joceran Gouneau Venkatram Vishwanath Isabelle Guyon Prasanna Balaprakash Asynchronous Distributed Bayesian Optimization at HPC Scale. 2022 abs/2207.00479 CoRR https://doi.org/10.48550/arXiv.2207.00479 db/journals/corr/corr2207.html#abs-2207-00479

Romain Égelé Prasanna Balaprakash Isabelle Guyon Venkatram Vishwanath Fangfang Xia Rick Stevens Zhengying Liu AgEBO-tabular: joint neural architecture and hyperparameter search with autotuned data-parallel training for tabular data. 30 2021 SC https://doi.org/10.1145/3458817.3476203 conf/sc/2021 db/conf/sc/sc2021.html#EgeleBGVXSL21

Romain Egele Romit Maulik Krishnan Raghavan Prasanna Balaprakash Bethany Lusch AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification. 2021 abs/2110.13511 CoRR https://arxiv.org/abs/2110.13511 db/journals/corr/corr2110.html#abs-2110-13511

Romit Maulik Romain Egele Bethany Lusch Prasanna Balaprakash Recurrent neural network architecture search for geophysical emulation. 8 2020 SC https://doi.org/10.1109/SC41405.2020.00012 https://dl.acm.org/doi/10.5555/3433701.3433711 conf/sc/2020 db/conf/sc/sc2020.html#MaulikELB20

Romain Egele Prasanna Balaprakash Venkatram Vishwanath Isabelle Guyon Zhengying Liu AgEBO-Tabular: Joint Neural Architecture and Hyperparameter Search with Autotuned Data-Parallel Training for Tabular Data. 2020 abs/2010.16358 CoRR https://arxiv.org/abs/2010.16358 db/journals/corr/corr2010.html#abs-2010-16358

Prasanna Balaprakash Romain Egele Misha Salim Stefan M. Wild Venkatram Vishwanath Fangfang Xia Tom Brettin Rick Stevens Scalable reinforcement-learning-based neural architecture search for cancer deep learning research. 37:1-37:33 2019 SC https://doi.org/10.1145/3295500.3356202 conf/sc/2019 db/conf/sc/sc2019.html#BalaprakashESWV19

Prasanna Balaprakash Romain Egele Misha Salim Stefan M. Wild Venkatram Vishwanath Fangfang Xia Tom Brettin Rick Stevens Scalable Reinforcement-Learning-Based Neural Architecture Search for Cancer Deep Learning Research. 2019 abs/1909.00311 CoRR http://arxiv.org/abs/1909.00311 db/journals/corr/corr1909.html#abs-1909-00311

Marcel Aach Prasanna Balaprakash Xavier Baró Birhanu BelayBirhanu Hailu Belay Thomas S. BrettinTom Brettin Steven Brus Tyler H. Chang Albert Clapés Guojing Cong Sajal Dash Matthieu Dorier Brett Eiffert J. Austin Ellis Sergio Escalera Carmelo Gonzales Joceran Gouneau Isabelle Guyon Júlio C. S. Jacques Júnior Jaehoon Koo Raghavan KrishnanKrishnan Raghavan Andreas Lintermann Xin Liu Zhengying Liu Marcus Liwicki Bethany Lusch Isaac Lyngaas Sandeep Madireddy Matthias Maiterth Allen D. Malony Romit Maulik Tadele Mengiste Thomas B. Moeslund Felix Mohr Balasubramanya T. NadigaBalu Nadiga Sri Hari Krishna Narayanan Elisabeth Pfaehler Alessio Quercia Srinivasan Ramesh Jan N. van Rijn Luke Van Roekel Robert B. Ross Mario Rüttgers Misha Salim Wolfgang Schröder 0001 Rushikesh Shende Olaperi Yeside Sowunmi Rick L. StevensRick Stevens Yixuan Sun Tesfa Tegegne Bezawork Tilahun Tom J. Viering Venkatram Vishwanath Jun Wan 0001 Feiyi Wang Xiao Wang 0004 Gavin M. Wiggins Stefan M. Wild Fangfang Xia Junqi Yin