Contribution to a conference proceedings/Contribution to a book DZNE-2025-01035

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
HydroGym: A Reinforcement Learning Platform for Fluid Dynamics

 ;  ;  ;  ;  ;  ;  ;  ;

2025
ML Research Press

Proceedings of the 7th Annual Learning for Dynamics & Control Conference
7th Annual Learning for Dynamics and Control Conference, L4DC 2025, Ann Arbor, MIAnn Arbor, MI, USA, 4 Jun 2025 - 6 Jun 20252025-06-042025-06-06
ML Research Press 283, 497 - 512 ()

Abstract: The modeling and control of fluid flows remain a significant challenge with tremendous potential to advance fields including transportation, energy, and medicine. Effective fluid flow control can lead to drag reduction, enhanced mixing, and noise reduction, among other applications. While reinforcement learning (RL) has shown great success in complex domains, such as robotics and protein folding, its application to flow control is hindered by the lack of standardized platforms and the computational demands of fluid simulations. To address these challenges, we introduce HydroGym, a solver-independent RL platform for flow control research. HydroGym integrates sophisticated flow control benchmarks, a scalable runtime, and state-of-the-art RL algorithms. Our platform includes four validated non-differentiable fluid flow environments and one differentiable environment, all evaluated with a variety of modern RL algorithms. HydroGym’s scalable design allows computations to run seamlessly from laptops to high-performance computing resources, providing a standardized interface for implementing new flow environments. HydroGym aims to bridge the gap in flow control research, providing a robust platform to support both non-differentiable and differentiable RL techniques, fostering advancements in scientific machine learning.


Contributing Institute(s):
  1. Statistics and Machine Learning (AG Mukherjee)
Research Program(s):
  1. 354 - Disease Prevention and Healthy Aging (POF4-354) (POF4-354)

Appears in the scientific report 2025
Click to display QR Code for this record

The record appears in these collections:
Document types > Events > Contributions to a conference proceedings
Document types > Books > Contribution to a book
Institute Collections > BN DZNE > BN DZNE-AG Mukherjee
Public records
Publications Database

 Record created 2025-09-02, last modified 2025-09-18


Fulltext:
Download fulltext PDF Download fulltext PDF (PDFA)
External link:
Download fulltextFulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)