TY - JOUR
T1 - Accelerating the Lagrangian particle tracking of residence time distributions and source water mixing towards large scales
AU - Yang, Chen
AU - Zhang, You Kuan
AU - Liang, Xiuyu
AU - Olschanowsky, Catherine
AU - Yang, Xiaofan
AU - Maxwell, Reed
N1 - Publisher Copyright:
© 2021 Elsevier Ltd
PY - 2021/6
Y1 - 2021/6
N2 - Travel/residence time distributions (TTDs/RTDs) are important tools to evaluate the vulnerability of catchments to contamination and understand many aspects of catchment function and behavior. In recent years, the calculation of TTDs/RTDs based on the Lagrangian particle tracking approach together with the integrated hydrologic modeling has become a popular counterpart to analytical approaches and lumped numerical models. As global water availability becomes more stressed due to anthropogenic disturbance and climate change, the requirement of large-scale and long-term simulations for TTDs/RTDs further pushes the high computational costs of Lagrangian particle tracking. Hence, speeding up the Lagrangian particle tracking approach becomes an important barrier to advancement. In this study, we accelerate the Lagrangian particle tracking program EcoSLIM, using a combination of distributed (e.g. MPI) and manycore accelerator (CUDA) approaches for large-scale and long-term simulations. EcoSLIM was developed to be seamlessly paired with the integrated ParFlow.CLM model for calculations of transient RTDs and source water mixing and was originally developed using threaded OpenMP. This work extends this implementation to compare combinations of MPI, CUDA and OpenMP. Of these combinations, the OpenMP-CUDA parallelism performed the best moving from single-GPU to multi-GPU. The multi-GPU shows strong scalability which becomes increasingly efficient with more particles, demonstrating a potential feasibility for regional-scale, transient residence time simulations. This work largely improves the computational capability of EcoSLIM, and results also show the advantages of using GPU to traditional parallel-APIs (application programming interfaces) and its potential to widely accelerate the next generation programs in subsurface environment modeling.
AB - Travel/residence time distributions (TTDs/RTDs) are important tools to evaluate the vulnerability of catchments to contamination and understand many aspects of catchment function and behavior. In recent years, the calculation of TTDs/RTDs based on the Lagrangian particle tracking approach together with the integrated hydrologic modeling has become a popular counterpart to analytical approaches and lumped numerical models. As global water availability becomes more stressed due to anthropogenic disturbance and climate change, the requirement of large-scale and long-term simulations for TTDs/RTDs further pushes the high computational costs of Lagrangian particle tracking. Hence, speeding up the Lagrangian particle tracking approach becomes an important barrier to advancement. In this study, we accelerate the Lagrangian particle tracking program EcoSLIM, using a combination of distributed (e.g. MPI) and manycore accelerator (CUDA) approaches for large-scale and long-term simulations. EcoSLIM was developed to be seamlessly paired with the integrated ParFlow.CLM model for calculations of transient RTDs and source water mixing and was originally developed using threaded OpenMP. This work extends this implementation to compare combinations of MPI, CUDA and OpenMP. Of these combinations, the OpenMP-CUDA parallelism performed the best moving from single-GPU to multi-GPU. The multi-GPU shows strong scalability which becomes increasingly efficient with more particles, demonstrating a potential feasibility for regional-scale, transient residence time simulations. This work largely improves the computational capability of EcoSLIM, and results also show the advantages of using GPU to traditional parallel-APIs (application programming interfaces) and its potential to widely accelerate the next generation programs in subsurface environment modeling.
KW - Integrated modeling
KW - Lagrangian particle tracking
KW - MPI
KW - Multi-GPU
KW - Travel/residence time distributions
UR - http://www.scopus.com/inward/record.url?scp=85103687184&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103687184&partnerID=8YFLogxK
U2 - 10.1016/j.cageo.2021.104760
DO - 10.1016/j.cageo.2021.104760
M3 - Article
AN - SCOPUS:85103687184
SN - 0098-3004
VL - 151
JO - Computers and Geosciences
JF - Computers and Geosciences
M1 - 104760
ER -