TY - GEN

T1 - A 14.6 billion degrees of freedom, 5 teraflops, 2.5 terabyte earthquake simulation on the Earth simulator

AU - Komatitsch, Dimitri

AU - Tsuboi, Seiji

AU - Ji, Chen

AU - Tromp, Jeroen

PY - 2003/12/1

Y1 - 2003/12/1

N2 - We use 1944 processors of the Earth Simulator to model seismic wave propagation resulting from large earthquakes. Simulations are conducted based upon the spectral-element method, a high-degree finite-element technique with an exactly diagonal mass matrix. We use a very large mesh with 5.5 billion grid points (14.6 billion degrees of freedom). We include the full complexity of the Earth, i.e., a three-dimensional wave-speed and density structure, a 3-D crustal model, ellipticity as well as topography and bathymetry. A total of 2.5 terabytes of memory is needed. Our implementation is purely based upon MPI, with loop vectorization on each processor. We obtain an excellent vectorization ratio of 99.3%, and we reach a performance of 5 teraflops (30% of the peak performance) on 38% of the machine. The very high resolution of the mesh allows us to perform fully three-dimensional calculations at seismic periods as low as 5 seconds.

AB - We use 1944 processors of the Earth Simulator to model seismic wave propagation resulting from large earthquakes. Simulations are conducted based upon the spectral-element method, a high-degree finite-element technique with an exactly diagonal mass matrix. We use a very large mesh with 5.5 billion grid points (14.6 billion degrees of freedom). We include the full complexity of the Earth, i.e., a three-dimensional wave-speed and density structure, a 3-D crustal model, ellipticity as well as topography and bathymetry. A total of 2.5 terabytes of memory is needed. Our implementation is purely based upon MPI, with loop vectorization on each processor. We obtain an excellent vectorization ratio of 99.3%, and we reach a performance of 5 teraflops (30% of the peak performance) on 38% of the machine. The very high resolution of the mesh allows us to perform fully three-dimensional calculations at seismic periods as low as 5 seconds.

UR - http://www.scopus.com/inward/record.url?scp=84877030797&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877030797&partnerID=8YFLogxK

U2 - 10.1145/1048935.1050155

DO - 10.1145/1048935.1050155

M3 - Conference contribution

AN - SCOPUS:84877030797

SN - 1581136951

SN - 9781581136951

T3 - Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003

BT - Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003

T2 - 2003 ACM/IEEE Conference on Supercomputing, SC 2003

Y2 - 15 November 2003 through 21 November 2003

ER -