A 14.6 billion degrees of freedom, 5 teraflops, 2.5 terabyte earthquake simulation on the Earth simulator

Dimitri Komatitsch, Seiji Tsuboi, Chen Ji, Jeroen Tromp

Research output: Chapter in Book/Report/Conference proceedingConference contribution

72 Scopus citations

Abstract

We use 1944 processors of the Earth Simulator to model seismic wave propagation resulting from large earthquakes. Simulations are conducted based upon the spectral-element method, a high-degree finite-element technique with an exactly diagonal mass matrix. We use a very large mesh with 5.5 billion grid points (14.6 billion degrees of freedom). We include the full complexity of the Earth, i.e., a three-dimensional wave-speed and density structure, a 3-D crustal model, ellipticity as well as topography and bathymetry. A total of 2.5 terabytes of memory is needed. Our implementation is purely based upon MPI, with loop vectorization on each processor. We obtain an excellent vectorization ratio of 99.3%, and we reach a performance of 5 teraflops (30% of the peak performance) on 38% of the machine. The very high resolution of the mesh allows us to perform fully three-dimensional calculations at seismic periods as low as 5 seconds.

Original languageEnglish (US)
Title of host publicationProceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003
DOIs
StatePublished - Dec 1 2003
Event2003 ACM/IEEE Conference on Supercomputing, SC 2003 - Phoenix, AZ, United States
Duration: Nov 15 2003Nov 21 2003

Publication series

NameProceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003

Other

Other2003 ACM/IEEE Conference on Supercomputing, SC 2003
CountryUnited States
CityPhoenix, AZ
Period11/15/0311/21/03

All Science Journal Classification (ASJC) codes

  • Software

Fingerprint Dive into the research topics of 'A 14.6 billion degrees of freedom, 5 teraflops, 2.5 terabyte earthquake simulation on the Earth simulator'. Together they form a unique fingerprint.

  • Cite this

    Komatitsch, D., Tsuboi, S., Ji, C., & Tromp, J. (2003). A 14.6 billion degrees of freedom, 5 teraflops, 2.5 terabyte earthquake simulation on the Earth simulator. In Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003 (Proceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003). https://doi.org/10.1145/1048935.1050155