TY - GEN
T1 - Using small abstractions to program large distributed systems
AU - Thain, Douglas
AU - Moretti, Christopher
AU - Bui, Hoang
AU - Yu, Li
AU - Chawla, Nitesh
AU - Flynn, Patrick
PY - 2008
Y1 - 2008
N2 - Distributed systems such as clusters, clouds and grids remain a difficult platform for executing large data intensive workloads. Even sophisticated users struggle to shape complex workloads into the simple "assembly language" of file transfer and job submission. To address this, problem, we advocate the use of abstractions, which are simple frameworks for expressing large structured problems. In this talk, we will discuss three examples of abstractions developed at the University of Notre Dame for scientific applications. In each case, we have been able to scale up workloads one to wto orders of magnitude larger than we previously feasible. Through each example, we will address some persistent obstacles in the field of distributed computing.
AB - Distributed systems such as clusters, clouds and grids remain a difficult platform for executing large data intensive workloads. Even sophisticated users struggle to shape complex workloads into the simple "assembly language" of file transfer and job submission. To address this, problem, we advocate the use of abstractions, which are simple frameworks for expressing large structured problems. In this talk, we will discuss three examples of abstractions developed at the University of Notre Dame for scientific applications. In each case, we have been able to scale up workloads one to wto orders of magnitude larger than we previously feasible. Through each example, we will address some persistent obstacles in the field of distributed computing.
KW - Abstractions
KW - Distributed systems
KW - Programming languages
UR - http://www.scopus.com/inward/record.url?scp=62749139574&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=62749139574&partnerID=8YFLogxK
U2 - 10.1109/eScience.2008.138
DO - 10.1109/eScience.2008.138
M3 - Conference contribution
AN - SCOPUS:62749139574
SN - 9780769535357
T3 - Proceedings - 4th IEEE International Conference on eScience, eScience 2008
SP - 723
EP - 724
BT - Proceedings - 4th IEEE International Conference on eScience, eScience 2008
T2 - 4th IEEE International Conference on eScience, eScience 2008
Y2 - 7 December 2008 through 12 December 2008
ER -