Invited Paper: Initial Steps Toward a Compiler for Distributed Programs

Joseph M. Hellerstein; Shadaj Laddad; Mae Milano; Conor Power; Mingwei Samuel

doi:10.1145/3584684.3597272

Invited Paper: Initial Steps Toward a Compiler for Distributed Programs

Joseph M. Hellerstein, Shadaj Laddad, Mae Milano, Conor Power, Mingwei Samuel

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In the Hydro project we are designing a compiler toolkit that can optimize for the concerns of distributed systems, including scale-up and scale-down, availability, and consistency of outcomes across replicas. This invited paper overviews the project, and provides an early walk-through of the kind of optimization that is possible. We illustrate how type transformations as well as local program transformations can combine, step by step, to convert a single-node program into a variety of distributed design points that offer the same semantics with different performance and deployment characteristics.

Original language	English (US)
Title of host publication	Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023
Publisher	Association for Computing Machinery, Inc
ISBN (Electronic)	9798400701283
DOIs	https://doi.org/10.1145/3584684.3597272
State	Published - Jun 19 2023
Externally published	Yes
Event	5th Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023 - Orlando, United States Duration: Jun 19 2023 → …

Publication series

Name	Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023

Conference

Conference	5th Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023
Country/Territory	United States
City	Orlando
Period	6/19/23 → …

All Science Journal Classification (ASJC) codes

Artificial Intelligence
Computational Theory and Mathematics
Theoretical Computer Science

Keywords

compiler
dataflow
distributed computing
programming languages
query optimization

Access to Document

10.1145/3584684.3597272

Cite this

Hellerstein, J. M., Laddad, S., Milano, M., Power, C., & Samuel, M. (2023). Invited Paper: Initial Steps Toward a Compiler for Distributed Programs. In Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023 Article 5 (Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023). Association for Computing Machinery, Inc. https://doi.org/10.1145/3584684.3597272

Hellerstein, Joseph M. ; Laddad, Shadaj ; Milano, Mae et al. / Invited Paper : Initial Steps Toward a Compiler for Distributed Programs. Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023. Association for Computing Machinery, Inc, 2023. (Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023).

@inproceedings{5aeb45cb4c964e4c8b88d5d807a691da,

title = "Invited Paper: Initial Steps Toward a Compiler for Distributed Programs",

abstract = "In the Hydro project we are designing a compiler toolkit that can optimize for the concerns of distributed systems, including scale-up and scale-down, availability, and consistency of outcomes across replicas. This invited paper overviews the project, and provides an early walk-through of the kind of optimization that is possible. We illustrate how type transformations as well as local program transformations can combine, step by step, to convert a single-node program into a variety of distributed design points that offer the same semantics with different performance and deployment characteristics.",

keywords = "compiler, dataflow, distributed computing, programming languages, query optimization",

author = "Hellerstein, {Joseph M.} and Shadaj Laddad and Mae Milano and Conor Power and Mingwei Samuel",

note = "Publisher Copyright: {\textcopyright} 2023 Copyright held by the owner/author(s).; 5th Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023 ; Conference date: 19-06-2023",

year = "2023",

month = jun,

day = "19",

doi = "10.1145/3584684.3597272",

language = "English (US)",

series = "Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023",

publisher = "Association for Computing Machinery, Inc",

booktitle = "Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023",

}

Hellerstein, JM, Laddad, S, Milano, M, Power, C & Samuel, M 2023, Invited Paper: Initial Steps Toward a Compiler for Distributed Programs. in Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023., 5, Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023, Association for Computing Machinery, Inc, 5th Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023, Orlando, United States, 6/19/23. https://doi.org/10.1145/3584684.3597272

Invited Paper: Initial Steps Toward a Compiler for Distributed Programs. / Hellerstein, Joseph M.; Laddad, Shadaj; Milano, Mae et al.
Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023. Association for Computing Machinery, Inc, 2023. 5 (Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Invited Paper

T2 - 5th Workshop on Advanced Tools, Programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023

AU - Hellerstein, Joseph M.

AU - Laddad, Shadaj

AU - Milano, Mae

AU - Power, Conor

AU - Samuel, Mingwei

PY - 2023/6/19

Y1 - 2023/6/19

N2 - In the Hydro project we are designing a compiler toolkit that can optimize for the concerns of distributed systems, including scale-up and scale-down, availability, and consistency of outcomes across replicas. This invited paper overviews the project, and provides an early walk-through of the kind of optimization that is possible. We illustrate how type transformations as well as local program transformations can combine, step by step, to convert a single-node program into a variety of distributed design points that offer the same semantics with different performance and deployment characteristics.

AB - In the Hydro project we are designing a compiler toolkit that can optimize for the concerns of distributed systems, including scale-up and scale-down, availability, and consistency of outcomes across replicas. This invited paper overviews the project, and provides an early walk-through of the kind of optimization that is possible. We illustrate how type transformations as well as local program transformations can combine, step by step, to convert a single-node program into a variety of distributed design points that offer the same semantics with different performance and deployment characteristics.

KW - compiler

KW - dataflow

KW - distributed computing

KW - programming languages

KW - query optimization

UR - http://www.scopus.com/inward/record.url?scp=85163824778&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85163824778&partnerID=8YFLogxK

U2 - 10.1145/3584684.3597272

DO - 10.1145/3584684.3597272

M3 - Conference contribution

AN - SCOPUS:85163824778

T3 - Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023

BT - Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023

PB - Association for Computing Machinery, Inc

Y2 - 19 June 2023

ER -

Hellerstein JM, Laddad S, Milano M, Power C, Samuel M. Invited Paper: Initial Steps Toward a Compiler for Distributed Programs. In Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023. Association for Computing Machinery, Inc. 2023. 5. (Proceedings of the 5th Workshop on Advanced Tools, programming Languages, and PLatforms for Implementing and Evaluating Algorithms for Distributed Systems, ApPLIED 2023). doi: 10.1145/3584684.3597272

Invited Paper: Initial Steps Toward a Compiler for Distributed Programs

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Keywords

Access to Document

Other files and links

Fingerprint

Cite this