Challenges in executing data intensive biometric workloads on a desktop grid

Christopher Moretti; Timothy C. Faltemier; Douglas Thain; Patrick J. Flynn

doi:10.1109/IPDPS.2007.370671

Challenges in executing data intensive biometric workloads on a desktop grid

Christopher Moretti, Timothy C. Faltemier, Douglas Thain, Patrick J. Flynn

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Desktop grids have traditionally focused on executing computation intensive workloads. Can they also be used to execute data-intensive workloads? To answer this question, we present a case study of a data intensive biometric application which is infeasible to process on a single machine. We evaluate the capacity of a desktop grid to store and deliver the data need to execute the workload, and compare several general techniques for data deployment. Selecting the most scalable technique, we execute and evaluate five large production workloads on a 350-CPU desktop grid. We observe that this technique is sensitive to many parameters, and propose that an ideal system should be responsible for choosing the proper decomposition of a workload.

Original language	English (US)
Title of host publication	Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM
DOIs	https://doi.org/10.1109/IPDPS.2007.370671
State	Published - 2007
Externally published	Yes
Event	21st International Parallel and Distributed Processing Symposium, IPDPS 2007 - Long Beach, CA, United States Duration: Mar 26 2007 → Mar 30 2007

Publication series

Name	Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

Other

Other	21st International Parallel and Distributed Processing Symposium, IPDPS 2007
Country/Territory	United States
City	Long Beach, CA
Period	3/26/07 → 3/30/07

All Science Journal Classification (ASJC) codes

Hardware and Architecture
Software
General Mathematics

Access to Document

10.1109/IPDPS.2007.370671

Cite this

Moretti, C., Faltemier, T. C., Thain, D., & Flynn, P. J. (2007). Challenges in executing data intensive biometric workloads on a desktop grid. In Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM Article 4228399 (Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM). https://doi.org/10.1109/IPDPS.2007.370671

Moretti, Christopher ; Faltemier, Timothy C. ; Thain, Douglas et al. / Challenges in executing data intensive biometric workloads on a desktop grid. Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM. 2007. (Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM).

@inproceedings{85ee7e69b1ab4bffbb8c43acafa27f8d,

title = "Challenges in executing data intensive biometric workloads on a desktop grid",

abstract = "Desktop grids have traditionally focused on executing computation intensive workloads. Can they also be used to execute data-intensive workloads? To answer this question, we present a case study of a data intensive biometric application which is infeasible to process on a single machine. We evaluate the capacity of a desktop grid to store and deliver the data need to execute the workload, and compare several general techniques for data deployment. Selecting the most scalable technique, we execute and evaluate five large production workloads on a 350-CPU desktop grid. We observe that this technique is sensitive to many parameters, and propose that an ideal system should be responsible for choosing the proper decomposition of a workload.",

author = "Christopher Moretti and Faltemier, {Timothy C.} and Douglas Thain and Flynn, {Patrick J.}",

year = "2007",

doi = "10.1109/IPDPS.2007.370671",

language = "English (US)",

isbn = "1424409101",

series = "Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM",

booktitle = "Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM",

}

Moretti, C, Faltemier, TC, Thain, D & Flynn, PJ 2007, Challenges in executing data intensive biometric workloads on a desktop grid. in Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM., 4228399, Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM, 21st International Parallel and Distributed Processing Symposium, IPDPS 2007, Long Beach, CA, United States, 3/26/07. https://doi.org/10.1109/IPDPS.2007.370671

Challenges in executing data intensive biometric workloads on a desktop grid. / Moretti, Christopher; Faltemier, Timothy C.; Thain, Douglas et al.
Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM. 2007. 4228399 (Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Challenges in executing data intensive biometric workloads on a desktop grid

AU - Moretti, Christopher

AU - Faltemier, Timothy C.

AU - Thain, Douglas

AU - Flynn, Patrick J.

PY - 2007

Y1 - 2007

N2 - Desktop grids have traditionally focused on executing computation intensive workloads. Can they also be used to execute data-intensive workloads? To answer this question, we present a case study of a data intensive biometric application which is infeasible to process on a single machine. We evaluate the capacity of a desktop grid to store and deliver the data need to execute the workload, and compare several general techniques for data deployment. Selecting the most scalable technique, we execute and evaluate five large production workloads on a 350-CPU desktop grid. We observe that this technique is sensitive to many parameters, and propose that an ideal system should be responsible for choosing the proper decomposition of a workload.

AB - Desktop grids have traditionally focused on executing computation intensive workloads. Can they also be used to execute data-intensive workloads? To answer this question, we present a case study of a data intensive biometric application which is infeasible to process on a single machine. We evaluate the capacity of a desktop grid to store and deliver the data need to execute the workload, and compare several general techniques for data deployment. Selecting the most scalable technique, we execute and evaluate five large production workloads on a 350-CPU desktop grid. We observe that this technique is sensitive to many parameters, and propose that an ideal system should be responsible for choosing the proper decomposition of a workload.

UR - http://www.scopus.com/inward/record.url?scp=34548801532&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34548801532&partnerID=8YFLogxK

U2 - 10.1109/IPDPS.2007.370671

DO - 10.1109/IPDPS.2007.370671

M3 - Conference contribution

AN - SCOPUS:34548801532

SN - 1424409101

SN - 9781424409105

T3 - Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

BT - Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM

T2 - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007

Y2 - 26 March 2007 through 30 March 2007

ER -

Moretti C, Faltemier TC, Thain D, Flynn PJ. Challenges in executing data intensive biometric workloads on a desktop grid. In Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM. 2007. 4228399. (Proceedings - 21st International Parallel and Distributed Processing Symposium, IPDPS 2007; Abstracts and CD-ROM). doi: 10.1109/IPDPS.2007.370671

Challenges in executing data intensive biometric workloads on a desktop grid

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this