Best of Both Worlds: High Performance Interactive and Batch Launching

Chansup Byun; Jeremy Kepner; William Arcand; David Bestor; Bill Bergeron; Vijay Gadepally; Michael Houle; Matthew Hubbell; Michael Jones; Andrew Kirby; Anna Klein; Peter Michaleas; Lauren Milechin; Julie Mullen; Andrew Prout; Antonio Rosa; Siddharth Samsi; Charles Yee; Albert Reuther

doi:10.1109/HPEC43674.2020.9286142

Best of Both Worlds: High Performance Interactive and Batch Launching

Chansup Byun, Jeremy Kepner, William Arcand, David Bestor, Bill Bergeron, Vijay Gadepally, Michael Houle, Matthew Hubbell, Michael Jones, Andrew Kirby, Anna Klein, Peter Michaleas, Lauren Milechin, Julie Mullen, Andrew Prout, Antonio Rosa, Siddharth Samsi, Charles Yee, Albert Reuther

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

Rapid launch of thousands of jobs is essential for effective interactive supercomputing, big data analysis, and AI algorithm development. Achieving thousands of launches per second has required hardware to be available to receive these jobs. This paper presents a novel preemptive approach to implement 'spot' jobs on MIT SuperCloud systems allowing the resources to be fully utilized for both long running batch jobs while still providing fast launch for interactive jobs. The new approach separates the job preemption and scheduling operations and can achieve 100 times faster performance in the scheduling of a job with preemption when compared to using the standard scheduler-provided automatic preemption-based capability. The results demonstrate that the new approach can schedule interactive jobs preemptively at a performance comparable to when the required computing resources are idle and available. The spot job capability can be deployed without disrupting the interactive user experience while increasing the overall system utilization.

Original language	English
Title of host publication	2020 IEEE High Performance Extreme Computing Conference, HPEC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781728192192
DOIs	https://doi.org/10.1109/HPEC43674.2020.9286142
State	Published - Sep 22 2020
Externally published	Yes
Event	2020 IEEE High Performance Extreme Computing Conference, HPEC 2020 - Virtual, Waltham, United States Duration: Sep 21 2020 → Sep 25 2020

Publication series

Name	2020 IEEE High Performance Extreme Computing Conference, HPEC 2020

Conference

Conference	2020 IEEE High Performance Extreme Computing Conference, HPEC 2020
Country/Territory	United States
City	Virtual, Waltham
Period	09/21/20 → 09/25/20

Keywords

cluster utilization
cron job
preemption
scheduling performance
spot jobs

Access to Document

10.1109/HPEC43674.2020.9286142

Cite this

Byun, C., Kepner, J., Arcand, W., Bestor, D., Bergeron, B., Gadepally, V., Houle, M., Hubbell, M., Jones, M., Kirby, A., Klein, A., Michaleas, P., Milechin, L., Mullen, J., Prout, A., Rosa, A., Samsi, S., Yee, C., & Reuther, A. (2020). Best of Both Worlds: High Performance Interactive and Batch Launching. In 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020 Article 9286142 (2020 IEEE High Performance Extreme Computing Conference, HPEC 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HPEC43674.2020.9286142

@inproceedings{24701052200f4fda8bccf68b8c2e1cd8,

title = "Best of Both Worlds: High Performance Interactive and Batch Launching",

abstract = "Rapid launch of thousands of jobs is essential for effective interactive supercomputing, big data analysis, and AI algorithm development. Achieving thousands of launches per second has required hardware to be available to receive these jobs. This paper presents a novel preemptive approach to implement 'spot' jobs on MIT SuperCloud systems allowing the resources to be fully utilized for both long running batch jobs while still providing fast launch for interactive jobs. The new approach separates the job preemption and scheduling operations and can achieve 100 times faster performance in the scheduling of a job with preemption when compared to using the standard scheduler-provided automatic preemption-based capability. The results demonstrate that the new approach can schedule interactive jobs preemptively at a performance comparable to when the required computing resources are idle and available. The spot job capability can be deployed without disrupting the interactive user experience while increasing the overall system utilization.",

keywords = "cluster utilization, cron job, preemption, scheduling performance, spot jobs",

author = "Chansup Byun and Jeremy Kepner and William Arcand and David Bestor and Bill Bergeron and Vijay Gadepally and Michael Houle and Matthew Hubbell and Michael Jones and Andrew Kirby and Anna Klein and Peter Michaleas and Lauren Milechin and Julie Mullen and Andrew Prout and Antonio Rosa and Siddharth Samsi and Charles Yee and Albert Reuther",

note = "Funding Information: This material is based upon work supported by the Assistant Secretary of Defense for Research and Engineering under Air Force Contract No. FA8721-05-C-0002 and/or FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Assistant Secretary of Defense for Research and Engineering. Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020 ; Conference date: 21-09-2020 Through 25-09-2020",

year = "2020",

month = sep,

day = "22",

doi = "10.1109/HPEC43674.2020.9286142",

language = "English",

series = "2020 IEEE High Performance Extreme Computing Conference, HPEC 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2020 IEEE High Performance Extreme Computing Conference, HPEC 2020",

}

Byun, C, Kepner, J, Arcand, W, Bestor, D, Bergeron, B, Gadepally, V, Houle, M, Hubbell, M, Jones, M, Kirby, A, Klein, A, Michaleas, P, Milechin, L, Mullen, J, Prout, A, Rosa, A, Samsi, S, Yee, C & Reuther, A 2020, Best of Both Worlds: High Performance Interactive and Batch Launching. in 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020., 9286142, 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020, Institute of Electrical and Electronics Engineers Inc., 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020, Virtual, Waltham, United States, 09/21/20. https://doi.org/10.1109/HPEC43674.2020.9286142

Best of Both Worlds: High Performance Interactive and Batch Launching. / Byun, Chansup; Kepner, Jeremy; Arcand, William et al.
2020 IEEE High Performance Extreme Computing Conference, HPEC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9286142 (2020 IEEE High Performance Extreme Computing Conference, HPEC 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Best of Both Worlds

T2 - 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020

AU - Byun, Chansup

AU - Kepner, Jeremy

AU - Arcand, William

AU - Bestor, David

AU - Bergeron, Bill

AU - Gadepally, Vijay

AU - Houle, Michael

AU - Hubbell, Matthew

AU - Jones, Michael

AU - Kirby, Andrew

AU - Klein, Anna

AU - Michaleas, Peter

AU - Milechin, Lauren

AU - Mullen, Julie

AU - Prout, Andrew

AU - Rosa, Antonio

AU - Samsi, Siddharth

AU - Yee, Charles

AU - Reuther, Albert

N1 - Funding Information: This material is based upon work supported by the Assistant Secretary of Defense for Research and Engineering under Air Force Contract No. FA8721-05-C-0002 and/or FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Assistant Secretary of Defense for Research and Engineering. Publisher Copyright: © 2020 IEEE.

PY - 2020/9/22

Y1 - 2020/9/22

N2 - Rapid launch of thousands of jobs is essential for effective interactive supercomputing, big data analysis, and AI algorithm development. Achieving thousands of launches per second has required hardware to be available to receive these jobs. This paper presents a novel preemptive approach to implement 'spot' jobs on MIT SuperCloud systems allowing the resources to be fully utilized for both long running batch jobs while still providing fast launch for interactive jobs. The new approach separates the job preemption and scheduling operations and can achieve 100 times faster performance in the scheduling of a job with preemption when compared to using the standard scheduler-provided automatic preemption-based capability. The results demonstrate that the new approach can schedule interactive jobs preemptively at a performance comparable to when the required computing resources are idle and available. The spot job capability can be deployed without disrupting the interactive user experience while increasing the overall system utilization.

AB - Rapid launch of thousands of jobs is essential for effective interactive supercomputing, big data analysis, and AI algorithm development. Achieving thousands of launches per second has required hardware to be available to receive these jobs. This paper presents a novel preemptive approach to implement 'spot' jobs on MIT SuperCloud systems allowing the resources to be fully utilized for both long running batch jobs while still providing fast launch for interactive jobs. The new approach separates the job preemption and scheduling operations and can achieve 100 times faster performance in the scheduling of a job with preemption when compared to using the standard scheduler-provided automatic preemption-based capability. The results demonstrate that the new approach can schedule interactive jobs preemptively at a performance comparable to when the required computing resources are idle and available. The spot job capability can be deployed without disrupting the interactive user experience while increasing the overall system utilization.

KW - cluster utilization

KW - cron job

KW - preemption

KW - scheduling performance

KW - spot jobs

UR - http://www.scopus.com/inward/record.url?scp=85099394610&partnerID=8YFLogxK

U2 - 10.1109/HPEC43674.2020.9286142

DO - 10.1109/HPEC43674.2020.9286142

M3 - Conference contribution

AN - SCOPUS:85099394610

T3 - 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020

BT - 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 21 September 2020 through 25 September 2020

ER -

Byun C, Kepner J, Arcand W, Bestor D, Bergeron B, Gadepally V et al. Best of Both Worlds: High Performance Interactive and Batch Launching. In 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9286142. (2020 IEEE High Performance Extreme Computing Conference, HPEC 2020). doi: 10.1109/HPEC43674.2020.9286142

Best of Both Worlds: High Performance Interactive and Batch Launching

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this