Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer

Michael Jones; Jeremy Kepner; Bradley Orchard; Albert Reuther; William Arcand; David Bestor; Bill Bergeron; Chansup Byun; Vijay Gadepally; Michael Houle; Matthew Hubbell; Anna Klein; Lauren Milechin; Julia Mullen; Andrew Prout; Antonio Rosa; Siddharth Samsi; Charles Yee; Peter Michaleas

doi:10.1109/HPEC.2018.8547782

Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer

Michael Jones, Jeremy Kepner, Bradley Orchard, Albert Reuther, William Arcand, David Bestor, Bill Bergeron, Chansup Byun, Vijay Gadepally, Michael Houle, Matthew Hubbell, Anna Klein, Lauren Milechin, Julia Mullen, Andrew Prout, Antonio Rosa, Siddharth Samsi, Charles Yee, Peter Michaleas

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

Simulation, machine learning, and data analysis require a wide range of software which can be dependent upon specific operating systems, such as Microsoft Windows. Running this software interactively on massively parallel supercomputers can present many challenges. Traditional methods of scaling Microsoft Windows applications to run on thousands of processors have typically relied on heavyweight virtual machines that can be inefficient and slow to launch on modern manycore processors. This paper describes a unique approach using the Lincoln Laboratory LLMapReduce technology in combination with the Wine Windows compatibility layer to rapidly and simultaneously launch and run Microsoft Windows applications on thousands of cores on a supercomputer. Specifically, this work demonstrates launching 16,000 Microsoft Windows applications in 5 minutes running on 16,000 processor cores. This capability significantly broadens the range of applications that can be run at large scale on a supercomputer.

Original language	English
Title of host publication	2018 IEEE High Performance Extreme Computing Conference, HPEC 2018
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781538659892
DOIs	https://doi.org/10.1109/HPEC.2018.8547782
State	Published - Nov 26 2018
Externally published	Yes
Event	2018 IEEE High Performance Extreme Computing Conference, HPEC 2018 - Waltham, United States Duration: Sep 25 2018 → Sep 27 2018

Publication series

Name	2018 IEEE High Performance Extreme Computing Conference, HPEC 2018

Conference

Conference	2018 IEEE High Performance Extreme Computing Conference, HPEC 2018
Country/Territory	United States
City	Waltham
Period	09/25/18 → 09/27/18

Keywords

High Performance Computing
Knight's Landing
Manycore
Microsoft Windows
Windows Emulation
Wine

Access to Document

10.1109/HPEC.2018.8547782

Cite this

Jones, M., Kepner, J., Orchard, B., Reuther, A., Arcand, W., Bestor, D., Bergeron, B., Byun, C., Gadepally, V., Houle, M., Hubbell, M., Klein, A., Milechin, L., Mullen, J., Prout, A., Rosa, A., Samsi, S., Yee, C., & Michaleas, P. (2018). Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer. In 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018 [8547782] (2018 IEEE High Performance Extreme Computing Conference, HPEC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/HPEC.2018.8547782

@inproceedings{741994f1808d4dedb84206ed4b3b6ec1,

title = "Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer",

abstract = "Simulation, machine learning, and data analysis require a wide range of software which can be dependent upon specific operating systems, such as Microsoft Windows. Running this software interactively on massively parallel supercomputers can present many challenges. Traditional methods of scaling Microsoft Windows applications to run on thousands of processors have typically relied on heavyweight virtual machines that can be inefficient and slow to launch on modern manycore processors. This paper describes a unique approach using the Lincoln Laboratory LLMapReduce technology in combination with the Wine Windows compatibility layer to rapidly and simultaneously launch and run Microsoft Windows applications on thousands of cores on a supercomputer. Specifically, this work demonstrates launching 16,000 Microsoft Windows applications in 5 minutes running on 16,000 processor cores. This capability significantly broadens the range of applications that can be run at large scale on a supercomputer.",

keywords = "High Performance Computing, Knight's Landing, Manycore, Microsoft Windows, Windows Emulation, Wine",

author = "Michael Jones and Jeremy Kepner and Bradley Orchard and Albert Reuther and William Arcand and David Bestor and Bill Bergeron and Chansup Byun and Vijay Gadepally and Michael Houle and Matthew Hubbell and Anna Klein and Lauren Milechin and Julia Mullen and Andrew Prout and Antonio Rosa and Siddharth Samsi and Charles Yee and Peter Michaleas",

note = "Funding Information: This material is based upon work supported by the Assistant Secretary of Defense for Research and Engineering under Air Force Contract No. FA8721-05-C-0002 and/or FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Assistant Secretary of Defense for Research and Engineering. Publisher Copyright: {\textcopyright} 2018 IEEE.; 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018 ; Conference date: 25-09-2018 Through 27-09-2018",

year = "2018",

month = nov,

day = "26",

doi = "10.1109/HPEC.2018.8547782",

language = "English",

series = "2018 IEEE High Performance Extreme Computing Conference, HPEC 2018",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2018 IEEE High Performance Extreme Computing Conference, HPEC 2018",

}

Jones, M, Kepner, J, Orchard, B, Reuther, A, Arcand, W, Bestor, D, Bergeron, B, Byun, C, Gadepally, V, Houle, M, Hubbell, M, Klein, A, Milechin, L, Mullen, J, Prout, A, Rosa, A, Samsi, S, Yee, C & Michaleas, P 2018, Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer. in 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018., 8547782, 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018, Institute of Electrical and Electronics Engineers Inc., 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018, Waltham, United States, 09/25/18. https://doi.org/10.1109/HPEC.2018.8547782

Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer. / Jones, Michael; Kepner, Jeremy; Orchard, Bradley et al.
2018 IEEE High Performance Extreme Computing Conference, HPEC 2018. Institute of Electrical and Electronics Engineers Inc., 2018. 8547782 (2018 IEEE High Performance Extreme Computing Conference, HPEC 2018).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer

AU - Jones, Michael

AU - Kepner, Jeremy

AU - Orchard, Bradley

AU - Reuther, Albert

AU - Arcand, William

AU - Bestor, David

AU - Bergeron, Bill

AU - Byun, Chansup

AU - Gadepally, Vijay

AU - Houle, Michael

AU - Hubbell, Matthew

AU - Klein, Anna

AU - Milechin, Lauren

AU - Mullen, Julia

AU - Prout, Andrew

AU - Rosa, Antonio

AU - Samsi, Siddharth

AU - Yee, Charles

AU - Michaleas, Peter

N1 - Funding Information: This material is based upon work supported by the Assistant Secretary of Defense for Research and Engineering under Air Force Contract No. FA8721-05-C-0002 and/or FA8702-15-D-0001. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the Assistant Secretary of Defense for Research and Engineering. Publisher Copyright: © 2018 IEEE.

PY - 2018/11/26

Y1 - 2018/11/26

N2 - Simulation, machine learning, and data analysis require a wide range of software which can be dependent upon specific operating systems, such as Microsoft Windows. Running this software interactively on massively parallel supercomputers can present many challenges. Traditional methods of scaling Microsoft Windows applications to run on thousands of processors have typically relied on heavyweight virtual machines that can be inefficient and slow to launch on modern manycore processors. This paper describes a unique approach using the Lincoln Laboratory LLMapReduce technology in combination with the Wine Windows compatibility layer to rapidly and simultaneously launch and run Microsoft Windows applications on thousands of cores on a supercomputer. Specifically, this work demonstrates launching 16,000 Microsoft Windows applications in 5 minutes running on 16,000 processor cores. This capability significantly broadens the range of applications that can be run at large scale on a supercomputer.

AB - Simulation, machine learning, and data analysis require a wide range of software which can be dependent upon specific operating systems, such as Microsoft Windows. Running this software interactively on massively parallel supercomputers can present many challenges. Traditional methods of scaling Microsoft Windows applications to run on thousands of processors have typically relied on heavyweight virtual machines that can be inefficient and slow to launch on modern manycore processors. This paper describes a unique approach using the Lincoln Laboratory LLMapReduce technology in combination with the Wine Windows compatibility layer to rapidly and simultaneously launch and run Microsoft Windows applications on thousands of cores on a supercomputer. Specifically, this work demonstrates launching 16,000 Microsoft Windows applications in 5 minutes running on 16,000 processor cores. This capability significantly broadens the range of applications that can be run at large scale on a supercomputer.

KW - High Performance Computing

KW - Knight's Landing

KW - Manycore

KW - Microsoft Windows

KW - Windows Emulation

KW - Wine

UR - http://www.scopus.com/inward/record.url?scp=85060081939&partnerID=8YFLogxK

U2 - 10.1109/HPEC.2018.8547782

DO - 10.1109/HPEC.2018.8547782

M3 - Conference contribution

AN - SCOPUS:85060081939

T3 - 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018

BT - 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018

Y2 - 25 September 2018 through 27 September 2018

ER -

Jones M, Kepner J, Orchard B, Reuther A, Arcand W, Bestor D et al. Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer. In 2018 IEEE High Performance Extreme Computing Conference, HPEC 2018. Institute of Electrical and Electronics Engineers Inc. 2018. 8547782. (2018 IEEE High Performance Extreme Computing Conference, HPEC 2018). doi: 10.1109/HPEC.2018.8547782

Interactive Launch of 16,000 Microsoft Windows Instances on a Supercomputer

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this