Skip navigation

Enabling and optimizing pilot jobs using xen based virtual machines for the HPC grid applications

Enabling and optimizing pilot jobs using xen based virtual machines for the HPC grid applications

Khalid, Omer, Anthony, Richard, Nilsson, Paul, Keahey, Kate, Schulz, Markus, Parrott, Kevin and Petridis, Miltos (2009) Enabling and optimizing pilot jobs using xen based virtual machines for the HPC grid applications. In: Virtualization technologies in distributed computing. ACM, New York, NY, USA, pp. 1-8. ISBN 9781605585802 (doi:10.1145/1555336.1555338)

[img] PDF
09_83.pdf - Published Version
Restricted to Repository staff only

Download (537kB)

Abstract

The primary motivation for uptake of virtualization have been resource isolation, capacity management and resource customization: isolation and capacity management allow providers to isolate users from the site and control their resources usage while customization allows end-users to easily project the required environment onto a variety of sites. Various approaches have been taken to integrate virtualization with Grid technologies. In this paper, we propose an approach that combines virtualization on the existing software infrastructure such as Pilot Jobs with minimum change on the part of resource providers. We also present a standard API to enable a wider set of applications including Batch systems to deploy virtual machines on-demand as isolated job sandboxes. To illustrate the usefulness of this approach, we also evaluate the impact of Xen virtualization on memory and compute intensive tasks, and present our results that how memory and scheduling parameters could be tweaked to optimize job performance.

Item Type: Conference Proceedings
Title of Proceedings: Virtualization technologies in distributed computing
Additional Information: This paper forms part of Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing, VTDC '09, which is a publication from ICAC '09 6th International Conference on Autonomic Computing, held 15-19 June 2009, Barcelona, Spain.
Uncontrolled Keywords: Xen, virtualization, grid, pilot jobs, HPC, cloud, cluster, credit scheduler, ATLAS
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Pre-2014 Departments: School of Computing & Mathematical Sciences
School of Computing & Mathematical Sciences > Department of Computer Science
School of Computing & Mathematical Sciences > Department of Computer Systems Technology
School of Computing & Mathematical Sciences > Department of Mathematical Sciences
Related URLs:
Last Modified: 14 Oct 2016 09:14
Selected for GREAT 2016: None
Selected for GREAT 2017: None
Selected for GREAT 2018: None
URI: http://gala.gre.ac.uk/id/eprint/5527

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics