Skip navigation

Dynamic scheduling of virtual machines running HPC workloads in scientific grids

Dynamic scheduling of virtual machines running HPC workloads in scientific grids

Khalid, Omer, Maljevic, Ivo, Anthony, Richard, Petridis, Miltos, Parrott, Kevin and Schulz, Markus (2009) Dynamic scheduling of virtual machines running HPC workloads in scientific grids. 3rd International Conference on New Technologies, Mobility and Security, NTMS 2009. IEEE Computer Society, Piscataway, NJ USA. ISBN 97814244 6273 5 (doi:https://doi.org/10.1109/NTMS.2009.5384725)

[img] PDF
09_84.pdf - Published Version
Restricted to Repository staff only

Download (438kB)

Abstract

The primary motivation for uptake of virtualization has been
resource isolation, capacity management and resource
customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been taken to integrate virtualization in to scientific Grids especially in the arena of High Performance Computing (HPC) to run grid jobs in virtual machines, thus enabling better provisioning of the
underlying resources and customization of the execution
environment on runtime. Despite the gains, virtualization layer also incur a performance penalty and its not very well understood that how such an overhead will impact the performance of systems where jobs are scheduled with tight deadlines. Since this overhead varies the types of workload whether they are memory intensive, CPU intensive or network I/O bound, and could lead to unpredictable deadline estimation for the running jobs in the system. In our study, we have attempted to tackle this problem by
developing an intelligent scheduling technique for virtual
machines which monitors the workload types and deadlines, and calculate the system over head in real time to maximize number of jobs finishing within their agreed deadlines.

Item Type: Book Section
Additional Information: This paper forms part of the published proceedings from 3rd International Conference on New Technologies, Mobility and Security, NTMS 2009 December 20, 2009 - December 23, 2009 Cairo, Egypt
Uncontrolled Keywords: Xen, virtualization, grid, pilot jobs, HPC, cloud, cluster, credit scheduler, ATLAS
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Pre-2014 Departments: School of Computing & Mathematical Sciences
School of Computing & Mathematical Sciences > Department of Computer Science
School of Computing & Mathematical Sciences > Department of Computer Systems Technology
School of Computing & Mathematical Sciences > Department of Mathematical Sciences
Related URLs:
Last Modified: 08 Oct 2019 09:21
URI: http://gala.gre.ac.uk/id/eprint/5530

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics