Dynamic scheduling of virtual machines running HPC workloads in scientific grids
Khalid, Omer, Maljevic, Ivo, Anthony, Richard, Petridis, Miltos, Parrott, Kevin and Schulz, Markus (2009) Dynamic scheduling of virtual machines running HPC workloads in scientific grids. 3rd International Conference on New Technologies, Mobility and Security, NTMS 2009. IEEE Computer Society, Piscataway, NJ USA. ISBN 97814244 6273 5 (doi:https://doi.org/10.1109/NTMS.2009.5384725)
PDF
09_84.pdf - Published Version Restricted to Repository staff only Download (438kB) |
Abstract
The primary motivation for uptake of virtualization has been
resource isolation, capacity management and resource
customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been taken to integrate virtualization in to scientific Grids especially in the arena of High Performance Computing (HPC) to run grid jobs in virtual machines, thus enabling better provisioning of the
underlying resources and customization of the execution
environment on runtime. Despite the gains, virtualization layer also incur a performance penalty and its not very well understood that how such an overhead will impact the performance of systems where jobs are scheduled with tight deadlines. Since this overhead varies the types of workload whether they are memory intensive, CPU intensive or network I/O bound, and could lead to unpredictable deadline estimation for the running jobs in the system. In our study, we have attempted to tackle this problem by
developing an intelligent scheduling technique for virtual
machines which monitors the workload types and deadlines, and calculate the system over head in real time to maximize number of jobs finishing within their agreed deadlines.
Item Type: | Book Section |
---|---|
Additional Information: | This paper forms part of the published proceedings from 3rd International Conference on New Technologies, Mobility and Security, NTMS 2009 December 20, 2009 - December 23, 2009 Cairo, Egypt |
Uncontrolled Keywords: | Xen, virtualization, grid, pilot jobs, HPC, cloud, cluster, credit scheduler, ATLAS |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Pre-2014 Departments: | School of Computing & Mathematical Sciences School of Computing & Mathematical Sciences > Department of Computer Science School of Computing & Mathematical Sciences > Department of Computer Systems Technology School of Computing & Mathematical Sciences > Department of Mathematical Sciences |
Related URLs: | |
Last Modified: | 08 Oct 2019 09:21 |
URI: | http://gala.gre.ac.uk/id/eprint/5530 |
Actions (login required)
View Item |
Downloads
Downloads per month over past year