Skip to main content

Virtualization and HPC

To see how virtualization might play in HPC, let's consider how programs operate on a cluster. A parallel MPI program is basically a collection of individual programs (processes) running on the same or different node. Messages are essentially a way to copy memory from one program to another. Programs are "placed" on specific idle nodes/cores by a scheduling program (such as PBS, Sun Grid Engine, or Torque). The programs are managed by the all-knowing scheduler and once placed on a node, stay there until complete. Communication takes place over an interconnect, but as far as the scheduler is concerned, what you do with your nodes is your business. This model has worked well for HPC clustering although it is not the only one.

Virtualization allows the OS instance (and subsequent programs) to be run on top of a hypervisor. Because the hypervisor insulates the OS instance from the hardware it allows the OS and running programs to be migrated from one hypervisor to another.


There's also a poll, do participate!

AS of now the results of the poll are going in this direction:

Virtualization & HPC

Will Virtualization help solve some of your HPC issue?
chart
Would multiple/custom distribution support on the same cluster be helpful?
chart
What is the most important capability that virtualization could bring to your HPC environment?
chart
Would you like to learn more about Virtualization and HPC?
chart

Comments

Popular posts from this blog

Security: VMware Workstation 6 vulnerability

vulnerable software: VMware Workstation 6.0 for Windows, possible some other VMware products as well type of vulnerability: DoS, potential privilege escalation I found a vulnerability in VMware Workstation 6.0 which allows an unprivileged user in the host OS to crash the system and potentially run arbitrary code with kernel privileges. The issue is in the vmstor-60 driver, which is supposed to mount VMware images within the host OS. When sending the IOCTL code FsSetVoleInformation with subcode FsSetFileInformation with a large buffer and underreporting its size to at max 1024 bytes, it will underrun and potentially execute arbitrary code. Security focus

Splunk that!

Saw this advert on Slashdot and went on to look for it and found the tour pretty neat to look at. Check out the demo too! So why would I need it? WHY NOT? I'd say. As an organization grows , new services, new data comes by, new logs start accumulating on the servers and it becomes increasingly difficult to look at all those logs, leave alone that you'd have time to read them and who cares about analysis as the time to look for those log files already makes your day, isn't it? Well a solution like this is a cool option to have your sysadmins/operators look at ONE PLACE and thus you don't have your administrators lurking around in your physical servers and *accidentally* messing up things there. Go ahead and give it a shot by downloading it and testing it. I'll give it a shot myself! Ok so I went ahead and installed it. Do this... [root@tarrydev Software]# ./splunk-Server-1.0.1-linux-installer.bin to install and this (if you screw up) [root@tarrydev Software]# /op

Virtualization is hot and sexy!

If this does not convince you to virtualize, believe me, nothing will :-) As you will hear these gorgeous women mention VMware, Akkori, Pano Logic, Microsoft and VKernel. They forgot to mention rackspace ;-) virtualization girl video I'm convinced, aren't you? Check out their site as well!