Skip to main content

Virtualization and HPC

To see how virtualization might play in HPC, let's consider how programs operate on a cluster. A parallel MPI program is basically a collection of individual programs (processes) running on the same or different node. Messages are essentially a way to copy memory from one program to another. Programs are "placed" on specific idle nodes/cores by a scheduling program (such as PBS, Sun Grid Engine, or Torque). The programs are managed by the all-knowing scheduler and once placed on a node, stay there until complete. Communication takes place over an interconnect, but as far as the scheduler is concerned, what you do with your nodes is your business. This model has worked well for HPC clustering although it is not the only one.

Virtualization allows the OS instance (and subsequent programs) to be run on top of a hypervisor. Because the hypervisor insulates the OS instance from the hardware it allows the OS and running programs to be migrated from one hypervisor to another.


There's also a poll, do participate!

AS of now the results of the poll are going in this direction:

Virtualization & HPC

Will Virtualization help solve some of your HPC issue?
chart
Would multiple/custom distribution support on the same cluster be helpful?
chart
What is the most important capability that virtualization could bring to your HPC environment?
chart
Would you like to learn more about Virtualization and HPC?
chart

Comments

Popular posts from this blog

Get Vyatta Virtual Appliance, now VMware certified!

We all know Vyatta, don't we?

Vyatta, the leader in Linux-based networking, today announced that its open-source networking software has received VMware Virtual Appliance Certification, thereby providing customers with a solution that has been optimized for a production-ready VMware environment. The company also announced it has joined the VMware Technology Alliance Partner (TAP) Program. As a member of TAP, Vyatta will offer its solutions via the TAP program website. With the Vyatta virtual appliance for VMware environments, organizations can now include Vyatta’s router, firewall and VPN functions as part of their virtualized infrastructure.

Vyatta combines enterprise-class routing and security capabilities into an integrated, reliable and commercially supported software solution, delivering twice the performance of proprietary network solutions at half the price. Running Vyatta software as virtual appliances gives customers many more options for scaling their data centers and cons…

3PAR adds native LDAP support to simplify administration

3PAR®, the leading global provider of utility storage, announced today native support for lightweight directory access protocol (LDAP). Support for LDAP enables centralized user authentication and authorization using a standard protocol for managing access to IT resources. With 3PAR’s support for LDAP, customers are able to now integrate 3PAR Utility Storage--a simple, cost-efficient, and massively scalable storage platform—with standard, open enterprise directory services. The result is simplified security administration with centralized access control and identity management.

“3PAR Utility Storage already provides us with a reliable, shared, and easy-to-use consolidated storage platform,” said Burzin Engineer, Vice President of Infrastructure Services at Shopzilla. "Now, with 3PAR support for LDAP, managing security commonly--across all our resources, including storage--is also simple and efficient.”

Press Release

DeepLearningTrucker Part 1