Home Support Resources

High Performance System Resources

Red Barn Computers is experienced in installing and customizing the operating system and software products in your system to meet your specific needs. We have gathered some useful links about operating systems, cluster-related software, libraries, standards and other concepts that we use in our high performance computing products.

Batching Tools

TORQUE Resource Manager

TORQUE (Tera-scale Open-source Resource and QUEue manager) is a resource manager providing control over batch jobs and distributed compute nodes. It is a community effort based on the original *PBS project and has incorporated significant advances in the areas of scalability, fault tolerance, and feature extensions contributed by NCSA, OSC, USC, the U.S. Dept of Energy, Sandia, PNNL, U of Buffalo, TeraGrid, and many other leading edge HPC organizations. TORQUE is fully supported by Moab Workload Manager and Maui Scheduler.

Moab Cluster SuiteĀ®

Moab Cluster Suite is a policy-based intelligence engine that integrates scheduling, managing, monitoring and reporting of cluster workloads. It guarantees service levels are met while maximizing job throughput. Moab integrates with existing middleware for consolidated administrative control and holistic cluster reporting. Its graphical management interfaces and flexible policy capabilities result in decreased costs and increased ROI.

Sun Grid EngineSun

Grid Engine software provides policy-based workload management and dynamic provisioning of application workloads. Maximize productivity by making the most of your computing resources.

Cluster Scheduler

Maui Cluster Scheduler, the precursor to Moab Cluster Suite, is an open source job scheduler for clusters and supercomputers. It is an optimized, configurable tool capable of supporting an array of scheduling policies, dynamic priorities, extensive reservations, and fairshare capabilities.

Back to Top

Compilers

Compilers are crucial for parallelizing your code to run on a Beowulf cluster or for compiling the source code of distributed software packages or libraries for use in a cluster environment. While freely available compilers like GNU’s compilers for C/C++ or Fortran are often quite useful and robust, they are not optimized for specific hardware and their binary output may require more execution time. Commercial compilers optimized for your cluster hardware setup can save costs by delivering higher performance with less overall hardware investment. Red Barn Computers has the experience needed to recommend and install the compilers appropriate to your application

Portland Group Compilers

PGI High-Performance Compilers: Optimizing Fortran, C and C++ Compilers for 32-bit x86, 64-bit AMD64 and 64-bit Intel EM64T processor-based Linux and Windows computer systems. Outstanding single-processor performance, uncommon reliability, support for most common extensions, and automatic or user-directed parallelization for shared-memory parallel systems add up to compilers that “just work” for users migrating from RISC/UNIX to 32-bit x86 or 64-bit AMD64 or IA32/EM64T processor-based systems

NAG (Numerical Algorithms Group)

NAG’s mathematical and statistical components underpin thousands of programs and applications spanning the globe in industries as diverse as financial analysis, science and engineering, and in academia and research. They are so widely used and trusted because of their outstanding and unrivaled quality, reliability and portability. Whether you are using a single PC or a cluster of the world’s largest supercomputers, NAG has the numerical software capabilities to suit your model.

PathScale EKOPath Compiler Suite

The PathScale EKOPath Compiler Suite represents the highest-performance 64-bit C, C++ and Fortran compilers for Linux-based environments. This advanced compiler suite takes advantage of the unique high-performance 64-bit features of both the Advanced Micro Devices AMD64 and the Intel Xeon EM64T architectures. EKO stands for “Every Known Optimization” and refers to a compiler framework purpose-built for inserting new optimization techniques to improve performance. At PathScale, poor compiler optimization is considered a bug and a challenge to our development team.

Intel Compilers

Create high-performance software optimized for Intel processors with Intel compilers. Compatible with the tools developers use, Intel compilers plug into popular development environments and feature source and binary compatibility with widely used compilers. Every compiler purchase includes one year of Intel Premier Support, providing updates, technical support and expertise for the Intel architecture.

GCC – GNU Compiler Collection

The GNU Compiler Collection is a full-featured ANSI C compiler with support for K&R C, as well as C++, Objective C, Java, and Fortran. GCC provides many levels of source code error checking traditionally provided by other tools (such as lint), produces debugging information, and can perform many different optimizations to the resulting object code. GCC includes front ends for C, C++, Objective-C, Fortran, Java, and Ada, as well as libraries for these languages.

Back to Top

File Systems

As deployments grow to hundreds or even thousands of nodes, the choice of which networked file system to use becomes an increasingly important factor in building parallel cluster systems. File system performance is particularly critical for applications that process large amounts of data or those which rely on out-of-core computation.

XFS for Linux

XFS combines advanced journaling technology with full 64-bit addressing and scalable structures and algorithms. This combination delivers the most scalable and high-performance filesystem in the world.

PVFS Parallel

Virtual File System is a user-space parallel file system for use on clusters of computers (and Beowulf parallel clusters in particular). It provides transparent file striping across multiple machines and includes a shared library for use with existing binaries.

PVFS2

Parallel applications need a fast I/O subsystem. Clusters need a parallel file system that can scale as the number of nodes increases to the thousands and tens of thousands. PVFS2 is the answer.

Open GFS

The Open Global File System (OpenGFS, or OGFS) is a journaled file system that supports simultaneous sharing of a common storage device by multiple computer nodes. It provides direct access to shared storage media. This is one way to implement a “clustered file system”.

JFS for Linux

The Journaled File System (JFS) provides fast file system restart in the event of a system crash. Using database journaling techniques, JFS can restore a file system to a consistent state in a matter of seconds or minutes, versus hours or days with non-journaled file systems. IBM has contributed this technology to the Linux open source community with the hope that some or all of it will be useful in bringing the best of journaling capabilities to the Linux operating system.

ext3

ext3 is a robust, journaling file system with improved data integrity. Time is saved after unclean system shutdowns because extensive file system checking is no longer necessary after such an event. Speed can be improved because journaling optimizes hard drive head motion. The whitepaper found at this link covers “Red Hat’s New Journaling File System: ext3″.

Back to Top