Personal tools
You are here: Home Documentation Administrator's Handbook Part IX: Technical Details
Document Actions

Part IX: Technical Details

Detailed background information and technical specifications.

TECHNICAL DETAILS

Cluster Stack Overview

The default cluster stack for a Diskless Shared Root Cluster is the Red Hat Cluster Suite (RHCS). The RHCS consists of the following components:

  • CMAN/DLM, Fencing, CCS for basic cluster infrastructure (configuration management, cluster membership, cluster locking, fencing)
  • rgmanager for service management (application failover, monitoring, relocation)
  • GFS for data storage on a shared cluster file system
  • CLVM for clustered logical volume management
  • Tool suite for configuration and cluster management (e.g. system-config-cluster, clustat, clusvcadm)
  • LVS provides ip-loadbalancing based upon the Linux Virtual Server project

Conga

Components Description
luci Remote Management System - Management Station
ricci Remote Management System - Managed Station

Cluster Configuration Tool

Components Description
system-config-cluster Command used to manage cluster configuration in a graphical setting.

Cluster Logical Volume Manager (CLVM)

Components Description
clvmd The daemon that distributes LVM metadata updates around a cluster.
lvm LVM2 tools. Provides the command-line tools for LVM2.
system-config-lvm Provides graphical user interface for LVM2.
lvm.conf The LVM configuration file. The full path is /etc/lvm/lvm.conf.

Cluster Configuration System (CCS)

Components Description
ccs_tool ccs_tool makes online updates of CCS configuration files.
ccs_test Diagnostic and testing command that is used to retrieve information from configuration files through ccsd.
ccsd CCS daemon that runs on all cluster nodes and provides configuration file data to cluster software.
cluster.conf This is the cluster configuration file. The full path is /etc/cluster/cluster.conf.

Cluster Manager (CMAN)

Components Description
cman.ko The kernel module for CMAN.
cman_tool Administrative front end to CMAN. It starts and stops CMAN and can change some internal parameters such as votes.
dlm_controld Daemon started by cman init script to manage dlm in kernel; not used by user.
gfs_controld Daemon started by cman init script to manage gfs in kernel; not used by user.
group_tool Used to get a list of groups related to fencing, DLM, GFS, and getting debug information.
groupd Daemon started by cman init script to interface between openais/cman and dlm_controld/gfs_controld/fenced.
libcman.so.<version> Library for programs that need to interact with cman.ko.

Resource Group Manager (rgmanager)

Components Description
clusvcadm Command used to manually enable, disable, relocate, and restart user services in a cluster
clustat Command used to display the status of the cluster, including node membership and services running.
clurgmgrd Daemon used to handle user service requests.
clurmtabd Daemon used to handle Clustered NFS mount tables

Fence

Components Description
fence_apc Fence agent for APC power switch.
fence_bladecenter Fence agent for for IBM Bladecenters with Telnet interface.
fence_bullpap Fence agent for Bull Novascale Platform Administration Processor (PAP) Interface.
fence_drac Fencing agent for Dell Remote Access Card
fence_ipmilan Fence agent for Bull Novascale Intelligent Platform Management Interface (IPMI).
fence_wti Fence agent for WTI power switch.
fence_brocade Fence agent for Brocade Fibre Channel switch.
fence_mcdata Fence agent for McData Fibre Channel switch.
fence_vixel Fence agent for Vixel Fibre Channel switch.
fence_sanbox2 Fence agent for SANBox2 Fibre Channel switch.
fence_ilo Fence agent for HP ILO interfaces (formerly fence_rib).
fence_rsa I/O Fencing agent for IBM RSA II.
fence_gnbd Fence agent used with GNBD storage.
fence_scsi I/O fencing agent for SCSI persistent reservations
fence_egenera Fence agent used with Egenera BladeFrame system.
fence_manual Fence agent for manual interaction. NOTE This component is not supported for production environments.
fence_ack_manual User interface for fence_manual agent.
fence_node A program which performs I/O fencing on a single node.
fence_xvm I/O Fencing agent for Xen virtual machines.
fence_xvmd I/O Fencing agent host for Xen virtual machines.
fence_tool A program to join and leave the fence domain.
fenced The I/O Fencing daemon.

DLM

Components Description
libdlm.so.version Library for Distributed Lock Manager (DLM) support.

GFS

Components Description
gfs.ko Kernel module that implements the GFS file system and is loaded on GFS cluster nodes.
gfs_fsck Command that repairs an unmounted GFS file system.
gfs_grow Command that grows a mounted GFS file system.
gfs_jadd Command that adds journals to a mounted GFS file system.
gfs_mkfs Command that creates a GFS file system on a storage device.
gfs_quota Command that manages quotas on a mounted GFS file system.
gfs_tool Command that configures or tunes a GFS file system. Also used to view filesystem info
mount.gfs Mount helper called by mount(8); not used by user.

GNBD

Components Description
gnbd.ko Kernel module that implements the GNBD device driver on clients.
gnbd_export Command to create, export and manage GNBDs on a GNBD server.
gnbd_import Command to import and manage GNBDs on a GNBD client.
gnbd_serv A server daemon that allows a node to export local storage over the network.

Quorum Disk

Components Description
qdisk A disk-based quorum daemon for CMAN / Linux-Cluster.
mkqdisk Cluster Quorum Disk Utility
qdiskd Cluster Quorum Disk Daemon

Comoonics RPM Packages (most important)

The following packages are essential to build a Diskless Sharedroot Cluster. You will see that with introduction of RHEL 5 there are much less packages to be installed. State: 02/2008

Components Description
SysVinit-comoonics Comoonics SysVinit enhancements (killall5 can exclude processes, init can be restarted in all initlevels)
comoonics-cs-py Comoonics Clustersuite utilities and libraries written in Python
comoonics-bootimage-initscripts Comoonics Bootimage initscripts. Initscripts used by the comoonics shared root cluster environment.
comoonics-cdsl-py Comoonics cdsl utilities and library written in Python.
comoonics-cluster-py Comoonics cluster configuration utilities written in Python.
comoonics-pythonosfix-py Comoonics module to fix bug in os.path.realpath in python-2.3.4-14.4
comoonics-bootimage Comoonics Bootimage. Scripts for creating an initrd in a gfs shared root environment.

Comoonics RPM Packages (other)

Components Description
comhf-sysreport Workaround to get sysreports from comoonics fenceack server.
comoonics-backup-legato Comoonics Legato Backup utilities and libraries written in Python
comoonics-backup-py Comoonics Backup utilities and libraries written in Python
comoonics-bootimage-compat Files needed for the compatibility to 1.2 releases
comoonics-bootimage-extras-dm-multipath Extra listfiles for device mapper multipath sharedroot configurations
comoonics-bootimage-extras-iscsi iscsi support in the open-sharedroot cluster
comoonics-bootimage-extras-network Extra listfiles for special network configurations
comoonics-bootimage-extras-nfs Extra listfiles for nfs sharedroot configurations
comoonics-bootimage-extras-rdac-multipath Extra listfiles for rdac multipath sharedroot configurations
comoonics-bootimage-extras-xen Extra listfiles for xen support in the open-sharedroot cluster
comoonics-bootimage-fenceacksv The Fence ackserver is a service running in the fencedchroot and managing manual fenced nodes
comoonics-bootimage-fenceclient-ilo An alternative fence client for ilo cards of HP servers. Written in python.
comoonics-bootimage-fenceclient-ilomp A fence client for iloMP cards of HP inegrity servers. Written in python.
comoonics-bootimage-fenceclient-vmware Fencing for vmware client
comoonics-bootimage-fencemaster-vmware Fencing for the vmware master server
comoonics-bootimage-listfiles Comoonics Bootimage listfiles. Listfiles for mkinitrd.
comoonics-cmdb-py Comoonics Softwaremanagement CMDB utilities and libraries written in Python
comoonics-cs Comoonics Clustersuite utilities and libraries written in Python
comoonics-cs-rgmanager-extras Extras for redhats rgmanager
comoonics-cs-xml XML and DTD Files for comoonics clustersuite
comoonics-cs-xsl-ec XSL Files for comoonics enterprisecopy (com-ec) to use cloning.
comoonics-db-py Comoonics Softwaremanagement Database utilities and libraries written in Python
comoonics-ec-py Comoonics Enterprisecopy utilities and libraries written in Python
comoonics-fenceacksv-plugins-py Comoonics Fenceacksv plugins written in Python
comoonics-fenceacksv-py Comoonics Fenceacksv utilities and libraries written in Python
comoonics-scsi-py Comoonics SCSI utilities and libraries written in Python
comoonics-storage-hp-py Comoonics Enterprisecopy HP Storage utilities and libraries written in Python

Ports used for Cluster Suite

Port Service L4-Protocol Relevance
41966 rgmanager/clurgmgrd tcp  
41967 rgmanager/clurgmgrd tcp  
41968 rgmanager/clurgmgrd tcp  
41969 rgmanager/clurgmgrd tcp  
50006 ccsd tcp  
50007 ccsd udp  
50008 ccsd tcp  
50009 ccsd tcp  
21064 dlm tcp  
6809 cman udp RHEL4 and under
5405 openais udp RHEL5 and above
14567 gnbd tcp  

GFS Quick Specs

  • Allows filenames up to 255 Bytes
  • Stores file owner
  • Supports POSIX file permissions
  • Stores Last access/read timestamps
  • Stores last metadata change timestamps
  • Supports ACLs
  • Supports extended file attributes in new versions
  • Supports hard links
  • Supports soft links
  • Supports Block journaling
  • Supports Metadata journaling
  • Is case sensitive
  • Is case preserving
  • Uses sparse files

Powered by Plone CMS, the Open Source Content Management System

This site conforms to the following standards: