Basic Installing and Configuring of GPFS Cluster (Part 4)


Step 10: Create a NSD Specification File at

At /gpfs_install, create a disk.lst

# vim disk.lst

Example of the file using primary and secondary NSD are as followed

/dev/sdb:nsd1-nas,nsd2-nas::::ds4200_b
/dev/sdc:nsd2-nas,nsd1-nas::::ds4200_c

The format is
s1:s2:s3:s4:s5:s6:s7

where
s1 = scsi device
s2 = NSD server list seperate by comma. Arrange in primary and secondary order
s3 = NULL (retained for legacy reasons)
s4 = usage
s5 = failure groups
s6 = NSD name
s7 = storage pool name

Step 11: Backup the disk.lst

Back up this specifications since its an input/output file for the mmcrnsd.

# cp disk.lst disk.lst.org

Step 12: Create the new NSD specification file

# mmcrnsd -F disk.lst -v no

-F = name of the NSD Specification File
-v = Check the disk is part of an eixsting GPFS file system or ever had a GPFS file system on it (if yes, mmcrnsd will not create it as a new NSD

mmcrnsd: Processing disk /dev/sdb
mmcrnsd: Processing disk /dev/sdc
mmcrnsd: Propagating the cluster configuration data to all
affected nodes. This is an asynchronous process.

Step 13: Verify that the NSD is properly created.

# mmlsnsd
File system   Disk name    NSD servers
---------------------------------------------------------------------------
gpfs1         ds4200_b     nsd1-nas,nsd2-nas
gpfs1         ds4200_c     nsd2-nas,nsd1-nas

Step 14: Creating different partitions

If you are just creating a single partitions, the above will suffice. If you are creating more than 1 partition, you should allocate the appropriate number of LUNs and repeat Step 11 – 13. But for each partition you can use different “disk.lst” name such as disk2.lst, disk3.lst etc.

Step 15: Create the GPFS  file system

# mmcrfs /gpfs1 gpfs1 -F disk.lst -A yes -B 1m -v no -n 50 -j scatter

/gpfs1 = a mount point
gpfs1 = device entry in /dev for the file system
-F = output file from the mmcrnsd command
-A = mount the file system automatically every time mmfsd is started
-B = actual block size for this file system; it can not be larger than the maxblocksize set by the mmchconfig command
-v = check if this disk is part of an existing GPFS file system or ever had a GPFS file system on it. If yes, mmcrfs will not include this disk in the file system
-n = estimated number of nodes that will mount this file system.

If you have more than 1 partitions, you have to create the file system

# mmcrfs /gpfs2 gpfs2 -F disk2.lst -A yes -B 1m -b no -n 50 -j scatter
The following disks of gpfs1 will be formatted on nsd1-nas
.....
.....
Formatting file system
Disk up to 2.7 TB  can be added to
storage pool 'dcs_4200'
Creating Inode File
Creating Allocation Maps
Clearing Inode Allocation Map
Clearing Block Allocation Map
Formatting Allocation Map for storage pool 'system'
.....
.....
mmcrfs: Propagating the cluster configuration data
to all affected nodes. This is an asynchronous process.

Step 16: Verify GPFS Disk Status

# mmlsdisk gpfs1
disk         driver   sector failure holds    holds                            storage
name         type       size   group metadata data  status        availability pool
------------ -------- ------ ------- -------- ----- ------------- ------------ ------------
ds4200_b     nsd         512    4001 yes      yes   ready         up           system
ds4200_c     nsd         512    4002 yes      yes   ready         up           system

Step 17: Mount the file systems and checking permissions

# mmmount /gpfs1 -a
Fri Sep 11 12:50:17 EST 2012: mmmount:  Mounting file systems ...

Change Permission for /gpfs1

# chmod 777 /gpfs1

Step 18: Checking and testing of file system

Adding time for dd to test and analyse read and write performance

Step 19: Update the /etc/fstab

LABEL=/                 /                       ext3    defaults        1 1
tmpfs                   /dev/shm                tmpfs   defaults        0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
LABEL=SWAP-sda2         swap                    swap    defaults        0 0
......
/dev/gpfs1           /gpfs_data           gpfs       rw,mtime,atime,dev=gpfs1,noauto 0 0

More Information:

  1. Basic Installing and Configuring of GPFS Cluster (Part 1)
  2. Basic Installing and Configuring of GPFS Cluster (Part 2)
  3. Basic Installing and Configuring of GPFS Cluster (Part 3)
  4. Basic Installing and Configuring of GPFS Cluster (Part 4)
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s