Search This Blog

Tuesday, March 14, 2017

Configure Open filer for RAC installation in VM ware

Hai, in this article I will demonstrate installation and Configuration of OPENFILER for RAC Installation

i will provide the links for Linux Installation and Grid Installation later

NOTE: Install open filer with 512gbram, 10GB Hard disk, Hostonly N/W, and install s/w.
Before you click on reboot, attach 100GB addtion HDD and click reboot
NOTE: Before proceeding check ping for all IP’s
NOTE: for Rac Installation we need to have Public, Virtual, SCAN, SAN(openfiler) IP’s in same sequence

Assumptions:

Node Name
Adapter Name
IP – Type
IP Number
Netmask
RAC-1
Eth 0
Public
192.168.1.11
255.255.255.0
RAC-1
Eth 1
Private
10.0.0.11
255.0.0.0
RAC-1
hostfile
Virtual
192.168.1.21

-
-
-
-
-
RAC-2
Eth 0
Public
192.168.1.12
255.255.255.0
RAC-2
Eth 1
Private
10.0.0.12
255.0.0.0
RAC-2
hostfile
Virtual
192.168.1.22

-
-
-
-
-
RAC-1 / RAC-2
hostfile
Scan
192.168.1.30

Open Filer
Eth 0
Public
192.168.1.40
255.255.0.0

Steps included :
1.     Create Virtual Machine with 512mb Memory
2.     Install openfiler software with one network adapter
3.     Attach 100gb disk for ASM before reboot
4.     Configure ASM for Linux










Power on the Virtual Machine

















Before reboot add 100gb Disk for ASM Storage



Now reboot the system





Now install RAC1, RAC 2 Machines with two Ethernet adapters and Provide the IP and subnet mask as shown in above table


After Successful installation of RAC1 and RAC2 Ping each other along with SAN there should be no network connectivity issue between all
Node 1:-  RAC1
Node 2:- RAC2
[root@rac1 ~]# ping rac2
[root@rac1 ~]# ping rac1
[root@rac1 ~]# ping 192.168.1.40
[root@rac1 ~]# ping 192.168.1.11
[root@rac1 ~]# ping 192.168.1.12
[root@rac1 ~]# ping 10.0.0.11
[root@rac1 ~]# ping 10.0.0.12

[root@rac2 ~]# ping rac1
[root@rac2 ~]# ping rac2
[root@rac2 ~]# ping 192.168.1.40
[root@rac2 ~]# ping 192.168.1.12
[root@rac2 ~]# ping 192.168.1.11
[root@rac2 ~]# ping 10.0.0.12
[root@rac2 ~]# ping 10.0.0.11



Now open the GUI of open filer and prepare the disk for shareable



Click on System tab add who can access SAN



Click on Volumes Tab and Create volume disk of 100GB





Create Volume Group for the Disk





Create Volume Group for the Disk



Add Disk to Volume Group
Here you can define As per your requirement
1.       OCR
2.       Voting Disk (VD)
3.       Flash Recovery Area (FRA)
I am installing All together in one Disk only as vol 1



Enable and start service of iSCSI TARGET and iSCSI Initiator



Create IQN  for the disk
Note: if you created Different volume disks then create separate IQN’s for VD,OCR, FRA then define it Acc. Here I have used single iqn for all(OCR,VD,FRA) in a single disk as vol-1




You have Successfully Configured the OpenFiler

Login to your Linux as root user and discover your IQN form all the NODES Node 1 


Node-1 Machine : RAC1
login as: root
root@192.168.1.11's password:
Last login: Mon Feb 20 14:45:28 2017
[root@rac1 ~]# hostname
rac1.dell.com
[root@rac1 ~]#
[root@rac1 ~]# hostname -i
192.168.1.11
[root@rac1 ~]#
[root@rac1 ~]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:8D
          inet addr:192.168.1.11  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::20c:29ff:fefb:3f8d/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:281 errors:0 dropped:0 overruns:0 frame:0
          TX packets:163 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:47348 (46.2 KiB)  TX bytes:25000 (24.4 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:97
          inet addr:10.0.0.11  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::20c:29ff:fefb:3f97/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:214 errors:0 dropped:0 overruns:0 frame:0
          TX packets:86 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:36007 (35.1 KiB)  TX bytes:17656 (17.2 KiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:3758 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3758 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:8380416 (7.9 MiB)  TX bytes:8380416 (7.9 MiB)

virbr0    Link encap:Ethernet  HWaddr EA:A2:66:7A:21:4C
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:3647 (3.5 KiB)

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux
[root@rac1 ~]#
[root@rac1 ~]#

Your Disk is Not Available. So, Discover your IQN

[root@rac1 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac1 ~]#
[root@rac1 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped                                          [  OK  ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
                                                           [  OK  ]
                                                           [  OK  ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
                                                           [  OK  ]
[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table
[root@rac1 ~]#


Node-2 Machine : RAC2
login as: root
root@192.168.1.12's password:
Last login: Mon Feb 20 14:47:45 2017
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# hostname
rac2.dell.com
[root@rac2 ~]# hostname -i
192.168.1.12
[root@rac2 ~]#

[root@rac2 ~]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:16
          inet addr:192.168.1.12  Bcast:192.168.1.255  Mask:255.255.255.0
          inet6 addr: fe80::20c:29ff:fe36:9c16/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:200 errors:0 dropped:0 overruns:0 frame:0
          TX packets:151 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:39700 (38.7 KiB)  TX bytes:26672 (26.0 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:20
          inet addr:10.0.0.12  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::20c:29ff:fe36:9c20/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:216 errors:0 dropped:0 overruns:0 frame:0
          TX packets:95 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:37580 (36.6 KiB)  TX bytes:19182 (18.7 KiB)

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:4374 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4374 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:9177312 (8.7 MiB)  TX bytes:9177312 (8.7 MiB)

virbr0    Link encap:Ethernet  HWaddr 0E:D4:79:B6:C8:15
          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:27 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 b)  TX bytes:4405 (4.3 KiB)

[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux
[root@rac2 ~]#
[root@rac2 ~]#

Your Disk is Not Available. So, Discover your IQN

[root@rac2 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac2 ~]#
[root@rac2 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped                                          [  OK  ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
                                                           [  OK  ]
                                                           [  OK  ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
                                                           [  OK  ]
[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1       38245   307202931   83  Linux
/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris
/dev/sda3           41433       43982    20482875   83  Linux
/dev/sda4           43983      130541   695285167+   5  Extended
/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table
[root@rac2 ~]#


This article helps those who want to install grid Infrastructure in VMWARE using openfiler.
Thanks for Reading.

Regards,
Mohammed Areefuddin

No comments:

Post a Comment