Hai, in this article I will demonstrate installation and Configuration of OPENFILER for RAC Installation
i will provide the links for Linux Installation and Grid Installation later
NOTE: Install open filer with 512gbram, 10GB Hard disk, Hostonly N/W, and install s/w.
Before you click on reboot, attach 100GB addtion HDD and click reboot
NOTE: Before proceeding check ping for all IP’s
NOTE: for Rac Installation we need to have Public, Virtual, SCAN, SAN(openfiler) IP’s in same sequence
Assumptions:
Node Name
|
Adapter Name
|
IP – Type
|
IP Number
|
Netmask
|
RAC-1
|
Eth 0
|
Public
|
192.168.1.11
|
255.255.255.0
|
RAC-1
|
Eth 1
|
Private
|
10.0.0.11
|
255.0.0.0
|
RAC-1
|
hostfile
|
Virtual
|
192.168.1.21
| |
-
|
-
|
-
|
-
|
-
|
RAC-2
|
Eth 0
|
Public
|
192.168.1.12
|
255.255.255.0
|
RAC-2
|
Eth 1
|
Private
|
10.0.0.12
|
255.0.0.0
|
RAC-2
|
hostfile
|
Virtual
|
192.168.1.22
| |
-
|
-
|
-
|
-
|
-
|
RAC-1 / RAC-2
|
hostfile
|
Scan
|
192.168.1.30
| |
Open Filer
|
Eth 0
|
Public
|
192.168.1.40
|
255.255.0.0
|
Steps included :
1. Create Virtual Machine with 512mb Memory
2. Install openfiler software with one network adapter
3. Attach 100gb disk for ASM before reboot
4. Configure ASM for Linux
Power on the Virtual Machine
Before reboot add 100gb Disk for ASM Storage
Now reboot the system
Now install RAC1, RAC 2 Machines with two Ethernet adapters and Provide the IP and subnet mask as shown in above table
After Successful installation of RAC1 and RAC2 Ping each other along with SAN there should be no network connectivity issue between all
Node 1:- RAC1
|
Node 2:- RAC2
|
[root@rac1 ~]# ping rac2
[root@rac1 ~]# ping rac1
[root@rac1 ~]# ping 192.168.1.40
[root@rac1 ~]# ping 192.168.1.11
[root@rac1 ~]# ping 192.168.1.12
[root@rac1 ~]# ping 10.0.0.11
[root@rac1 ~]# ping 10.0.0.12
|
[root@rac2 ~]# ping rac1
[root@rac2 ~]# ping rac2
[root@rac2 ~]# ping 192.168.1.40
[root@rac2 ~]# ping 192.168.1.12
[root@rac2 ~]# ping 192.168.1.11
[root@rac2 ~]# ping 10.0.0.12
[root@rac2 ~]# ping 10.0.0.11
|
Now open the GUI of open filer and prepare the disk for shareable
Click on System tab add who can access SAN
Click on Volumes Tab and Create volume disk of 100GB
Create Volume Group for the Disk
Create Volume Group for the Disk
Add Disk to Volume Group
Here you can define As per your requirement
1. OCR
2. Voting Disk (VD)
3. Flash Recovery Area (FRA)
I am installing All together in one Disk only as vol 1
Enable and start service of iSCSI TARGET and iSCSI Initiator
Create IQN for the disk
Note: if you created Different volume disks then create separate IQN’s for VD,OCR, FRA then define it Acc. Here I have used single iqn for all(OCR,VD,FRA) in a single disk as vol-1
You have Successfully Configured the OpenFiler
Login to your Linux as root user and discover your IQN form all the NODES Node 1
Node-1 Machine : RAC1
login as: root
root@192.168.1.11's password:
Last login: Mon Feb 20 14:45:28 2017
[root@rac1 ~]# hostname
rac1.dell.com
[root@rac1 ~]#
[root@rac1 ~]# hostname -i
192.168.1.11
[root@rac1 ~]#
[root@rac1 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:0C:29:FB:3F:8D
inet addr:192.168.1.11 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fefb:3f8d/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:281 errors:0 dropped:0 overruns:0 frame:0
TX packets:163 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:47348 (46.2 KiB) TX bytes:25000 (24.4 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:FB:3F:97
inet addr:10.0.0.11 Bcast:10.255.255.255 Mask:255.0.0.0
inet6 addr: fe80::20c:29ff:fefb:3f97/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:214 errors:0 dropped:0 overruns:0 frame:0
TX packets:86 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:36007 (35.1 KiB) TX bytes:17656 (17.2 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:3758 errors:0 dropped:0 overruns:0 frame:0
TX packets:3758 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:8380416 (7.9 MiB) TX bytes:8380416 (7.9 MiB)
virbr0 Link encap:Ethernet HWaddr EA:A2:66:7A:21:4C
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:20 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:3647 (3.5 KiB)
[root@rac1 ~]# fdisk -l
Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 38245 307202931 83 Linux
/dev/sda2 38246 41432 25599577+ 82 Linux swap / Solaris
/dev/sda3 41433 43982 20482875 83 Linux
/dev/sda4 43983 130541 695285167+ 5 Extended
/dev/sda5 43983 130541 695285136 83 Linux
[root@rac1 ~]#
[root@rac1 ~]#
Your Disk is Not Available. So, Discover your IQN
[root@rac1 ~]# iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac1 ~]#
[root@rac1 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped [ OK ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
[ OK ]
[ OK ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
[ OK ]
[root@rac1 ~]# fdisk -l
Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 38245 307202931 83 Linux
/dev/sda2 38246 41432 25599577+ 82 Linux swap / Solaris
/dev/sda3 41433 43982 20482875 83 Linux
/dev/sda4 43983 130541 695285167+ 5 Extended
/dev/sda5 43983 130541 695285136 83 Linux
Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdb doesn't contain a valid partition table
[root@rac1 ~]#
Node-2 Machine : RAC2
login as: root
root@192.168.1.12's password:
Last login: Mon Feb 20 14:47:45 2017
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# hostname
rac2.dell.com
[root@rac2 ~]# hostname -i
192.168.1.12
[root@rac2 ~]#
[root@rac2 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:0C:29:36:9C:16
inet addr:192.168.1.12 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe36:9c16/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:200 errors:0 dropped:0 overruns:0 frame:0
TX packets:151 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:39700 (38.7 KiB) TX bytes:26672 (26.0 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:36:9C:20
inet addr:10.0.0.12 Bcast:10.255.255.255 Mask:255.0.0.0
inet6 addr: fe80::20c:29ff:fe36:9c20/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:216 errors:0 dropped:0 overruns:0 frame:0
TX packets:95 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:37580 (36.6 KiB) TX bytes:19182 (18.7 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:4374 errors:0 dropped:0 overruns:0 frame:0
TX packets:4374 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:9177312 (8.7 MiB) TX bytes:9177312 (8.7 MiB)
virbr0 Link encap:Ethernet HWaddr 0E:D4:79:B6:C8:15
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:27 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:4405 (4.3 KiB)
[root@rac2 ~]# fdisk -l
Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 38245 307202931 83 Linux
/dev/sda2 38246 41432 25599577+ 82 Linux swap / Solaris
/dev/sda3 41433 43982 20482875 83 Linux
/dev/sda4 43983 130541 695285167+ 5 Extended
/dev/sda5 43983 130541 695285136 83 Linux
[root@rac2 ~]#
[root@rac2 ~]#
Your Disk is Not Available. So, Discover your IQN
[root@rac2 ~]# iscsiadm -m discovery -t st -p 192.168.1.40
192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0
[root@rac2 ~]#
[root@rac2 ~]# service iscsi restart
iscsiadm: No matching sessions found
Stopping iSCSI daemon:
iscsid is stopped [ OK ]
Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)
[ OK ]
[ OK ]
Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.
[ OK ]
[root@rac2 ~]# fdisk -l
Disk /dev/sda: 1073.7 GB, 1073741824000 bytes
255 heads, 63 sectors/track, 130541 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 38245 307202931 83 Linux
/dev/sda2 38246 41432 25599577+ 82 Linux swap / Solaris
/dev/sda3 41433 43982 20482875 83 Linux
/dev/sda4 43983 130541 695285167+ 5 Extended
/dev/sda5 43983 130541 695285136 83 Linux
Disk /dev/sdb: 102.3 GB, 102374572032 bytes
255 heads, 63 sectors/track, 12446 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdb doesn't contain a valid partition table
[root@rac2 ~]#
This article helps those who want to install grid Infrastructure in VMWARE using openfiler.
Thanks for Reading.
Regards,
Mohammed Areefuddin















































No comments:
Post a Comment