Thursday 31 January 2019

Create a ACFS File System on Exadata X7-2 with 18c Grid

Planning to create 15TB ACFS mount for database backups on Exadata
We had x7-2 half rack setup with preinstalled 18c grid
Logged into ASM and checked disk group space details, around 60TB space allocated to DATAC1 disk group,will create 15TB ACFS from DATAC1

[oracle@dbm0dbadm01-vm01 ~]$asmcmd
ASMCMD> lsdg
State    Type    Rebal  Sector  Logical_Sector  Block       AU  Total_MB   Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  HIGH    N         512             512   4096  4194304  62914816  62523708          2621440        19967356              0             Y  DATAC1/
MOUNTED  NORMAL  N         512             512   4096  4194304  16760832  16757724           349184         8204270              0             N  RECOC1/

Create a Volume:
ASMCMD> volcreate -G DATAC1 -s 15360G  backup

Verify volume details:
ASMCMD> volinfo -G DATAC1 backup
Diskgroup Name: DATAC1

         Volume Name: BACKUP
         Volume Device: /dev/asm/backup-437
         State: ENABLED
         Size (MB): 15728640
         Resize Unit (MB): 512
         Redundancy: HIGH
         Stripe Columns: 8
         Stripe Width (K): 1024
ASMCMD> exit

Format create ACFS Volume:
as a grid owner run 
[oracle@dbm0dbadm01-vm01 ~]$ /sbin/mkfs -t acfs /dev/asm/backup-437
mkfs.acfs: version                   =
mkfs.acfs: on-disk version           = 46.0
mkfs.acfs: volume                    = /dev/asm/backup-437
mkfs.acfs: volume size               = 16492674416640  (  15.00 TB )
mkfs.acfs: Format complete.

Mount volume as /backup:
[root@dbm0dbadm01-vm01 ~]# /sbin/acfsutil registry -a /dev/asm/backup-437 /backup -u oracle
acfsutil registry: mount point /backup successfully added to Oracle Registry

Verify /backup mount from all cluster nodes:
It should be visible from all nodes
[oracle@dbm0dbadm01-vm01 ~]$ df -h /backup
Filesystem           Size  Used Avail Use% Mounted on
/dev/asm/backup-437   15T   31G   15T   1% /backup

[root@dbm0dbadm02-vm01 ~]# df -h /backup
Filesystem           Size  Used Avail Use% Mounted on
/dev/asm/backup-437   15T   31G   15T   1% /backup

Verify Cluster Resource status:
Newly created ACFS volume automatically added to cluster resources
#crsctl stat res -t
Name           Target  State        Server                   State details        Local Resources
               ONLINE  ONLINE       dbm0dbadm01-vm01         STABLE
               ONLINE  ONLINE       dbm0dbadm02-vm01         STABLE