WARNING OGG-01933 Datastore create failed.

GGSCI (racnode01.com) 2> stop *

GGSCI (racnode01.com) 4> stop jagent

JAgent process is required by other GGS processes.

Are you sure you want to stop it (y/n)? y

 

Sending STOP request to GGCMD JAGENT ...

Request processed.

JAgent stopped.

 

GGSCI (racnode01.com) 5> stop mgr

Manager process is required by other GGS processes.

Are you sure you want to stop it (y/n)?y

 

Sending STOP request to MANAGER ...

Request processed.

Manager stopped.

GGSCI (racnode01.com) 7> delete datastore

Are you sure you want to delete the datastore? yes

 

2020-08-31 03:49:24  INFO    OGG-06492  Datastore deleted.

 

GGSCI (racnode01.com) 8> create datastore

2020-08-31 03:49:49  WARNING OGG-01933  Datastore create failed.

 

GGSCI (racnode01.com) 9> exit

/san/gg> ./ggsci 

GGSCI (racnode01.com) 1> create datastore

Profile 'Trace' added.

 

2020-08-31 03:52:00  INFO    OGG-06489  Datastore created.

 

GGSCI (racnode01.com) 2> start mgr

Manager started.

 

GGSCI (racnode01.com) 4> start *

GGSCI (racnode01.com) 6> start jagent

Check Hidden parameters in Oracle Database

set line 200 pages 555

 col PARAMETER format a40

 col DESCRIPTION format a70

 col SESSION_VALUE format a10

 col INSTANCE_VALUE format a10

 

 SELECT a.ksppinm AS parameter,

        a.ksppdesc AS description,

        b.ksppstvl AS session_value,

        c.ksppstvl AS instance_value

 FROM   x$ksppi a,

        x$ksppcv b,

        x$ksppsv c

 WHERE  a.indx = b.indx

 AND    a.indx = c.indx

 AND    a.ksppinm LIKE '/_%' ESCAPE '/'

 ORDER BY a.ksppinm;

ORA-01678: parameter db_file_name_convert must be pairs of pattern and replacement strings

SQL> alter system set db_file_name_convert ='' scope=spfile sid='*';

alter system set db_file_name_convert ='' scope=spfile sid='*'

*

ERROR at line 1:

ORA-32017: failure in updating SPFILE

ORA-01678: parameter db_file_name_convert must be pairs of pattern and replacement strings

SQL> alter system reset db_file_name_convert scope=spfile sid='*';

System altered.

Patches to be applied before upgrading Grid and DB to 19c from previous release

List of One-off patches for Upgrades, Downgrades and Co-existence with previous release

GI Upgrade to 19c (Linux x86-64): 

From Release	Bug#(s)	Patch	Description	Additional comments
18c	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_183000OCWRU_<platform>.zip
12.2.0.1.0	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_12201190115OCWJAN2019RU_<platform>.zip
12.1.0.2	21255373			Recommended to install latest 12.1.0.2 GI PSU
	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_12102190115forOCW_<platform>.zip
11.2.0.4	17617807	GI PSU 22646198	11.2.0.4.160419 (Apr 2016) Grid Infrastructure Patch Set Update (GI PSU)	Recommended to install latest* 11.2.0.4 GI PSU
	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_11204190115forOCW_<platform>.zip

 

DB Upgrades to 19c:

From Release	Bug#(s)	Patch	Description	Additional comments
18c	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_183000OCWRU_<platform>.zip
12.2.0.1.0	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_12201190115OCWJAN2019RU_<platform>.zip
12.1.0.2	21255373
	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_12102190115forOCW_<platform>.zip
11.2.0.4	17617807	GI PSU 22646198	11.2.0.4.160419 (Apr 2016) Grid Infrastructure Patch Set Update (GI PSU)
	21255373
	28553832	28553832	LNX-191-EXA:CSSD PROCESS CANNOT GET REAL-TIME PRIORITY	p28553832_11204190115forOCW_<platform>.zip

Managing older database with 19c ASM:

With Release	Bug#(s)	Patch	Description	Additional comments
18c DB	None	None	None	None
12.2.0.1 DB	None	None	None	None
12.1.0.2 DB	21626377	21626377	12.2_150812: DBCA FAILS TO CREATE 12102 DB OVER 12.2 GI/ASM	Install 12.1.0.2.170718 DB PSU or later
				Install 12.1.0.2.170117 DB Proactive BP or later
	21780146	21780146	LNX64-12.2-WLM: MGMTDB FAILED TO BE CREATED DURING POST GI INSTALLATION
11.2.0.4 DB	23519414	23186035	W2K12_122_CMP: CREATE 11204DB WITH 122 ENV AFTER 1120419DBBP HIT ORA-00955	11.2.0.4.190416 (Apr 2019) GI PSU or later

19.8 Patch update details:

GI Release Update (July 2020):       p31305339_190000_Linux-x86-64.zip

Database Release Update (July 2020): p31281355_190000_Linux-x86-64.zip

Steps to downgrade failed 18c to 19c clusterware upgrade on node 1

18c to 19c Clusterware upgrade failed on node 1 while running rootupgrade.sh,Node 2 is running with 18c

crs status from node 1

cd /u01/app/19.3.0.0/grid/bin

[grid@racnode01 ~]$ crsctl stat res -t -init

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

      1        ONLINE  OFFLINE                               STABLE

ora.cluster_interconnect.haip

      1        ONLINE  OFFLINE                               STABLE

ora.crf

      1        ONLINE  ONLINE       racnode01            STABLE

ora.crsd

      1        ONLINE  OFFLINE                               STABLE

ora.cssd

      1        ONLINE  OFFLINE                               STABLE

ora.cssdmonitor

      1        ONLINE  ONLINE       racnode01            STABLE

ora.ctssd

      1        ONLINE  OFFLINE                               STABLE

ora.diskmon

      1        OFFLINE OFFLINE                               STABLE

ora.driver.afd

      1        ONLINE  ONLINE       racnode01            STABLE

ora.drivers.acfs

      1        ONLINE  ONLINE       racnode01            STABLE

ora.evmd

      1        ONLINE  INTERMEDIATE racnode01            STABLE

ora.gipcd

      1        ONLINE  ONLINE       racnode01            STABLE

ora.gpnpd

      1        ONLINE  ONLINE       racnode01            STABLE

ora.mdnsd

      1        ONLINE  ONLINE       racnode01            STABLE

ora.storage

      1        ONLINE  OFFLINE                               STABLE

--------------------------------------------------------------------------------

[grid@racnode01 ~]$

 

Step 1:Shut down crs on the first node

root@racnode01:# cd /u01/app/19.3.0.0/grid/bin

root@racnode01:# ./crsctl stop crs -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'racnode01'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'racnode01'

CRS-2673: Attempting to stop 'ora.crf' on 'racnode01'

CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'racnode01'

CRS-2673: Attempting to stop 'ora.driver.afd' on 'racnode01'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'racnode01'

CRS-2673: Attempting to stop 'ora.evmd' on 'racnode01'

CRS-2677: Stop of 'ora.cssdmonitor' on 'racnode01' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'racnode01'

CRS-2677: Stop of 'ora.driver.afd' on 'racnode01' succeeded

CRS-2677: Stop of 'ora.crf' on 'racnode01' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'racnode01'

CRS-2677: Stop of 'ora.drivers.acfs' on 'racnode01' succeeded

CRS-2677: Stop of 'ora.mdnsd' on 'racnode01' succeeded

CRS-2677: Stop of 'ora.evmd' on 'racnode01' succeeded

CRS-2677: Stop of 'ora.gpnpd' on 'racnode01' succeeded

CRS-2677: Stop of 'ora.gipcd' on 'racnode01' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'racnode01' has completed

CRS-4133: Oracle High Availability Services has been stopped.

 

Step 2. Unset the Oracle ASM rolling migration mode from any other node running GI other than first node

 

SQL> SELECT SYS_CONTEXT('sys_cluster_properties', 'cluster_state') FROM DUAL;

SYS_CONTEXT('SYS_CLUSTER_PROPERTIES','CLUSTER_STATE')

----------------------------------------------------------

In Rolling Upgrade

 

SQL> ALTER SYSTEM STOP ROLLING MIGRATION;

System altered.

 

SQL> SELECT SYS_CONTEXT('sys_cluster_properties', 'cluster_state') FROM DUAL;

SYS_CONTEXT('SYS_CLUSTER_PROPERTIES','CLUSTER_STATE')

------------------------------------------------------------

Normal

 

Step 3. Run command from any other node running GI other than first node

root@racnode02:# ./clscfg -nodedowngrade -h racnode01

clscfg: -nodedowngrade mode specified

clscfg: EXISTING configuration version 5 detected.

clscfg: version 5 is 12c Release 2.

Successfully restored the node specific configuration from backup for host:[racnode01]

root@racnode02:#

 

Step 4. From Node1 Grid home, run the command to downgrade Clusterware

root@racnode01:# pwd

/u01/app/19.3.0.0/grid/crs/install

root@racnode01:# ./rootcrs.sh -downgrade -online

Using configuration parameter file: /u01/app/19.3.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /app/grid/crsdata/racnode01/crsconfig/crsdowngrade_racnode01_2020-08-18_04-09-29AM.log

 

2020/08/18 04:13:32 CLSRSC-591: successfully downgraded Oracle Clusterware stack on this node

2020/08/18 04:13:33 CLSRSC-592: Run 'crsctl start crs' from home /u01/app/18.3.0.0/grid on each node to complete downgrade.

root@racnode01:#

root@racnode01:#

 

 

Step 5: Start crs from 18c home

root@racnode01:# cd /u01/app/18.3.0.0/grid/bin

root@racnode01:# ./crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

 

[grid@racnode02 bin]$ ./crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.LISTENER.lsnr

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.POC_DATA.dg

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.POC_FRA.dg

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.VOTEDISK.GHCHKPT.advm

               OFFLINE OFFLINE      racnode01            STABLE

               OFFLINE OFFLINE      racnode02            STABLE

ora.VOTEDISK.dg

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.chad

               OFFLINE OFFLINE      racnode01            STABLE

               OFFLINE OFFLINE      racnode02            STABLE

ora.helper

               OFFLINE OFFLINE      racnode01            IDLE,STABLE

               OFFLINE OFFLINE      racnode02            STABLE

ora.net1.network

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.ons

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.proxy_advm

               ONLINE  ONLINE       racnode01            STABLE

               ONLINE  ONLINE       racnode02            STABLE

ora.votedisk.ghchkpt.acfs

               OFFLINE OFFLINE      racnode01            STABLE

               OFFLINE OFFLINE      racnode02            STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       racnode01            STABLE

ora.LISTENER_SCAN2.lsnr

      1        ONLINE  ONLINE       racnode02            STABLE

ora.LISTENER_SCAN3.lsnr

      1        ONLINE  ONLINE       racnode02            STABLE

ora.MGMTLSNR

      1        ONLINE  ONLINE       racnode02            XXX.XX.XX.XX,STABLE

ora.asm

      1        ONLINE  ONLINE       racnode01            Started,STABLE

      2        ONLINE  ONLINE       racnode02            Started,STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.cvu

      1        ONLINE  OFFLINE                               STABLE

ora.racnode01.vip

      1        ONLINE  ONLINE       racnode01            STABLE

ora.racnode02.vip

      1        ONLINE  ONLINE       racnode02            STABLE

ora.mgmtdb

      1        ONLINE  ONLINE       racnode02            Open,STABLE

ora.poc01.db

      1        ONLINE  ONLINE       racnode01            Open,HOME=/u01/app/o

                                                             racle/product/11.2.0

                                                             _64,STABLE

      2        ONLINE  ONLINE       racnode02            Open,HOME=/u01/app/o

                                                             racle/product/11.2.0

                                                             _64,STABLE

ora.poc01.poc01_db1.svc

      1        ONLINE  ONLINE       racnode01            STABLE

ora.qosmserver

      1        OFFLINE OFFLINE                               STABLE

ora.rhpserver

      1        OFFLINE OFFLINE                               STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       racnode01            STABLE

ora.scan2.vip

      1        ONLINE  ONLINE       racnode02            STABLE

ora.scan3.vip

      1        ONLINE  ONLINE       racnode02            STABLE

----------------------------------------------------------------------