Error while cloning R12 – Database Tier : RC-00110: Fatal: Error occurred while relinking of ApplyDBTechStack : Error while running adlnkoh.sh
I was recently cloning Oracle R12 instance from hot backup (RMAN : DUPLICATE ) using Metalink note 406982.1 Cloning Oracle Applications Release 12 with Rapid Clone and clone failed while reconfiguring database tier ORACLE_HOME on target node.
Since I was cloning from RMAN hotbackup (using DUPLICATE command in RMAN), I used option dbTechStack (use option dbTier for cold back) on database tier.
$ cd [RDBMS ORACLE_HOME]/appsutil/clone/bin
$ perl adcfgclone.pl dbTechStack
.
What is difference between dbTier and dbTechStack option in adcfgclone.pl ?
.
—dbTier option reconfigures ORACLE_HOME and recreates (clone) database automatically for you. Use this option for cloning from cold backup.
—dbTechStack option reconfigures only ORACLE_HOME in target machine. You then manually clone database (by manually creating control file or using RMAN DUPLICATE) . Use this option for cloning from hot backup or cloning from standby database.
.
Error during clone in R12:
APPS Password : Log file located at /target_oracle_home/ appsutil/ log/$CONTEXT_NAME/ ApplyDBTechStack_04191255.log
– 2% completed
\ 2% completed RC-00110: Fatal: Error occurred while relinking of ApplyDBTechStack ERROR while running Apply…
Mon Apr 05 12:57:44 2010
ERROR: Failed to execute /target_oracle_home/appsutil/clone/bin/adclone.pl Please check logfile.
This issue is reported in Metalink Note 603104.1 Troubleshooting RapidClone issues with Oracle Applications R12 : as per this note issue is because of 32 bit library and issue was fixed in 12.0.6 (I was cloning 12.1.1) so it was time to look at relink logs.
.
Error 1 : ldflags soft link pointing to source instance
Since error was while relinking (RC-00110 Fatal Error while relinking) so I checked logs related to relink which were available at /[target_oracle_home]/ appsutil/ log/$CONTEXT_NAME/ make_[timeStamp].log
.
cat: cannot open /target_oracle_home/db/tech_st/11.1.0/lib32/ldflags
*** Error code 2
.
Next step was to check file ldflags
.
$ ls -l /target_oracle_home/db/tech_st/11.1.0/lib32/ldflags
lrwxrwxrwx 1 ocmsmig1 dba 54 Apr 19 00:49 /target_oracle_home/db/tech_st/11.1.0/lib32/ldflags -> /source_oracle_home/db/tech_st/11.1.0/lib/ldflags
Hence issue was that softlink for ldflags was pointing to source instance (I used tar to backup and restore ORACLE_HOME from source to target machine).
.
Fix 1 : Drop softlink and recreate it pointing to target ORACLE_HOME
$ cd /[target_oracle_home]/db/tech_st/11.1.0/lib32/
$ rm ldflags
$ ln -s /[target_oracle_home]/db/tech_st/11.1.0/lib/ldflags ldflags
.
Restart clone $ perl adcfgclone.pl dbTechStack and it failed with different error this time
.
.
Error 2 : wrong ELF class ELFCLASS32
- ld: fatal: file /target_oracle_home/db/tech_st/11.1.0/appsutil/clone/jre/lib/sparc/libjava.so: wrong ELF class: ELFCLASS32
- ld: fatal: file /target_oracle_home/db/tech_st/11.1.0/appsutil/clone/jre/lib/sparc/server/libjvm.so: wrong ELF class: ELFCLASS32
- ld: fatal: File processing errors. No output written to /target_oracle_home/11.1.0/sysman/lib/libnmemso.so
*** Error code 1
Cause : As per Metalink note 743833.1 Rapid Clone & Em Dbconsole also reported here; there are references of source system in make file and fix is to change references from source to target instance.
.
Fix 2 : change reference in env_sysman.mk
cp $ORACLE_HOME/sysman/lib/env_sysman.mk $ORACLE_HOME/sysman/lib/env_sysman.mk.bak
change
JRE_LIB_DIR=$SOURCE_ORACLE_HOME/10.2.0/jdk/jre/lib/sparc (It was pointing to source Directory)
to
JRE_LIB_DIR=$TARGET_ORACLE_HOME/10.2.0/jdk/jre/lib/sparc
.
Restart clone $ perl adcfgclone.pl dbTechStack and it failed with third error (though relink completed successfully) this time
.
.Error 3: ouicli.pl failed in /[target_oracle_home]/ appsutil/ log/ $CONTEXT_NAME/ ApplyDBTechStack_04191255.log
_______________________________________________________________
ouicli.pl INSTE8_APPLY 255
AutoConfig is exiting with status 1
RC-50013: Fatal: Instantiate driver did not complete successfully.
/[target_oracle_home]/db/tech_st/11.1.0/appsutil/driver/regclone.drvFinished OUI CLI cloning for s_db_oh with return code: 72057594037927935 (non zero status code)
________________________________________________________________
. Cause 3 Missing jre directory in $ORACLE_HOME/appsutil/ on target Database Tier
Fix 3: As part of “Enable Autoconfig in Database Tier : Metalink Note 387859.1” Install JRE on source install (also on target instance if files are already copied to target instance)