{"id":1006,"date":"2009-01-02T09:13:04","date_gmt":"2009-01-02T13:13:04","guid":{"rendered":"http:\/\/onlineappsdba.com\/index.php\/2009\/01\/02\/oem-dbconsole-startup-issues-on-10g-r2-database-for-11ir12\/"},"modified":"2009-06-18T09:00:19","modified_gmt":"2009-06-18T13:00:19","slug":"oem-dbconsole-startup-issues-on-10g-r2-database-for-11ir12","status":"publish","type":"post","link":"https:\/\/onlineappsdba.com\/index.php\/2009\/01\/02\/oem-dbconsole-startup-issues-on-10g-r2-database-for-11ir12\/","title":{"rendered":"OEM DBConsole startup issues on 10g R2 database for 11i\/R12"},"content":{"rendered":"

On one of our cloned 11i Instance, I faced issues while trying to start Database Control <\/strong>(aka Enterprise Manager Console) using “emctl start dbconsole<\/strong>“.
\nThis post covers issues and resolution (Issues mentioned here are specific to particular Database and Operating System Version<\/font>)
\n.<\/p>\n

Instance Details <\/strong><\/u><\/p>\n

Operating System<\/strong> : Solaris Sparc 64 Bit
\nDatabase<\/strong> : Oracle Database Version 10.2.0.2
\nApps Version<\/strong> : 11.5.10.2<\/p>\n

.
\nThings good to know about Enterprise Manager <\/strong><\/u><\/p>\n

Database Control <\/strong>: is Web-based tool to manage database. Using Database Control (OEM) you can perform administrative task like adding tablespace, table, index, managed space or view performance statistics…<\/p>\n

Files\/Directory for Database Control<\/strong> (DB Console) :
\na) <\/strong>$ORACLE_HOME\/sysman
\nb) <\/strong>$ORACLE_HOME\/[hostname_sid]\/sysman
\nc)<\/strong> $ORACLE_HOME\/oc4j\/j2ee\/OC4J_DBConsole_[hostname]_[sid]<\/p>\n

Files useful in troubleshooting<\/strong> : $ORACLE_HOME\/[hostname_sid]\/sysman\/log\/<\/p>\n

How to use Database Control<\/strong><\/u><\/p>\n

a)<\/strong> ORACLE_HOME\/bin\/emctl start dbconsole\u00a0 [To start DB Control]
\nb)<\/strong> ORACLE_HOME\/bin\/emctl status dbconsole [To check status of DB Control]
\nc)<\/strong> ORACLE_HOME\/bin\/emctl stop dbconsole\u00a0\u00a0 [To stop DB Control]<\/p>\n

Issue 1<\/strong><\/u> : On running “emctl start dbconsole<\/strong>“, I received error message<\/p>\n

OC4J Configuration issue. $OH\/oc4j\/j2ee\/OC4J_DBConsole_$hostname_$sid not found
\n<\/font>
\nThis means enterprise manager was not configured and Fix was to configure enterprise manager using emca<\/strong> (Enterprise Manger Configuration Assistant).
\nSteps to create enterprise manager configuration files & repository are explained in “Oracle Enterprise Manager Advanced Configuration Guide<\/strong>“\u00a0 here<\/a><\/p>\n

.<\/p>\n

How to create Database Control<\/strong><\/u>(DB Console)<\/strong><\/p>\n

emca<\/strong> (Enterprise Manager Configuration Assistant) is utility to create Database Control Configuration files<\/strong> and Repository Objects<\/strong><\/p>\n

For 10.2.X Database I used
\nemca -config dbcontrol db -repos create<\/strong><\/p>\n

.<\/p>\n

Issue 2<\/strong><\/u> : While running emca, I got below error message<\/p>\n

UnsatisfiedLinkError exception loading native library: njni10
\nException in thread “main” java.lang.UnsatisfiedLinkError: get
\nat oracle.net.common.NetGetEnv.get(Native Method)
\nat oracle.sysman. assistants. util.sqlEngine. SQLEngine. getEnvParams (SQLEngine.java:409)
\n<\/font><\/p>\n

as per Metalink note 553154.1<\/strong>, Fix was to set environment variable and relink executable<\/p>\n

Fix 2<\/strong><\/u> :
\nexport LD_LIBRARY_PATH=$ORACLE_HOME\/lib32
\nexport LD_LIBRARY_PATH_64=$ORACLE_HOME\/lib
\ncd $ORACLE_HOME\/network\/lib
\nmake -f ins_net_client.mk client_sharedlib
\nrelink all<\/p>\n

Issue 3<\/strong><\/u> : While running “relink all<\/strong>“, there was another error<\/p>\n

ld: fatal: library -ljava: not found
\nld: fatal: library -ljvm: not found
\nld: fatal: File processing errors. No output written to $OH\/10.2.0\/sysman\/lib\/libnmemso.so
\n*** Error code 1
\nmake: Fatal error: Command failed for target `$OH\/10.2.0\/sysman\/lib\/libnmemso.so’
\nCurrent working directory $OH\/10.2.0\/sysman\/lib
\n*** Error code 1
\nmake: Fatal error: Command failed for target `libnmemso’<\/font>
\nFix 3<\/strong><\/u> : As per Metalink note 743833.1<\/strong>, issue was because there are references of source system in make file<\/strong> and fix was to change references from source to target instance. (DB was cloned as part of 11i Cloning steps)<\/p>\n

cp $ORACLE_HOME\/sysman\/lib\/env_sysman.mk $ORACLE_HOME\/sysman\/lib\/env_sysman.mk.bak<\/p>\n

change
\nJRE_LIB_DIR=$SOURCE_ORACLE_HOME<\/font>\/10.2.0\/jdk\/jre\/lib\/sparc<\/strong>\u00a0 (It was pointing to source Directory)
\nto
\nJRE_LIB_DIR=$TARGET_ORACLE_HOME<\/font>\/10.2.0\/jdk\/jre\/lib\/sparc<\/strong><\/p>\n

and relink again using “relink all<\/strong>”
\n.<\/p>\n


\nIssue 4 <\/strong><\/u>: Just when I was expecting all issues to be resolved by now I got another (different) error message while\u00a0 running “relink all<\/strong>”<\/p>\n

ld: warning: file $OH\/10.2.0\/lib\/libclntsh.so.10.1: wrong ELF class: ELFCLASS64
\nUndefined\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 first referenced
\nsymbol\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 in file
\nztch\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 $OH\/10.2.0\/lib32\/\/libnmemso.so<\/font><\/p>\n

ld: fatal: Symbol referencing errors. No output written to $OH\/10.2.0\/sysman\/lib\/emagent
\n*** Error code 1
\nmake: Fatal error: Command failed for target `$OH\/10.2.0\/sysman\/lib\/emagent’
\nCurrent working directory $OH\/10.2.0\/sysman\/lib
\n*** Error code 1
\nmake: Fatal error: Command failed for target `emagent’
\nld libclntsh.so.10.1 wrong ELF class ELFCLASS64
\n<\/font><\/p>\n

Fix 4 <\/strong><\/u>: another note from Metalink 395731.1<\/strong>, and fix was to create soft link<\/strong> for file “ldflags<\/strong>” like<\/p>\n

ln -s $ORACLE_HOME\/lib\/ldflags $ORACLE_HOME\/lib32\/ldflags<\/strong><\/p>\n

After creating softlink, I did manage to relink all executable in ORACLE_HOME successfully and it was time to run emca<\/strong> for enterprise manager configuration<\/p>\n

“emca -config dbcontrol db -repos create<\/strong>”<\/p>\n

.<\/p>\n

Issue 5<\/u><\/strong> : While running above emca<\/strong> command, scripting was prompting for dbsnmp<\/strong> password again and again stating<\/p>\n

“Invalid username\/password<\/strong>” (Even though I could connect to dbsnmp\/ dbsnmp_passsword from sqlplus)<\/p>\n

Error message 5<\/strong><\/u> : On checking emca<\/strong> logs at\u00a0 $OH\/cfgtoollogs\/emca\/ emca_$timestamp.log<\/strong><\/p>\n

oracle.sysman.assistants.util.sqlEngine.SQLFatalErrorException: ORA-01034: ORACLE not available
\n<\/font>
\n.
\nFix 6<\/strong><\/u> : It was time to search in metalink again and this time I got note # 337260.1 <\/strong>according to this note issue was because of user profile<\/strong> (password limit and resource limit)<\/p>\n

SQL> select u.username, u.profile, p.resource_name, p.limit
\nfrom dba_profiles p, dba_users u
\nwhere p.profile=u.profile
\nand u.username in (‘DBSNMP’)
\nand p.resource_type = ‘PASSWORD’
\norder by u.username, p.resource_name;<\/p>\n

Profile for user dbsnmp<\/strong> was set according to metalink 337260.1 which means issue was something else, on doing some hit & trial I realized I was using SID in uppercase<\/strong> where as in database listener.ora<\/strong> SID was in lower case<\/strong>.<\/p>\n

When I enetered SID name in lowercase, emca script accepted dbsnmp password and finally after 3 hours I managed to install\/configure enterprise manager console on cloned target 11i Database Instance.<\/p>\n

30-Oct-2008 16:51:05 oracle.sysman.emcp.EMDBPostConfig performConfiguration
\nINFO: >>>>>>>>>>> The Database Control URL is http:\/\/machinename:<port_number>\/em <<<<<<<<<<<
\nEnterprise Manager configuration completed successfully
\nFINISHED EMCA at 30-Oct-2008 16:51:05
\n<\/font><\/p>\n

—
\nMore on how to monitor database using database control (dbconsole) coming soon …<\/strong><\/font><\/p>\n

References<\/strong><\/u><\/p>\n