Oracle Apps R12.2 : Error Starting Admin Server : weblogic.nodemanager.NMException java.io.IOException: Server failed to start up

This post is from our Oracle Apps DBA (R12.2) Training ( next batch starts on 7th Feb and only 2 seats remaining . We limit number trainees to 15 and We cover Architecture, Installation, File System, WebLogic Concepts, Patching, Cloning , Common Tasks and difference in 12.2 from previous version with Hands-On,  Register here for Oracle Apps DBA 12.2 Training )

One of the trainee from our previous batch, having an issue ” Error Starting server AdminServer: weblogic.nodemanager.NMException: Exception while starting server ‘AdminServer” in Oracle E-Business Suite R12.2 to start AdminServer .

Note: Oracle E-Business Suite 12.2 uses WebLogic Server as underlying application Server and you get Weblogic Domain with 1 Admin Server and 4 Managed Servers. Application is deployed in Managed Server and to start Admin Server or Managed Server it rely on Node Manager (part of WebLogic Server) Register here for Oracle Apps DBA 12.2 Training for FREE bonus class on WebLogic with Apps DBA’s.

 

Issue:

1. Starting Services in EBS R12.2 results in error starting Admin Server (adstrtall script calls adnodemgrctl to start NodeManager and adadminsrvctl to start Admin Server)

cd $ADMIN_SCRIPTS_HOME

./adstrtal.sh apps/apps

adadminsrvctl.sh: exiting with status 1

adadminsrvctl.sh: check the logfile /u02/oracle/PRD12211/fs1/inst/apps/PRD12211_iamdemo07/logs/appl/admin/log/

adadminsrvctl.txt for more information …

2. Error message in logfile /u02/oracle/PRD12211/fs1/inst/apps/PRD12211_iamdemo07/logs/appl/admin/log/

adadminsrvctl.txt

Error Starting server AdminServer: weblogic.nodemanager.NMException: Exception while starting server ‘AdminServer’

Note: NMException means error in Node Manager (that means Node Manager encountered some error while starting Admin Server)

3. In Node Manager Logfile, error message is /u02/ oracle/PRD12211/ fs1/FMW_Home/ wlserver_10.3/ common/ nodemanager/nmHome1

<May 22, 2015 7:12:25 AM> <INFO> <EBS_domain_PRD12211> <AdminServer> <Rotated server output log to “/u02/oracle/PRD12211/fs1/FMW_Home/user_projects/domains/

EBS_domain_PRD12211/servers/AdminServer/logs/AdminServer.out00041″>
<May 22, 2015 7:12:25 AM> <INFO> <EBS_domain_PRD12211> <AdminServer> <Server error log also redirected to server log>
<May 22, 2015 7:12:25 AM> <INFO> <EBS_domain_PRD12211> <AdminServer> <Server output log file is ‘/u02/oracle/PRD12211/fs1/FMW_Home/user_projects/domains/

EBS_domain_PRD12211/servers/AdminServer/logs/AdminServer.out’>
<May 22, 2015 7:12:41 AM> <INFO> <EBS_domain_PRD12211> <AdminServer> <Server failed during startup so will not be restarted>
<May 22, 2015 7:12:41 AM> <WARNING> <Exception while starting server ‘AdminServer’>
java.io.IOException: Server failed to start up. See server output log for more details.
at weblogic.nodemanager.server.AbstractServerManager.start(AbstractServerManager.java:214)
at weblogic.nodemanager.server.ServerManager.start(ServerManager.java:23)
at weblogic.nodemanager.server.Handler.handleStart(Handler.java:617)
at weblogic.nodemanager.server.Handler.handleCommand(Handler.java:129)
at weblogic.nodemanager.server.Handler.run(Handler.java:73)
at java.lang.Thread.run(Thread.java:724)

4. Then Looked into Admin Server log file out /u02/ oracle/ PRD12211/ fs1/ FMW_Home/ user_projects/ domains/EBS_domain_PRD12211/servers/AdminServer/logs/AdminServer.out 

/u02/oracle/PRD12211/fs1/FMW_Home/user_projects/domains/EBS_domain_PRD12211/

servers/AdminServer/logs/AdminServer.out
Caused By: oracle.security.jps.service.igf.IGFException: JPS-02592: Failed to push ldap config data to libOvd for service instance “idstore.ldap” in JPS context “default”, cause: java.io.FileNotFoundException: /tmp/.ovdlock.tmp (Permission denied)
at oracle.security.jps.internal.igf.ovd.OvdIGFServiceProvider.pushLdapNamesTolibOvd

(OvdIGFServiceProvider.java:321)
at oracle.security.jps.internal.igf.ovd.OvdIGFServiceProvider.prepareDataPush2libOvd

(OvdIGFServiceProvider.java:370)
at oracle.security.jps.internal.idstore.ldap.LdapIdentityStoreProvider$NoLibOvd.getInstance

(LdapIdentityStoreProvider.java:339)
at oracle.security.jps.internal.idstore.ldap.LdapIdentityStoreProvider.getInstance

(LdapIdentityStoreProvider.java:118)
at oracle.security.jps.internal.idstore.ldap.LdapIdentityStoreProvider.getInstance

(LdapIdentityStoreProvider.java:74)
Truncated. see log file for complete stacktrace
Caused By: java.io.FileNotFoundException: /tmp/.ovdlock.tmp (Permission denied)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at oracle.ods.virtualization.config.ConfigureAdapters.configure(ConfigureAdapters.java:512)
at oracle.security.jps.internal.igf.ovd.OvdIGFServiceProvider.pushLdapNamesTolibOvd

(OvdIGFServiceProvider.java:312)

Fix:

1. Looked into the /tmp directory

drwxrwxrwt. 28 root root 24576 May 22 07:39 tmp

But there is no .ovdlock.tmp

2. So changed the permission to 777 of tmp directory

chmod 777 /tmp

3. Restart adminserver again

cd $ADMIN_SCRIPTS_HOME
./adadminsrvctl.sh start
You are running adadminsrvctl.sh version 120.10.12020000.9

Enter the WebLogic Admin password:
Enter the APPS Schema password:
Starting WLS Admin Server…
Refer /u02/oracle/PRD12211/fs1/inst/apps/PRD12211_iamdemo07/logs/appl/admin/log/

adadminsrvctl.txt for details

adadminsrvctl.sh: exiting with status 0

adadminsrvctl.sh: check the logfile /u02/oracle/PRD12211/fs1/inst/apps/_iamdemo07/logs/appl/admin/log/adadminsrvctl.txt for more information …

And this time AdminServer should be up and running fine.

If you want to learn more about Oracle Apps DBA (Architecture, Installation, WebLogic, Patching, Cloning and other maintenance tasks with the upgrade of Oracle E-Business Suite 12.2.0 to 12.2.4) then have a look at our Oracle Apps DBA (R12.2) Training (next batch starts on 7th February, 2016).

Note: We are so confident on our workshops that we provide 100% Money back guarantee, in unlikely case of you being not happy after 2 sessions, just drop us a mail before third session and We’ll refund FULL money (or ask us from our 100s of happy trainees in our private Facebook Group)

Oracle AppsDBA R12.2 Training

Live Instructor led Online sessions with Hands-on Lab Exercises, Dedicated Machines to Practice and Recorded sessions of the Training

Click here to learn more with limited time discounts

 

Series Navigation<< FREE Demo Class : Oracle Apps DBA 12.1 & 12.2 : on 29 January (Friday) Join Team K21 TechnologiesForgot EBS 12.2 : “Invalid credentials passed” issue while starting Admin Server >>

About the Author SeemaYadav

Oracle Consultant at K21 Technologies - Oracle Gold Partner specialising in Design, Implement, and Support.

Leave a Comment:

Not found