adoacorectl.sh can not start

adoacorectl.sh: exiting with status 206/204

[Service Control Execution Report]

The report format is:

  <Service Group>            <Service>                              <Script>         <Status>

 

  Root Service                                                                       Enabled

  Root Service               Oracle Process Manager for VIS_erpvis  adopmnctl.sh     Started

  Web Entry Point Services                                                           Enabled

  Web Entry Point Services   Oracle HTTP Server VIS_erpvis          adapcctl.sh      Started

  Web Entry Point Services   OracleTNSListenerAPPS_VIS_erpvis       adalnctl.sh      Started

  Web Application Services                                                           Enabled

  Web Application Services   OACORE OC4J Instance VIS_erpvis        adoacorectl.sh   Failed

  Web Application Services   FORMS OC4J Instance VIS_erpvis         adformsctl.sh    Failed

  Web Application Services   OAFM OC4J Instance VIS_erpvis          adoafmctl.sh     Failed

  Batch Processing Services                                                          Enabled

  Batch Processing Services  OracleConcMgrVIS_erpvis                adcmctl.sh       Started

  Batch Processing Services  Oracle Fulfillment Server VIS_erpvis   jtffmctl.sh      Started

  Other Services                                                                     Disabled

  Other Services             OracleFormsServer-Forms VIS_erpvis     adformsrvctl.sh  Disabled

  Other Services             Oracle Metrics Client VIS_erpvis       adfmcctl.sh      Disabled

  Other Services             Oracle Metrics Server VIS_erpvis       adfmsctl.sh      Disabled

  Other Services             Oracle MWA Service VIS_erpvis          mwactlwrpr.sh    Disabled

In this Document

Symptoms

Changes

Cause

Solution

---

 

Applies to:

Oracle Applications Technology Stack - Version 12.1.3 and later
Information in this document applies to any platform.

Symptoms

 One of the OC4J:oacore process does not start on the middle-tier server

cd $ADMIN_SCRIPTS_HOME
./adstrtall.sh apps/apps_pw or ./adoacorectl.sh

Applications will start except for one of the OC4J processes:
OC4JGroup:default_group | OC4J:oacore | 21034 | Alive
OC4JGroup:default_group | OC4J:oacore | N/A | Down


We have four web/forms servers, including this one.
This is the only server having the problem.

Found the following errors in these logs:
adoacorectl.txt

03/30/12-10:12:24 :: adoacorectl.sh: Starting OPMN managed OACORE OC4J instance

opmnctl: starting opmn managed processes...
================================================================================
opmn id=ebs015.oracle.edu:6000
1 of 2 processes started.

ias-instance id=ebs015.e015.oracle.edu
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
--------------------------------------------------------------------------------
ias-component/process-type/process-set:
default_group/oacore/default_group/

Error
--> Process (index=1,uid=311,pid=21296)
failed to start a managed process after the maximum retry limit
Log:
/oracle/ebs/inst/apps/ebs015/logs/ora/10.1.3/opmn/default_group~oacore~default_group~1.log


03/30/12-10:13:00 :: adoacorectl.sh: exiting with status 206
======================================================================

Last entry in the default_group~oacore~default_group~2.log shows:

--------
12/03/30 10:12:25 WARNING: ApplicationLogManager is not installed, may result in loader leaks. Set -Djava.util.logging.manager=oracle.classloader.util.ApplicationLogManager

opmn.log

12/03/30 10:12:46 [libopmnoc4j] Process Start Error: default_group~oacore~default_group~1 (311:21203)
12/03/30 10:12:47 [pm-process] Stopping Process: default_group~oacore~default_group~1 (311:21203)
12/03/30 10:12:47 [libopmnoc4j] Process Stop Error: default_group~oacore~default_group~1 (311:21203)
12/03/30 10:12:47 [libopmnoc4j] Failed to construct stop command for proc: 311
12/03/30 10:12:47 [libopmnoc4j] Forcefully Terminating Process: default_group~oacore~default_group~1 (311:21203)
12/03/30 10:12:49 [pm-process] Starting Process: default_group~oacore~default_group~1 (311:0)
12/03/30 10:12:55 [libopmnoc4j] Host and Port information for port type jms not sent by the OC4J process
12/03/30 10:12:55 [libopmnoc4j] WARNING: OC4J did not send the protocol value for port id: jms
12/03/30 10:12:55 [libopmnoc4j] Port information in the ONS notification is incorrect for proc: 311. Some of the reasons for the failure are:
1. ajp, rmi and jms ports could not be bound by the process.
2. If a port value for a certain port ID is handed by OPMN to the OC4J process and this value is not returned back in the ONS notifications. For example, this can happen for certain bad JGroups related configurations.
12/03/30 10:12:55 [libopmnoc4j] Process Start Error: default_group~oacore~default_group~1 (311:21296)
12/03/30 10:12:57 [pm-process] Stopping Process: default_group~oacore~default_group~1 (311:21296)
12/03/30 10:12:57 [libopmnoc4j] Process Stop Error: default_group~oacore~default_group~1 (311:21296)
12/03/30 10:12:57 [libopmnoc4j] Failed to construct stop command for proc: 311
12/03/30 10:12:57 [libopmnoc4j] Forcefully Terminating Process: default_group~oacore~default_group~1 (311:21296)
12/03/30 10:12:59 [pm-requests] Request 3 Completed. Command: /start?process-type=oacore

Changes

Unknown

Cause

Turned out to be .lock files under $INST_TOP/ora/10.1.3/j2ee/oacore/persistence/oacore_default_group_1.


Once removed the .lock file the services started.

Solution

Check for and remove the lock files from the following directories.
$INST_TOP/ora/10.1.3/j2ee/oacore/persistence
$INST_TOP/ora/10.1.3/j2ee/oafm/persistence
$INST_TOP/ora/10.1.3/j2ee/forms/persistence

Restart services.
cd $ADMIN_SCRIPTS_HOME
./adstrtall.sh apps/apps_pw or ./adoacorectl.sh

 

备注：这种方法也可能适用152,timeout(10000)