Issue

Getting the following error while starting Oracle HTTP Server (OHS)

/app/APPLTOP/instance/CommonDomain_webtier/bin/opmnctl startall
opmnctl startall: starting opmn and all managed processes...
================================================================================
opmn id=fa87.aclnz.com:7043
Response: 0 of 1 processes started.

ias-instance id=CommonDomain_webtier
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
--------------------------------------------------------------------------------
ias-component/process-type/process-set:
ohs1/OHS/OHS/

Error
--> Process (index=1,uid=978846808,pid=8356)
failed to start a managed process after the maximum retry limit
Log:
/app/APPLTOP/instance/CommonDomain_webtier/diagnostics/logs/OHS/ohs1/console~OHS~1.log

Investigation done

1. Opened log from the following directory:

vi /app/APPLTOP/instance/CommonDomain_webtier/diagnostics/logs/OHS/ohs1/ohs1.log

2. Found following log entries:

[2018-07-22T03:45:53.8235+12:00] [OHS] [INCIDENT_ERROR:32] [OHS-9999] [core.c] [host_id: fa87.aclnz.com] [host_addr: 192.168.1.87] [pid: 8248] [tid: 140663531390768] [user: fusion] [VirtualHost: main] (98)Address already in use: make_sock: could not bind to address 192.168.1.87:10615

[2018-07-22T03:45:53.8235+12:00] [OHS] [INCIDENT_ERROR:20] [OHS-9999] [core.c] [host_id: fa87.aclnz.com] [host_addr: 192.168.1.87] [pid: 8248] [tid: 140663531390768] [user: fusion] [VirtualHost: main] no listening sockets available, shutting down

3. As it can be seen port 10615 is already in use. This is the root cause of the error.

Resolution

1. Check which process is currently running on port 10615 using the following command:

fuser 10615/tcp

Output

10615/tcp: 29997

2. Now find more details process with PID 29997

ls -l /proc/29997/exe

Output

lrwxrwxrwx 1 fusion dba 0 Jul 22 03:01 /proc/29997/exe -> /app/APPLTOP/fusionapps/jdk6/bin/java

3. Kill the PID running on port 10615

kill 29997

4. Now retry running the command to start OHS:

[fusion@fa87 ~]$ /app/APPLTOP/instance/CommonDomain_webtier/bin/opmnctl startall

​Output
opmnctl startall: starting opmn and all managed processes...

5. Check the status of the OHS process:

/app/APPLTOP/instance/CommonDomain_webtier/bin/opmnctl status

Output
Processes in Instance: CommonDomain_webtier
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
ohs1 | OHS | 11398 | Alive

Environment

+ Oracle Fusion Applications 11g

+ Oracle Linux x86-64