Oracle Fusion: CommonDomain_webtier is not starting up and giving error

Oracle Fusion: CommonDomain_webtier is not starting up and giving error

Issue

The Fusion Applications Oracle HTTP Server for Common Domain (CommonDomain_webtier) is not starting up and giving error.

$ /app/APPLTOP/instance/CommonDomain_webtier/bin/opmnctl startall
opmnctl startall: starting opmn and all managed processes...
================================================================================
opmn id=fa87.aclnz.com:7043
Response: 0 of 1 processes started.

ias-instance id=CommonDomain_webtier
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
--------------------------------------------------------------------------------
ias-component/process-type/process-set:
ohs1/OHS/OHS/

Error
--> Process (index=1,uid=978846797,pid=14844)
failed to start a managed process after the maximum retry limit
Log:
/app/APPLTOP/instance/CommonDomain_webtier/diagnostics/logs/OHS/ohs1/console~OHS~1.log

Investigation Done

Check out the details of error:

$ vi /app/APPLTOP/instance/CommonDomain_webtier/diagnostics/logs/OHS/ohs1/ohs1.log

[2015-04-05T15:03:31.1435+12:00] [OHS] [INCIDENT_ERROR:32] [OHS-9999] [core.c] [host_id: fa87.aclnz.com] [host_addr: 192.168.1.87] [pid: 14844] [tid: 140174359107376] [user: fusion] [VirtualHost: main] (98)Address already in use: make_sock: could not bind to address 192.168.1.87:10621

[2015-04-05T15:03:31.1435+12:00] [OHS] [INCIDENT_ERROR:20] [OHS-9999] [core.c] [host_id: fa87.aclnz.com] [host_addr: 192.168.1.87] [pid: 14844] [tid: 140174359107376] [user: fusion] [VirtualHost: main] no listening sockets available, shutting down

[2015-04-05T15:03:31.1436+12:00] [OHS] [ERROR:32] [OHS-9999] [core.c] [host_id: fa87.aclnz.com] [host_addr: 192.168.1.87] [pid: 14844] [tid: 140174359107376] [user: fusion] [VirtualHost: main] Unable to open logs

As it can be seen the port 10621 is already in use and hence the error

Resolution

A quick fix is to simply free up the port and retry starting OHS.

Step 1. Find the process which is using port 10621
lsof -i :10621

Step 2. Say Process ID (PID) 10467 is using port 10621. Run the following command to find out more about PID 10467:
ls -l /proc/10467/ exe

Step 3. To free up port 10621, simply kill the process that is using it.
kill 10467

Step 4. Now simply try to restart the ompn and it will start successfully without any errors
/app/APPLTOP/instance/CommonDomain_webtier/bin/opmnctl startallb2ap3_thumbnail_4_20150405-033743_1.pngEnvironment+ Oracle Linux x86-64+ Oracle Fusion Applications 11.1.7

Linux: How to find out files updated in last N min...
Fusion Apps IDM - OID and ODSM Server EMAGENT givi...