One of our EBS R12 was inaccessible and was throwing generic http-404 erorr for the login page. On the application side adopmnctl was showing status ACTIVE for all the required procesees.
Simple HTML file like http://<server_name>:<port>/OA_HTML/test.html was also not opening means it was Apache issue or Oacore issue since definition of OA_HTML in html link is given by OACORE.
Error message in the Browser was like below:
The requested URL /OA_HTML/test.html was not found on this server.
In one of the Apache server log we were able to see that it is trying to find the file under portal directory which is not the correct place
</EXEC_CONTEXT_ID> </CORRELATION_DATA> <PAYLOAD> <MSG_TEXT>File does not exist: /fs01/<SID>/inst/apps/<CONTEXT_NAME>/portal/OA_HTML/test.html</MSG_TEXT> </PAYLOAD> </MESSAGE>
We put extra debug on Apache by below method but didn’t find any issue.
Modified /fs01/<SID>/inst/apps/<CONTEXT_NAME>/ora/10.1.3/Apache/Apache/conf/httpd.conf and adding below entry OraLogMode oracle OraLogSeverity TRACE:32 OraLogDir /fs01/<SID>/inst/apps/<CONTEXT_NAME/logs/ora/10.1.3/Apache/oracle
Then we put extra debug on OACORE by below method:
Edited the j2ee-logging.xml adjust the following in file: $ORA_CONFIG_HOME/10.1.3/j2ee/oacore/config/j2ee-logging.xml <logger name='oracle' level='TRACE:32' useParentHandlers='false'>
This time it produced below error message in the oacorestd.out file under
error: error reading /fh04/<SID>/applcust/12App/xxdba/java/jar/xxdba6039_httpclient-4.3.5.jar; invalid END header (bad central directory offset) error: error reading /fh04/<SID>/applcust/12App/xxdba/java/jar/xxdba6039_httpcore-4.3.2.jar; invalid END header (bad central directory offset) 2 errors
Looks like some bad custom jar file was uploaded to server which impacted the oacore to go into silent error. Oacore was showing as started normal but internally was not working.
We renamed the files and started oacore again to correct the issue.
-rwxrwxr-x 1 oaoracle dba 590517 Dec 13 15:10 xxdba6039_httpclient-4.3.5.jar_bkp_14dec15 -rwxrwxr-x 1 oaoracle dba 282266 Dec 13 15:10 xxdba6039_httpcore-4.3.2.jar_bkp_14dec15
[Post Views: 238]
You can connect with me on LinkedIn.
Latest posts by Brijesh Gogia (see all)
- Performance Tuning Basics 16 : Using SQL Tuning Health-Check Script (SQLHC) - April 1, 2018
- Physical and Logical Block Corruption in Oracle Database - March 10, 2018
- Performance Tuning Basics 15 : AWR Report Analysis - February 6, 2018