Wednesday, June 24, 2015

ORA-01102 cannot mount database in EXCLUSIVE mode

Users might receive error “ORA-01102” when trying to startup

01102, 00000, "cannot mount database in EXCLUSIVE mode"
// *Cause: Some other instance has the database mounted exclusive or shared.
// *Action: Shutdown other instance or mount in a compatible mode.


You will receive this error when instance is already opening in parallel. You can resolve this issue by shutting down all the instances before mounting the database.

Verify that no background processes running owner as oracle
Ps –ef |grep <$ORACLE_SID>

If you found any processes then shutdown the instance, if you are not able to shutdown then you can kill by using “kill -9 <processed>.

Now you should be able to startup without any issues.

Regards
Satishbabu Gunukula, Oracle ACE

Monday, May 18, 2015

Oracle Optimized Data Center Reference Architecture


IT departments are under constant pressure to increase their ability to respond rapidly to rapidly changing business requirements and select best technology while reducing cost and risk

This results in complexity and integration challenges.These effects add up to drive agility, cost, and risk in the wrong directions. While it is clear that cloud computing offers many potential benefits

Oracle’s optimized data center is a pragmatic solution to these problems. By providing a fully integrated stack, “from Applications to Disk”, the data center is greatly simplified while integration is already built- in. This paves the way for reduced cost and risk.

The key drivers for the optimized data center can be summarized as follows
  • Cost management: Virtualization/consolidation, simplification
  • Business gro wth: Removing barriers to infrastructure performance and flexibility
  • Service continuity: Maximum availability architecture, disaster recovery planning
  • Security and conformity: Comprehensive, end-to-end security and compliance approach
This paper published by Oracle Corporation and it will show in architectural terms how reduced risk reduced cost , and increased agility can be achieved through consistent integration and reduced complexity.

You can download the White paper "Oracle Optimized Data Center Reference Architecture"

Regards
Satishbabu Gunukula
http://www.oracleracexpert.com


http://www.oracle.com/technetwork/topics/entarch/oracle-wp-optmizd-dc-ref-arch-1918519.pdf

Wednesday, May 13, 2015

error while loading shared libraries: libSQLDBCHDB.so

While installing SAP HANA Database system I have received following error.

Do you want to create a customer incident? You can now:
Choose OK to create the support SAPCAR archive SUPPORT.SAR
Choose Stop to stop the task and continue later

We don't know what causing the issue and need to find the error from log file.

I found below error in log file "R3load.exe.log" under "/install/tmp/sapinst_instdir/BS2013SR2/ERP607SR2/HDB/INSTALL/DISTRIBUTED/ABAP/DB"
usr/sap/BWE/SYS/exe/uc/linuxx86_64/R3load: error while loading shared libraries: libSQLDBCHDB.so: cannot open shared object file: No such file or directory

By looking the error it looks like shared libraries libSQLDBCHDB is missing. This library is related to hana client and installation will use the client to connect to the database.

I want to make sure that library exists or not and ran find command. I was able to find the library

find . -name libSQLDBCHDB.so -print
./HANA/hdbclient/libSQLDBCHDB.so


That means library exists but not able to use this connect to HANA database. It looks like the issue is with Environment variable

When you come across this issue with HANA Client, make sure to check following
1. LD_LIBRARY_PATH is set properly
2. SAPSYSTEMNAME & DBMS_TYPE is set

In my case LD_LIBRARY_PATH library path does not have "hdbclcient" path, after updating correct path I was able to install successfully.

LD_LIBRARY_PATH=/usr/sap/HANA/SYS/exe/run:/usr/sap/HANA/SYS/exe/uc/linuxx86_64:/usr/sap/HANA/hdbclient

Note: You might receive this error during the maintenance also

Regards,
Satishbabu Gunukula
http://www.oracleracexpert.com

Thursday, May 7, 2015

Terminating the instance due to error 16038 and unable to startup

I have encountered storage crash on one of the Database system. After storage is back online, not able to bring up the database. The database comes to mount stage and terminating the instance.

We are receiving below error.

ORA-03113: end-of-file on communication channel
Process ID: 5038
Session ID: 202 Serial number: 3


When I look into the alert.log I found below error messages

ARC2: Archival started
ARC1: Becoming the 'no FAL' ARCH
ARC2: Becoming the heartbeat ARCH
ARC3: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
Tue Mar 10 10:24:10 2015
Incomplete read from log member '/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'. Trying next member.
ARCH: All Archive destinations made inactive due to error 333
ARCH: Closing local archive destination LOG_ARCHIVE_DEST_1: '/oracle/ORAC/archiveORAC_ARCH_347548987.dbf' (error 333) (ORAC)
Committing creation of archivelog '/oracle/ORAC/archive/1_3541_854889367.dbf' (error 333)
Errors in file /oracle/diag/rdbms/orac/ORAC/trace/ORAC_ora_23498.trc:
ORA-16038: log 1 sequence# 3541 cannot be archived
ORA-00333: redo log read error block count
ORA-00312: online log 1 thread 1: '/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'

USER (ospid: 23498): terminating the instance due to error 16038
Tue Mar 10 10:24:12 2015
System state dump requested by (instance=1, osid=23498), summary=[abnormal instance termination].
System State dumped to trace file /oracle/diag/rdbms/orac/ORAC/trace/ORAC_diag_23470.trc
Dumping diagnostic data in directory=[cdmp_20150310102412], requested by (instance=1, osid=23498), summary=[abnomal instance termination].
Instance terminated by USER, pid = 23498


By looking the error, I can see that one of the online redo is corrupted. Archive process cannot able to archive to disk. In order to bring up the database you need to clear the corrupted redo log.

From ALERT.LOG file, I am able to identify that group 1 redo log 1 corrupted. By using below command I have cleared the unarchived log file

SQL> alter database clear unarchived logfile ‘/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'

If you find all multiplexed redo members are corrupted then you need to run below command to clear the GROUP.

SQL> alter database clear unarchived logfile group 1;

Now I am able to bring up the database. But note that you cannot able to bring the database back beyond corrupted point using old backups. Now you must take one FULL database backup.

Regards
Satishbabu Gunukula, Oracle ACE
http://www.oracleracexpert.com
http://www.sqlserver-expert.com

ORA-16038: log 1 sequence# 3541 cannot be archived

I have encountered storage crash on one of the Database system. After storage is back online, not able to bring up the database. The database comes to mount stage, but going down.

We are receiving below error.

ORA-03113: end-of-file on communication channel
Process ID: 5038
Session ID: 202 Serial number: 3


When I look into the alert.log I found below error messages

ARC2: Archival started
ARC1: Becoming the 'no FAL' ARCH
ARC2: Becoming the heartbeat ARCH
ARC3: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
Tue Mar 10 10:24:10 2015
Incomplete read from log member '/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'. Trying next member.
ARCH: All Archive destinations made inactive due to error 333
ARCH: Closing local archive destination LOG_ARCHIVE_DEST_1: '/oracle/ORAC/archiveORAC_ARCH_347548987.dbf' (error 333) (ORAC)
Committing creation of archivelog '/oracle/ORAC/archive/1_3541_854889367.dbf' (error 333)
Errors in file /oracle/diag/rdbms/orac/ORAC/trace/ORAC_ora_23498.trc:
ORA-16038: log 1 sequence# 3541 cannot be archived
ORA-00333: redo log read error block count
ORA-00312: online log 1 thread 1: '/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'

USER (ospid: 23498): terminating the instance due to error 16038
Tue Mar 10 10:24:12 2015
System state dump requested by (instance=1, osid=23498), summary=[abnormal instance termination].
System State dumped to trace file /oracle/diag/rdbms/orac/ORAC/trace/ORAC_diag_23470.trc
Dumping diagnostic data in directory=[cdmp_20150310102412], requested by (instance=1, osid=23498), summary=[abnomal instance termination].
Instance terminated by USER, pid = 23498


By looking the error, I can see that one of the online redo is corrupted. Archive process cannot able to archive to disk. In order to bring up the database you need to clear the corrupted redo log.

From ALERT.LOG file, I am able to identify that group 1 redo log 1 corrupted. By using below command I have cleared the unarchived log file

SQL> alter database clear unarchived logfile ‘/oracle/ORAC/datafile/ORAC/onlinelog/ORAC_Redo1_.log'

If you find all multiplexed redo members are corrupted then you need to run below command to clear the GROUP.

SQL> alter database clear unarchived logfile group 1;

Now I am able to bring up the database. But note that you cannot able to bring the database back beyond corrupted point using old backups. Now you must take one FULL database backup.

Regards
Satishbabu Gunukula, Oracle ACE
http://www.oracleracexpert.com
http://www.sqlserver-expert.com