Oracle Database Appliance – /opt filling up

Last time we had the /opt filesystem on a couple of ODA nodes filling up. It turned out that the OS Watcher archive directory structure (/opt/oracle/oak/osw/archive) contained lots of old files that should have been cleaned by OSWatcher. When OSWatcher is started, it will also start a script called OSWatcherFM.sh that is responsible for cleaning up old files. It turned… Read more »

ORA-29283: invalid file operation using UTL_FILE.FREMOVE

I’ve been breaking my head over a problem I had with the UTL_FILE.FREMOVE command trying to remove a file created by another (not oracle) process. On *nix command line, logged in as user oracle (same as database) I’m able to remove the file using the “rm” command, but when using UTL_FILE.FREMOVE it comes back with ORA-29283. Sample of directory and… Read more »

ORA-600 [kkpo_rcinfo_defstg:objnotfound] on a 11.2 RAC instance

RECOMMENDATION: Set the deferred_segment_creation parameter to FALSE for 11.2 RAC databases! Recently our monitoring picked up an ORA-600 from the alertlog of one of our 11.2 RAC instances. ORA-00600: internal error code, arguments: [kkpo_rcinfo_defstg:objnotfound],[87421], [], [], [], [], [], [], [], [], [], [] Oracle Support was telling me that I was hitting bug 14252187 (Bug 14252187 – ORA-600 [qesmaGetTblSeg1]… Read more »

ORA-19809: limit exceeded for recovery files

      No Comments on ORA-19809: limit exceeded for recovery files

In our cloning procedures we use the RMAN “DUPLICATE” command for duplicating databases. This all went fine for a long time until one moment we start getting errors during the duplication process (from the point where media recovery gets started). Here is an example of the errors we received: RMAN-00571: =========================================================== RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS =============== RMAN-00571: ===========================================================… Read more »

Oracle Database Appliance – /boot filling up

      No Comments on Oracle Database Appliance – /boot filling up

After the installation of the ODA bundle patch 2.4.0.0.0, the /boot filesystem on the ODA nodes was filled up to 84% (16 MB of 99 MB was free) and so Oracle Enterprise Manager started sending warnings about the default 80% warning threshold being overridden for the /boot filesystem. Although the /boot filesystem is, while not patching or so, not growing…. Read more »

Determine versions of connected Oracle clients

Last week I was trying to find a way to determine the version of the Oracle clients that are connected/connecting to databases from these databases. We cannot connect to each application server to figure out the used version and certainly not all laptops and desktops from which some users can connect. The v$session_connect_info view contains a column named client_version so… Read more »

Cryptographic flaws in Oracle Database authentication protocol

Recently a security researcher (Esteban Martinez Fayo) made the world aware of a problem with the O5LOGON Oracle database authentication protocol (used in 11g – 11.1 & 11.2). This problem, known as CVE-2012-3137, makes it relatively simple for attackers to get hold of passwords using a brute-force attack on the encrypted (AES  -192 bit) session key that is returned by… Read more »

Grid Infra – ASM 11.2.0.3 bug on Solaris – slice 2 CANDIDATE

We recently ran into a bug (at least that how I look at it) that is introduced with ASM 11.2.0.3. As of this version, ASM shows slice 2 (the complete disk, starting a cylinder 0 thus inlcuding the VTOC) as an CANDIDATE disk in ASM. In previous versions of ASM (Grid Infra) only slices that started from cylinder 3 (or… Read more »

Oracle Database Appliance – Installing Bundle Patch 2.3.0.0.0

On 23 july 2012 ODA bundle patch 2.3.0.0.0 was released, a long awaited version which should (and indeed does) include multi-home support. As with each new bundle patch, in this version the patch process is getting more robust and the long awaited support for rolling upgrade of the Grid Infrastructure and RAC databases is implemented. Unfortunately the installation of the… Read more »