In an earlier post I noted that Berkeley DB Java Edition cleaner performance had improved significantly in release 5.x. From an Oracle NoSQL Database point of view, this is important because Berkeley DB Java Edition is the core storage engine for Oracle NoSQL Database.
Many contemporary NoSQL Databases utilize log based (i.e. append-only) storage systems and it is well-understood that these architectures also require a "cleaning" or "compaction" mechanism (effectively a garbage collector) to free up unused space. 10 years ago when we set out to write a new Berkeley DB storage architecture for the BDB Java Edition ("JE") we knew that the corresponding compaction mechanism would take years to perfect. "Cleaning", or GC, is a hard problem to solve and it has taken all of those years of experience, bug fixes, tuning exercises, user deployment, and user feedback to bring it to the mature point it is at today. Reports like Vinoth Chandar's where he observes a 20x improvement validate the maturity of JE's cleaner.
Cleaner performance has a direct impact on predictability and throughput in Oracle NoSQL Database. A cleaner that is too aggressive will consume too many resources and negatively affect system throughput. A cleaner that is not aggressive enough will allow the disk storage to become inefficient over time. It has to
- Work well out of the box, and
- Needs to be configurable so that customers can tune it for their specific workloads and requirements.
The JE Cleaner has been field tested in production for many years managing instances with hundreds of GBs to TBs of data. The maturity of the cleaner and the entire underlying JE storage system is one of the key advantages that Oracle NoSQL Database brings to the table -- we haven't had to reinvent the wheel.
Berkeley DB Java Edition 5.x has significant performance improvements. One user noted that they are seeing a 20x improvement in cleaner performance.
Snip from a very Nice Slide Deck from a Presentation by the E-Business Suite Team.
See the entire presentation here
Yesterday I gave a presentation ”Best of Oracle Security 2012” at the DOAG 2012 conference in Nürnberg.
Oracle platform products and architecture have progressed at a rapid pace to meet the demanding needs of SaaS application deployment. We recently (Nov 2012) recorded a webcast on latest capabilites in Oracle Cloud Application Foundation and how we using it as a platform under our own SaaS applications while also offering it as PaaS.
I just uploaded my talk Hashdays 2012 ”Self-Defending Databases” to the Red-Database-Security website. The talk explains how to detect SQL Injection attacks in databases (Oracle/MSSQL/MySQL) and how to react in case of a SQL Injection (e.g. done with Pangolin, Havij or Netsparker).
In 2011, I joined many others in the Movember event for the first time. This is a fund-raising effort where participants grow a mustache for the month of November and collect donations to support men’s health, specifically prostate and testicular cancers. Individuals can participate on their own or as a team, but no matter what you donate, it all goes to the same place. In my first year, I managed to collect $754 from 15 donors! Hopefully, I’ll exceed my previous year’s fundraising this year…just not sure what mustache style will bring in the most money yet?!
To see photo updates of how my ‘stache is coming along and to make donations, go to my page on Movember. Thanks for any donation you can make!