Re: Oracle Benchmark Results for Different Hardware Configurations?

From: Serge Rielau <srielau_at_ca.ibm.com>
Date: Fri, 15 Sep 2006 15:29:14 -0400
Message-ID: <4n0d8fF85mqfU1@individual.net>

DA Morgan wrote:
> Serge Rielau wrote:

>> Further, car manufacturers certainly tune there vehicles to get the 
>> safety rating they aspire to rather than decreasing the de-facto 
>> injury rates (which would be the real application).

>
> But it is also what they sell. No RDBMS vendor can claim that what I
> buy from their salesperson is exactly what was tested. A claim that
> sleazy car salesman can make with a straight face.
If you have names and reasonable evidence of RDBMS vendors that to not sell what they submitted for test in TPC I encourage you to let TPC know because it violates the benchmarking rules. I will gladly pass you the name of one of the auditors as a direct contact offline.

I know for fact that "NO RDBMS Vendor" is not a correct statement. It is pretty obvious that software undergoes patches, but so do cars. I'm pretty sure Ford doesn't resubmit their cars for testing after each recall.

Note that the TPC rules require full disclosure, so a competitor or customer can reproduce the results. Certainly not realistic for the 10TB TPC-H or 4.2M tpmC TPC-C results, but if cheating is widespread that should easily show on the low-end. Quite often the small benchmarks are made with off-the shelf software installs.

Cheers
Serge

-- 
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ondemandbusiness/conf2006/

Received on Fri Sep 15 2006 - 14:29:14 CDT