StackOverflow2013

Note that there are some explanatory texts on larger screens.

plurals

PO
text
Body
copied!<p>The information is scattered all over the web, but here's what I found out:</p> <p><strong>Introduction to database benchmarking</strong></p> <p>The first thing that you need to do is figure out a standard benchmark to use for comparing your in-memory database choices. A wiki page on Oracle gives an <a href="http://wiki.oracle.com/page/Database+Benchmarking" rel="noreferrer">overview of the industry standard database benchmarks</a>. If you can find results for the same industry standard benchmarks for TimesTen and MySql Cluster, you'll be able to compare the two. Finding a detailed comparison of all the in-memory databases is quite rare.</p> <p><em>Summary:</em> Since you mentioned OLTP, the industry standard benchmark that you're probably interested in is TPC-E which simulates the OLTP workload of a brokerage firm. Other industry standard benchmarks measure decision support and e-commerce database transactions.</p> <p><strong>Open source database benchmark kits</strong></p> <p>The <a href="http://sourceforge.net/projects/osdldbt/" rel="noreferrer">Open Source Development Labs Database Test Suite</a> is the most comprehensive open source implementation of those industry standard benchmarks I mentioned earlier. They have four main suite of tests numbered DBT1, DBT2, DBT3, DBT4. They haven't implemented the TPC-E benchmark, but the Database Test 2 (DBT2) is what you are looking for since it simulates OLTP transactions. Everyone simply refers to running the DBT2 benchmark instead of spelling it out as OSDLB DBT2.</p> <p><strong>Results</strong></p> <p><strong>MySql</strong></p> <p><a href="http://www.mysql.com/products/database/cluster/" rel="noreferrer">MySql Cluster Website</a></p> <p><a href="http://www.mysql.com/why-mysql/benchmarks/mysql-cluster/" rel="noreferrer">MySql published benchmarks</a></p> <p>You'll need to register to get the white paper emailed to you, but here is the summary that I took from their site:</p> <blockquote> <p>Ultimately, MySQL Cluster was able to reach 100,000 transactions per minute in an 8-node configuration. This showed impressive scaling improvements when compared to a 2-node cluster which was able to obtain 26,000 transactions per minute. These performance improvements were realized through the use of new Multi Core Intel Xeon servers based on the Intel Core T micro architecture.</p> </blockquote> <p><strong>Oracle</strong></p> <p><a href="http://www.oracle.com/technology/products/timesten/index.html" rel="noreferrer">Oracle TimesTen Website</a></p> <p>Unfortunately the DBT2 does not support TimesTen. However I found a whitepaper that gives <a href="http://www.soliddata.com/pdf/TimesTen.pdf" rel="noreferrer">detailed benchmarking information for TimesTen</a> in an OLTP workload.</p> <p><strong>IBM</strong></p> <p><a href="http://www-01.ibm.com/software/data/soliddb/" rel="noreferrer">IBM SolidDB Website</a></p> <p><strong>Other Resources</strong></p> <ol> <li><a href="http://www.dbms2.com/category/memory-centric-data-management/in-memory-dbms/" rel="noreferrer">In Memory DBMS section</a> of a blog that focuses on databases.</li> <li><a href="http://www.tpc.org/" rel="noreferrer">Transaction Processing Performance Council website</a> - You can search their database for benchmarks from various hardware vendors using various DBMSes. I was unable to find any in memory DBMS benchmarks however.</li> </ol>

Querying!

Guidance

An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload