Example: TPC-H
This example shows how to benchmark 22 reading queries Q1-Q22 derived from TPC-H in MySQL
The query file is derived from the TPC-H and as such is not comparable to published TPC-H results, as the query file results do not comply with the TPC-H Specification.
Official TPC-H benchmark - http://www.tpc.org/tpch
Content:
Prerequisites
Perform Benchmark
Evaluate Results in Dashboard
Where to go
Prerequisites
We need
a local instance of MySQL
having a database
database
containing the TPC-H data of SF=1access rights for user / password:
username/password
a suitable MySQL JDBC driver jar file
JDK 8 installed
If necessary, adjust the settings in the file example/connections.py
:
[
{
'name': "MySQL",
'alias': "Some DBMS",
'version': "CE 8.0.13",
'docker': 'MySQL',
'docker_alias': "DBMS A",
'dialect': "MySQL",
'hostsystem': {'node': 'localhost'},
'info': "This is an example: MySQL on localhost",
'active': True,
'JDBC': {
'driver': "com.mysql.cj.jdbc.Driver",
'url': "jdbc:mysql://localhost:3306/database",
'auth': ["username", "password"],
'jar': "mysql-connector-java-8.0.13.jar"
},
},
]
Perform Benchmark
Run the command:
python benchmark.py run -e yes -b -f example/tpch
-e yes
: This will precompile some evaluations and generate the timer cube.-b
: This will suppress some output-f
: This points to a folder having the configuration files.
For more options, see the documentation
After benchmarking has been finished will see a message like
Experiment <code> has been finished
The script has created a result folder in the current directory containing the results. <code>
is the name of the folder.
Evaluate Results in Dashboard
Run the command:
python dashboard.py
This will start the evaluation dashboard at localhost:8050
.
Visit the address in a browser and select the experiment <code>
.
Where to go
Use different DBMS
Add metadata
SF
Use Bexhoma: https://github.com/Beuth-Erdelt/Benchmark-Experiment-Host-Manager