benchfilesort

BenchFileSort

BenchFileSort is a command line tool to test the performance of util/filesort.

Quick Start (Examples)

Step 1 - Generate the synthetic data

./benchfilesort gen -keySize 8 -valSize 16 -scale 1000

Expected output:

Generating...
Done!
Data placed in: /path/to/data.out
Time used: xxxx ms
=================================

Step 2 - Load the data and run the benchmark

./benchfilesort run -bufSize 50 -nWorkers 1 -inputRatio 100 -outputRatio 50

Expected output:

Loading...
	number of rows = 1000, key size = 8, value size = 16
	load 1000 rows
Done!
Loaded 1000 rows
Time used: xxxx ms
=================================
Inputing...
Done!
Input 1000 rows
Time used: xxxx s
=================================
Outputing...
Done!
Output 500 rows
Time used: xxxx ms
=================================
Closing...
Done!
Time used: xxxx ms
=================================

For performance tuning purpose, Input time and Output time are two KPIs you should focus on. Close time reflects the GC performance, which might be noteworthy sometimes.

Commands and Arguments

gen command

The gen command generate the synthetic data for the benchmark.

You can specify how many rows you want to generate, the key size and value size for each row.

The generated data is located in $dir/data.out ($dir is specified by the dir argument).

The gen command supports the following arguments:

• dir (default: current working directory) Specify the home directory of generated data

• keySize (default: 8) Specify the key size for generated rows

• valSize (default: 8) Specify the value size for generated rows

• scale (default: 100) Specify how many rows to generate

• cpuprofile (default: "") Turn on the CPU profile

run command

The run command load the synthetic data and run the benchmark.

You can specify the home directory of the synthetic data.

The benchmark will use predefined amount of memory, which is controlled by the bufSize argument, to run the test.

You can control how many rows to input into and output from, which are defined by the inputRatio and outputRatio arguments.

The run command supports the following arguments:

• dir (default: current working directory) Specify the home directory of synthetic data

• bufSize (default: 500000) Specify the amount of memory used by the benchmark

• nWorkers (default: 1) Specify the number of workers used in async sorting

• inputRatio (default: 100) Specify the percentage of rows to input:

  # of rows to input = # of total rows * inputRatio / 100

• outputRatio (default: 100) Specify the percentage of rows to output:

  # of rows to output = # of rows to input * outputRatio / 100

• cpuprofile (default: "") Turn on the CPU profile