TPC-C workload
TPC-C (spec §§2–3) with deterministic plain-Go population data and the standard
45/43/4/4/4 New-Order, Payment, Order-Status, Delivery, and Stock-Level mix.
Eight tables are loaded through Bench.Insert; history starts empty and is
populated by transactions.
Variants
tpcc/tx runs ordered DML in driver transactions on PostgreSQL, MySQL, and
YDB, and as a non-transactional approximation on Picodata 26.2 or newer.
tpcc/procs calls server-side procedures and supports PostgreSQL and MySQL.
Run it
./build/stroppy run tpcc/tx -d pg \
-D url=postgres://postgres:postgres@localhost:5432/stroppy
./build/stroppy run tpcc/tx -d mysql \
-D 'url=root:pass@tcp(127.0.0.1:3306)/stroppy'
./build/stroppy run tpcc/tx -d pico
./build/stroppy run tpcc/tx -d ydb -D url=grpc://localhost:2136/local
./build/stroppy run tpcc/procs -d pg
Typed workload parameters are listed by stroppy run tpcc/tx --help and
stroppy run tpcc/procs --help:
--scale-factor sets the warehouse count.
--spread-warehouses chooses a home warehouse uniformly for each transaction
instead of pinning each VU to one warehouse. The choice stays fixed across
retries; this stress mode is not fixed-terminal TPC-C.
--warehouse-start sets the first warehouse ID for a distributed slice.
--load-items controls loading the shared 100,000-row item table; it defaults
to true only when warehouse-start is 1.
--load-workers sets the workers used to load each table.
--pacing applies the TPC-C keying and think times.
--warmup adds traffic before the measured workload step (default 0s,
constant-vus only); --duration remains the measured workload duration.
--retry-attempts sets the maximum transaction attempts.
--pg-unlogged uses PostgreSQL unlogged tables during the load.
--tx-isolation overrides the driver-specific isolation default.
--sql-file overrides the dialect SQL file.
Picodata approximation
Picodata execution uses isolation none, not a transaction spanning the
operation's statements. It is a stress workload, not compliant TPC-C, and logs
this limitation when execution starts. Picodata 26.2 or newer is required for
the single-bucket atomic block that reads and increments the district's next
order ID in one request; concurrent clients cannot reserve the same ID.
The rest of each operation remains non-transactional. A later failure can leave
partial writes and unused order IDs; stock read/update sequences and other
multi-statement operations are not isolated. The expected invalid-item rollback
is disabled. Duplicate-key errors are terminal for the iteration, not a reason
to retry partially applied writes. Reusing an inconsistent dataset is not
repaired by atomic ID reservation.
Distributed warehouse ranges
Several processes can load disjoint warehouse ranges into one database:
# Creates the schema and loads warehouses 1..100 plus the shared item table.
./build/stroppy run tpcc/tx -d pg -D url=postgres://host/db \
--warehouse-start 1 --scale-factor 100 \
--steps drop_schema,create_schema,load_data,validate_population
# Loads warehouses 101..200 and leaves the shared item table alone.
./build/stroppy run tpcc/tx -d pg -D url=postgres://host/db \
--warehouse-start 101 --scale-factor 100 \
--steps load_data,validate_population
By default, each virtual user is pinned to a home warehouse within its configured
slice. With --spread-warehouses, every transaction chooses a home warehouse from
the full slice, so a small VU count can exercise a large warehouse range. Remote
warehouse choices stay inside that slice and exclude the current home warehouse. On YDB, run
create_schema once with the total warehouse range so generated partition keys
cover every loader. Population validation is restricted to the configured
slice.
Setup and execution
Setup runs these gatable steps in order:
drop_schema
create_schema, including Go-rendered YDB partition keys
create_procedures for tpcc/procs only
set_unlogged when requested on PostgreSQL
load_data, using typed driver.InsertRequest values backed by
gen.IndexedSource batches for warehouse, district, customer, item,
stock, orders, order_line, and new_order
create_indexes
set_logged when unlogged loading was enabled
create_foreign_keys
analyze
validate_population
Each workload iteration selects one transaction according to the standard
mix. The tx variant executes its ordered statements within a driver
transaction; the procs variant performs one procedure call. Both variants
share retry policy, pacing, transaction metrics, and the final compliance
report.
ydb.sql uses pre-split tablets and post-load indexes. To compare its load path
with the single-tablet ydb_no_indexes.sql schema:
stroppy run tpcc/tx tpcc/ydb_no_indexes -d ydb -D url=grpc://host:2136/db \
--scale-factor 50 --load-workers 8 \
--steps drop_schema,create_schema,load_data
stroppy run tpcc/tx tpcc/ydb -d ydb -D url=grpc://host:2136/db \
--scale-factor 50 --load-workers 8 \
--steps drop_schema,create_schema,load_data,create_indexes
Run shapes and two-pass runs
./build/stroppy run tpcc/tx --executor shared-iterations --vus 4 --iterations 100
./build/stroppy run tpcc/tx --executor constant-vus --vus 64 --duration 1h
# Load first, then measure the existing data.
./build/stroppy run tpcc/tx --scale-factor 10 --no-steps workload
./build/stroppy run tpcc/tx --executor constant-vus --vus 64 --duration 1h \
--steps workload
A normal run with no step filter performs setup and measurement together.
Warmup, pacing, and measurements
# Reuse loaded data, warm up for five minutes, then measure for thirty minutes.
./build/stroppy run tpcc/procs -d pg -D url=postgres://host/db \
--executor constant-vus --vus 10000 --pacing=true \
--warmup 5m --duration 30m --steps warmup,workload
Warmup uses the same transaction mix, worker RNG state, and history ID counter
as measurement. Both phases export the existing metric names, distinguished by
step=warmup and step=workload. The TPC-C report selects only workload
histograms and its measurement window. Duration histograms also carry
phase=warmup|measurement|drain and outcome=success|error|canceled, based on
operation completion. TPC-C throughput counts successful completions during
measurement; drain completions and cancellations are reported separately.
Latency and transaction mix include failed measured operations. Generic
summaries retain both phases and drain; filter exported series by step and
phase when comparing measured traffic. Step filters
apply normally: --steps workload excludes warmup even when --warmup is set.
Each phase uses the configured drain policy, so elapsed time can exceed
warmup plus duration. Workers activate immediately at each phase boundary;
warmup alone does not guarantee steady state.
Keying waits precede database work. Think time follows each successful or
nonfatal failed logical transaction, once after all retries. Fatal errors and
cancellation stop immediately. Both waits observe cancellation; canceling
post-transaction thinking does not turn an already successful transaction into
a failure. Native success counters update before thinking, while native TPS
still uses the executor wall-clock window, including drain.
Latency measures have different scopes:
tpcc_<transaction>_duration: logical database operation, including pool
acquisition, retries, and failed outcomes; excludes keying and thinking.
tx_total_duration: one database transaction attempt, not the full retry loop.
iteration_duration: entire iteration, including keying, retries, and thinking.
At the first traffic iteration, history IDs start above the table's current
maximum and are unique across workers and phases. Sequential runs can reuse a
dataset without truncating history. Concurrent independent transaction
processes must not share that history ID space: maximum-based initialization
does not reserve ranges across processes. Distributed loading of disjoint
warehouse ranges remains supported.
Pacing is a TPC-C-style stress profile, not an audited TPC-C result. Strict
terminal/district and deferred Delivery semantics are tracked in
#193; reusable gradual worker
activation is tracked in #194.
Environment variables and -e remain compatibility inputs; direct flags and
typed config are preferred.
Integration test
make tmpfs-up
make build
go test -tags=integration -count=1 -run TestTpccWorkloadEndToEnd ./test/integration
make tmpfs-down
CockroachDB SQL
Use -d crdb for CockroachDB; it selects the built-in crdb.sql.
For CockroachDB 24.1, add --sql-dialect crdb24; its procedures use
WHILE loops supported by that version. --sql-dialect selects a built-in
TPC-C asset without consulting local files. --sql-file remains an explicit
filesystem path; the two selectors cannot be combined.
Both variants retain the expected TPC-C rollback and use Cockroach-compatible
decimal arithmetic and statistics.
The cloud compiler selects the variant from the catalog database version.
These SQL variants ignore --pg-unlogged: loading keeps CockroachDB's normal
durability and does not issue PostgreSQL-only SET UNLOGGED/SET LOGGED commands.