Benchmark

non-incremental/QF_ABV/stp/testcase14.stp.smt2 

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html
Benchmark
Size20650128
Compressed Size227254
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20650120
Compressed Size227241
Max. Term Depth1943
Asserts 1
Declared Functions0
Declared Constants33799
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true161 false1 ite2736 not1398
and1 =19205 let1932 extract2891
bvnot8 bvand87 bvor26 bvxor8
bvadd1929 bvmul1 bvsub632 bvult20
bvule90 bvslt130 bvsle6 bvshl104
bvlshr22 select2136 store11479

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 166.40000 —
Z3 Z3 0.1 sat ✅ 9.30000 —
Z3 0.1 (fixed BV) sat ✅ 9.40000 —
SMT-COMP 2008 Boolector Boolector sat ✅ 1.30000 —
CVC3 CVC3-1.5 sat ✅ 1028.00000 —
Z3 Z3 0.1 sat ✅ 9.30000 —
Z3.2 sat ✅ 4.70000 —
SMT-COMP 2009 Boolector Boolector sat ✅ 1.20000 —
Boolector 1.2 sat ✅ 1.60000 —
CVC3 CVC3 2.0 sat ✅ 74.30000 —
MathSAT MathSAT 4.3 sat ✅ 65.40000 —
Yices2 Yices 2 proto sat ✅ 1.10000 —
SMT-COMP 2012 Boolector Boolector sat ✅ 1.60000 —
Boolector 1.5.23-833 sat ✅ 1.60000 —
CVC3 CVC3 v2.4.2 sat ✅ 65.20000 —
CVC4 1.0rc.3931 unknown ❌ 26.10000 —
CVC4 1.0rc.3970 unknown ❌ 26.20000 —
SONOLAR SONOLAR sat ✅ 4.60000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar sat ✅ 3.00000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.74051 —
Boolector-SMT-COMP-2011 default sat ✅ 0.99193 —
Boolector-SMT-COMP-2012 default sat ✅ 0.90318 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 23.54590 —
CVC3-SMT-COMP-2011 default sat ✅ 21.32520 —
CVC3-SMT-COMP-2012 default sat ✅ 20.20540 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 7.88018 —
CVC4-SMT-EVAL-2013 default sat ✅ 6.17833 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 11.17420 —
MathSAT5-SMT-COMP-2011 default sat ✅ 30.65620 —
MathSAT5-SMT-COMP-2012 default sat ✅ 18.82290 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.83503 —
SONOLAR-SMT-COMP-2011 default sat ✅ 217.99900 —
SONOLAR-SMT-COMP-2012 default sat ✅ 1.96791 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 1.54746 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 11.70460 —
Z3-SMT-COMP-2011 default sat ✅ 10.27730 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 2.40606 2.39464
Boolector boolectorj sat ✅ 2.38399 2.38264
CVC4 CVC4 f7118b2 default sat ✅ 9.22749 9.22460
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 1.93216 1.92071
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 2.43650 2.42663
MathSAT MathSAT-5.2.12-Main default sat ✅ 11.44430 11.44730
SONOLAR sonolar_smtcomp-2014 default sat ✅ 2.12853 2.11368
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.60225 0.60091
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 11.88080 11.87320
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 2.04902 2.04869
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 8.10543 8.10677
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 8.09254 8.09277
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 10.46710 10.47040
Yices2 Yices default sat ✅ 0.59153 0.59091
Z3 z3 4.4.0 default sat ✅ 11.56430 11.56920
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 2.31822 2.31945
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 8.63082 8.63613
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 9.99438 10.00110
Yices2 Yices-2.4.2 default sat ✅ 0.59547 0.59579
Z3 z3-4.4.1 default sat ✅ 9.30781 9.31488
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 1.97922 1.97799
CVC4 CVC4-smtcomp2017-main default sat ✅ 8.98512 8.98231
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 10.07320 10.07410
Yices2 Yices2-Main default sat ✅ 0.58929 0.58880
Z3 z3-4.5.0 default sat ✅ 9.50360 9.49923
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 1.95360 1.95321
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.68577 8.68596
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 9.94743 9.94772
Yices2 Yices 2.6.0_default sat ✅ 0.70442 0.70426
Z3 z3-4.7.1_default sat ✅ 12.62010 12.61840
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.60793 1.60788
Boolector Boolector-wrapped-sq_default sat ✅ 1.66841 1.66819
CVC4 CVC4-sq-final_default sat ✅ 14.24570 14.24530
MathSAT MathSAT5_default.sh sat ✅ 22.17440 22.17400
Par4 Par4-wrapped-sq_default sat ✅ 0.62658 0.00907
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.55638 0.55626
Z3 z3-4.8.8_default sat ✅ 9.96501 9.96439
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 20.32910 20.33000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.55538 0.55529
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.56119 0.56112
Z3 z3-4.8.11_default sat ✅ 10.36160 10.36120
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 1.72210 1.72195
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 8.57664 8.57100
MathSAT MathSAT-5.6.8_default sat ✅ 20.51510 20.51410
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.61265 0.61260
Z3 z3-4.8.17_default sat ✅ 11.34930 11.34940
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 8.20560 8.20496
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.86638 2.86678
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1223.44000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.59755 0.59745
Z3-Owl z3-Owl-Final_default sat ✅ 13.17550 13.17550
z3-Owl-Final_default sat ✅ 13.60710 13.60600
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 4.31136 4.18075
cvc5 cvc5 sat ✅ 8.54453 8.41470
SMTInterpol SMTInterpol unknown ❌ 1201.74459 1240.78919
Yices2 Yices2 sat ✅ 0.60575 0.48877
Z3 Z3-Owl-base sat ✅ 61.90924 61.78019
Z3-Owl Z3-Owl sat ✅ 6.53696 6.40338