Benchmark

non-incremental/QF_ABV/stp/testcase3.stp.smt2 

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html
Benchmark
Size71064680
Compressed Size4810244
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 71064672
Compressed Size4810232
Max. Term Depth39375
Asserts 1
Declared Functions0
Declared Constants730578
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1121 false1 ite49358 not24320
and1 =397768 let39361 extract48962
bvnot26 bvand10240 bvor755 bvxor1176
bvadd56447 bvmul10 bvsub7072 bvult630
bvule351 bvslt23 bvsle239 bvshl4949
bvlshr1168 select47440 store204416

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 258.80000 —
Z3 Z3 0.1 sat ✅ 30.20000 —
Z3 0.1 (fixed BV) sat ✅ 30.20000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector sat ✅ 14.00000 —
CVC3 CVC3-1.5 unknown ❌ 287.10000 —
Z3 Z3 0.1 sat ✅ 30.30000 —
Z3.2 sat ✅ 25.50000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 sat ✅ 15.70000 —
CVC3 CVC3 2.3 unknown ❌ 101.10000 —
SMT-COMP 2011 0.80 (1/5) Boolector Boolector 1.5.23-833 sat ✅ 20.80000 —
CVC3 CVC3 v2.4 unknown ❌ 73.40000 —
MathSAT MathSAT5 unknown ❌ 830.60000 —
SONOLAR SONOLAR unknown ❌ 54.80000 —
Z3 Z3 unknown ❌ 65.60000 —
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 10.65180 —
Boolector-SMT-COMP-2011 default sat ✅ 12.66790 —
Boolector-SMT-COMP-2012 default sat ✅ 10.96820 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 161.66200 —
CVC3-SMT-COMP-2011 default sat ✅ 743.34400 —
CVC3-SMT-COMP-2012 default sat ✅ 772.99300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 376.22200 —
CVC4-SMT-EVAL-2013 default sat ✅ 326.38800 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ 117.81900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 22.06500 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 21.57060 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 13.52940 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 530.13900 —
Z3-SMT-COMP-2011 default sat ✅ 677.07300 —
SMT-COMP 2014 0.29 (5/7) Boolector Boolector boolectord sat ✅ 82.15550 82.14950
Boolector boolectorj sat ✅ 81.37870 81.38860
CVC4 CVC4 f7118b2 default sat ✅ 92.43030 92.42990
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 10.11800 10.10650
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 11.46630 11.45630
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.12000 2400.03000
SONOLAR sonolar_smtcomp-2014 default sat ✅ 28.63970 28.62560
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 3.86073 3.84741
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 629.99300 630.07300
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 45.95800 45.96200
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 67.23990 67.26680
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 147.72500 147.71800
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2365.30000 2365.99000
Yices2 Yices default sat ✅ 3.74685 3.74643
Z3 z3 4.4.0 default sat ✅ 1198.17000 1198.52000
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 51.32500 51.35410
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 222.34600 205.79700
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2217.75000 2218.85000
Yices2 Yices-2.4.2 default sat ✅ 3.72828 3.73040
Z3 z3-4.4.1 default sat ✅ 401.76100 401.96500
SMT-COMP 2017 0.40 (3/5) Boolector Boolector SMT17 final boolector sat ✅ 29.44480 29.44530
CVC4 CVC4-smtcomp2017-main default sat ✅ 144.58300 128.71200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.03700 599.81000
Yices2 Yices2-Main default sat ✅ 3.64059 3.63903
Z3 z3-4.5.0 default unknown ❌ 600.04600 599.81700
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 29.30440 29.30160
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 168.94100 135.76800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.86000
Yices2 Yices 2.6.0_default sat ✅ 3.45851 3.45513
Z3 z3-4.7.1_default sat ✅ 134.39600 134.39700
SMT-COMP 2020 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 21.46830 21.45750
Boolector Boolector-wrapped-sq_default sat ✅ 25.30230 25.28380
CVC4 CVC4-sq-final_default sat ✅ 156.72200 145.97400
MathSAT MathSAT5_default.sh unknown ❌ 1200.03000 1199.27000
Par4 Par4-wrapped-sq_default sat ✅ 3.63609 10.84000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.17405 4.17364
Z3 z3-4.8.8_default sat ✅ 41.61940 41.59350
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 50.17080 50.14730
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 172.47900 153.73100
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 325.05800 433.76200
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 4.46448 4.46437
Z3-Owl z3-Owl-Final_default sat ✅ 304.00100 303.95300
z3-Owl-Final_default sat ✅ 69.16030 69.16160
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla sat ✅ 29.29553 29.18203
cvc5 cvc5 sat ✅ 127.99207 127.84651
SMTInterpol SMTInterpol unknown ❌ 1202.22475 1429.74893
Yices2 Yices2 sat ✅ 3.37033 3.26907