Benchmark

non-incremental/QF_ABV/stp/testcase8.stp.smt2 

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html
Benchmark
Size69581304
Compressed Size4685999
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 69581296
Compressed Size4686007
Max. Term Depth38382
Asserts 1
Declared Functions0
Declared Constants717384
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1121 ite48627 not23952 and1
=389603 let38372 extract46981 bvnot26
bvand10129 bvor745 bvxor1160 bvadd55368
bvmul10 bvsub5436 bvult577 bvule320
bvslt6 bvsle231 bvshl4971 bvlshr1149
select46170 store199935

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 unsat ✅ 36.00000 —
Z3 Z3 0.1 unsat ✅ 20.90000 —
Z3 0.1 (fixed BV) unsat ✅ 20.90000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector unsat ✅ 10.40000 —
CVC3 CVC3-1.5 unknown ❌ 276.10000 —
Z3 Z3 0.1 unsat ✅ 21.40000 —
Z3.2 unsat ✅ 15.40000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 unsat ✅ 10.60000 —
CVC3 CVC3 2.3 unknown ❌ 98.10000 —
SMT-COMP 2012 Boolector Boolector unsat ✅ 14.40000 —
Boolector 1.5.23-833 unsat ✅ 15.20000 —
CVC3 CVC3 v2.4.2 unknown ❌ 71.80000 —
CVC4 1.0rc.3931 unsat ✅ 110.90000 —
CVC4 1.0rc.3970 unsat ✅ 112.00000 —
SONOLAR SONOLAR unsat ✅ 336.10000 —
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unsat ✅ 14.90000 —
SMT-COMP 2011 0.60 (2/5) Boolector Boolector 1.5.23-833 unsat ✅ 15.50000 —
CVC3 CVC3 v2.4 unknown ❌ 69.30000 —
MathSAT MathSAT5 unknown ❌ 814.80000 —
SONOLAR SONOLAR unknown ❌ 54.20000 —
Z3 Z3 unsat ✅ 20.70000 —
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 8.48646 —
Boolector-SMT-COMP-2011 default unsat ✅ 9.55443 —
Boolector-SMT-COMP-2012 default unsat ✅ 9.14756 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 208.50000 —
CVC3-SMT-COMP-2011 default unsat ✅ 285.32500 —
CVC3-SMT-COMP-2012 default unsat ✅ 290.84400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 58.98350 —
CVC4-SMT-EVAL-2013 default unsat ✅ 26.65270 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ 119.49000 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 19.19590 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 18.65970 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 8.09284 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 13.72780 —
Z3-SMT-COMP-2011 default unsat ✅ 12.39890 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord unsat ✅ 41.23450 41.24470
Boolector boolectorj unsat ✅ 41.03070 41.01880
CVC4 CVC4 f7118b2 default unsat ✅ 39.74430 39.74900
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 9.43447 9.41857
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 10.55320 10.54340
MathSAT MathSAT-5.2.12-Main default unsat ✅ 2237.18000 2237.88000
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 24.58980 24.58830
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 3.54657 3.52846
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 13.23560 13.23300
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 20.65440 20.66190
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 42.39770 42.41360
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 42.41960 42.42660
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 2269.24000 2270.36000
Yices2 Yices default unsat ✅ 3.46887 3.46847
Z3 z3 4.4.0 default unsat ✅ 12.17680 12.18210
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 21.41880 21.43090
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 42.52260 42.54760
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 2010.55000 2011.53000
Yices2 Yices-2.4.2 default unsat ✅ 3.43530 3.43706
Z3 z3-4.4.1 default unsat ✅ 12.26410 12.27120
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector unsat ✅ 16.06770 16.06830
CVC4 CVC4-smtcomp2017-main default unsat ✅ 45.06220 45.06390
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02900 599.63000
Yices2 Yices2-Main default unsat ✅ 3.35609 3.35424
Z3 z3-4.5.0 default unsat ✅ 12.60220 12.59860
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 15.53520 15.53450
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 46.91810 46.91730
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.03000 1199.78000
Yices2 Yices 2.6.0_default unsat ✅ 3.13780 3.13732
Z3 z3-4.7.1_default unsat ✅ 12.82160 12.82060
SMT-COMP 2020 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 17.42630 17.41100
Boolector Boolector-wrapped-sq_default unsat ✅ 20.43600 20.43400
CVC4 CVC4-sq-final_default unsat ✅ 124.96300 110.28700
MathSAT MathSAT5_default.sh unknown ❌ 1200.04000 1199.42000
Par4 Par4-wrapped-sq_default unsat ✅ 3.33346 9.89000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 3.86654 3.86601
Z3 z3-4.8.8_default unsat ✅ 28.00610 28.00110
SMT-COMP 2021 0.33 (2/3) MathSAT mathsat-5.6.6_default unknown ❌ 1200.10000 1199.73000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 3.82711 3.82696
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 3.80640 3.80587
Z3 z3-4.8.11_default unsat ✅ 26.48840 26.48700
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default unsat ✅ 20.09460 20.08570
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 139.51100 130.54300
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.09000 1199.75000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 3.79422 3.79383
Z3 z3-4.8.17_default unsat ✅ 26.65780 26.65660
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default unsat ✅ 52.07680 52.06880
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 36.95090 36.92710
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 294.34000 395.10900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 4.18441 4.18385
Z3-Owl z3-Owl-Final_default unsat ✅ 8.33126 8.33099
z3-Owl-Final_default unsat ✅ 11.33790 11.33800
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla unsat ✅ 18.42177 18.31827
cvc5 cvc5 unsat ✅ 27.48375 27.38288
SMTInterpol SMTInterpol unknown ❌ 1202.24464 1414.29584
Yices2 Yices2 unsat ✅ 3.23171 3.13155