Benchmark

non-incremental/QF_BV/Sage2/bench_2081.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size17702
Compressed Size1777
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 17694
Compressed Size1771
Max. Term Depth60
Asserts 103
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not79 =83 let340
bvadd62 bvmul62 bvult19 zero_extend137

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 45.23980 45.23310
Boolector SMT17 final boolector sat ✅ 27.90470 27.89710
CVC4 CVC4-smtcomp2017-main default sat ✅ 15.75460 31.56200
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.46148 0.46108
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.16230 1.14597
Q3B Q3B default unknown ❌ 600.03000 1799.47000
STP stp_st default sat ✅ 114.77600 114.77500
stp_mt default sat ✅ 18.69650 73.93480
Yices2 Yices2-Main default sat ✅ 52.00070 51.99540
Z3 z3-4.5.0 default sat ✅ 139.47800 139.48200
SMT-COMP 2018 Boolector Boolector_default sat ✅ 34.95540 34.95340
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 141.08400 141.07800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 21.95500 21.95600
MinkeyRink Minkeyrink MT_mt sat ✅ 2.52246 9.70130
Minkeyrink ST_st sat ✅ 4.93513 4.93468
STP STP-CMS-st-2018_default-no-stderr sat ✅ 20.13510 20.13280
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 28.54300 113.06900
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.00822 2.00837
Yices2 Yices 2.6.0_default sat ✅ 64.35760 64.35610
Z3 z3-4.7.1_default sat ✅ 491.93600 491.91700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 11.95500 11.95480
Poolector-wrapped-sq_default sat ✅ 13.00790 51.06000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 110.55700 110.53300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 116.92700 116.93000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 14.49200 57.29540
MinkeyRink ST-wrapped-sq_default sat ✅ 15.41480 15.41460
Par4 Par4-wrapped-sq_default sat ✅ 8.28835 24.58000
STP STP-2019-wrapped-sq_default sat ✅ 22.44340 22.44210
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.76720 11.74710
stp-minisat-wrapped-sq_default sat ✅ 45.82570 45.79290
stp-mt-wrapped-sq_default sat ✅ 23.09750 91.27820
stp-portfolio-fixed-wrapped-sq_default sat ✅ 46.02770 80.95140
stp-riss-wrapped-sq_default unknown ❌ 0.13496 0.13517
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 80.42390 80.41720
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 63.00480 63.00090
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 5.02810 5.02799
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.87000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 58.79220 58.79170
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 93.44930 93.41900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.22154 3.21745
Boolector Boolector-wrapped-sq_default sat ✅ 18.67230 18.67130
Poolector-wrapped-sq_default sat ✅ 19.92310 78.33570
CVC4 CVC4-sq-final_default sat ✅ 65.03690 65.02780
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1200.11000
MathSAT MathSAT5_default.sh sat ✅ 100.55000 100.52600
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08723 0.08747
MinkeyRink Solver 2020.3_default sat ✅ 9.12178 35.92150
STP STP_default sat ✅ 2.13025 8.23218
STP ++ Mergsat v1_default sat ✅ 13.34900 13.35090
Yices2 Yices 2.6.2 bug fix_default sat ✅ 9.35352 9.34805
Z3 z3-4.8.8_default sat ✅ 688.06300 688.01700
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 18.53120 18.52840
MathSAT mathsat-5.6.6_default sat ✅ 2.11552 2.11555
STP STP 2021.0_default sat ✅ 1.46415 5.56183
Z3 z3-4.8.11_default sat ✅ 695.19900 695.14800
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 12.00030 11.99950
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 164.43000 164.40500
STP STP 2022.4_default sat ✅ 0.78040 0.78033
STP 2022.4_default sat ✅ 0.78166 0.78055
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 183.44200 212.40500
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 301.73700 301.66700
Z3-Owl z3-Owl-Final_default sat ✅ 94.33700 94.20000
z3-Owl-Final_default sat ✅ 31.88590 31.88240
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 119.24571 119.09471
Bitwuzla-MachBV-base sat ✅ 52.66785 52.54437
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.71452 2.58420
BVDecide bv_decide sat ✅ 10.87318 10.72831
bv_decide-nokernel sat ✅ 10.84138 10.68107
cvc5 cvc5 sat ✅ 25.38939 25.25459
SMTInterpol SMTInterpol unknown ❌ 1201.38748 1233.12041
Yices2 Yices2 sat ✅ 13.26641 13.13179
Z3alpha Z3-alpha sat ✅ 29.30637 115.64996
Z3 Z3-alpha-base sat ✅ 2.48351 2.36241
Z3-Owl-base sat ✅ 9.63506 9.51365
z3siri-base sat ✅ 2.55132 2.42997
Z3-Owl Z3-Owl sat ✅ 284.26839 284.10411