Benchmark

non-incremental/QF_BV/Sage2/bench_1789.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size19553
Compressed Size1700
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 19545
Compressed Size1692
Max. Term Depth60
Asserts 103
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not80 =83 let387
bvadd76 bvmul76 bvult19 zero_extend155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 14.70600 14.70630
Boolector SMT17 final boolector sat ✅ 91.63260 91.62660
CVC4 CVC4-smtcomp2017-main default sat ✅ 7.02476 14.05440
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 22.60440 22.60230
MinkeyRink MinkeyRink 2017.3a default sat ✅ 5.96214 6.80000
Q3B Q3B default unknown ❌ 600.02600 1799.49000
STP stp_st default sat ✅ 3.67060 3.66784
stp_mt default sat ✅ 9.92519 31.19830
Yices2 Yices2-Main default sat ✅ 92.27530 92.26830
Z3 z3-4.5.0 default sat ✅ 249.29600 197.76400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 70.37200 70.36250
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 34.49380 34.49090
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 11.44300 11.44320
MinkeyRink Minkeyrink MT_mt sat ✅ 2.45389 9.42735
Minkeyrink ST_st sat ✅ 6.29835 6.29811
STP STP-CMS-st-2018_default-no-stderr sat ✅ 22.31960 22.31800
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 4.71136 18.25460
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.88783 3.88804
Yices2 Yices 2.6.0_default sat ✅ 8.68707 8.68602
Z3 z3-4.7.1_default sat ✅ 529.22000 529.21500
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 4.17871 4.17861
Poolector-wrapped-sq_default sat ✅ 4.63247 17.86000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 74.47590 74.46820
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.31804 3.31821
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.68233 6.39443
MinkeyRink ST-wrapped-sq_default sat ✅ 3.64690 3.64665
Par4 Par4-wrapped-sq_default sat ✅ 19.18070 57.34000
STP STP-2019-wrapped-sq_default sat ✅ 5.70170 5.70092
stp-mergesat-fixed-wrapped-sq_default sat ✅ 18.12260 18.12070
stp-minisat-wrapped-sq_default sat ✅ 5.30969 5.30668
stp-mt-wrapped-sq_default sat ✅ 5.26047 20.39550
stp-portfolio-fixed-wrapped-sq_default sat ✅ 18.50590 29.76520
stp-riss-wrapped-sq_default unknown ❌ 0.15891 0.15912
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 49.04020 49.03710
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 3.36213 3.36200
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 3.73428 3.73397
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.87000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 12.00280 12.00190
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 568.26900 568.24300
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.25089 2.25080
Boolector Boolector-wrapped-sq_default sat ✅ 11.13160 11.13170
Poolector-wrapped-sq_default sat ✅ 12.21860 47.85230
CVC4 CVC4-sq-final_default sat ✅ 148.20600 148.19900
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1200.00000
MathSAT MathSAT5_default.sh sat ✅ 80.12560 80.12410
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08528 0.08553
MinkeyRink Solver 2020.3_default sat ✅ 2.23819 8.57179
STP STP_default sat ✅ 0.74012 2.69337
STP ++ Mergsat v1_default sat ✅ 11.77220 11.77160
Yices2 Yices 2.6.2 bug fix_default sat ✅ 8.18742 8.18649
Z3 z3-4.8.8_default sat ✅ 283.24300 283.21500
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 12.47120 12.46970
Bitwuzla-wrapped_default sat ✅ 10.19100 10.18980
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 145.39300 145.38100
MathSAT MathSAT-5.6.8_default sat ✅ 34.90200 34.88580
STP STP 2022.4_default sat ✅ 2.70233 2.70182
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 7.08879 7.08776
Z3++BV z3++bv_0702_default sat ✅ 41.82930 41.82740
Z3 z3-4.8.17_default sat ✅ 80.84040 80.83450
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 12.89252 12.77195
Bitwuzla-MachBV-base sat ✅ 2.97147 2.84500
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.55297 3.43623
BVDecide bv_decide sat ✅ 8.37595 8.23223
bv_decide-nokernel sat ✅ 8.43941 8.27755
cvc5 cvc5 sat ✅ 46.80198 46.67536
SMTInterpol SMTInterpol unknown ❌ 1201.38302 1228.52622
Yices2 Yices2 sat ✅ 15.66724 15.54367
Z3alpha Z3-alpha sat ✅ 147.89325 589.96401
Z3 Z3-alpha-base sat ✅ 62.94727 62.81789
Z3-Owl-base sat ✅ 263.63049 263.47092
z3siri-base sat ✅ 63.91838 63.77806
Z3-Owl Z3-Owl sat ✅ 94.02320 93.88782