Benchmark

non-incremental/QF_BV/Sage2/bench_2898.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size23160
Compressed Size1886
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 23152
Compressed Size1880
Max. Term Depth60
Asserts 116
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not91 =96 let467
bvadd95 bvmul95 bvult19 zero_extend186

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 43.81540 43.80250
Boolector SMT17 final boolector sat ✅ 50.13760 50.13320
CVC4 CVC4-smtcomp2017-main default sat ✅ 35.58150 55.06830
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 10.53050 10.53010
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.80756 0.77748
Q3B Q3B default unknown ❌ 600.05900 1786.81000
STP stp_st default sat ✅ 3.51387 3.51320
stp_mt default sat ✅ 3.05276 8.58631
Yices2 Yices2-Main default sat ✅ 102.05400 102.04400
Z3 z3-4.5.0 default sat ✅ 81.03390 81.01010
SMT-COMP 2018 Boolector Boolector_default sat ✅ 20.55720 20.55250
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 82.98900 82.97250
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.45269 1.45358
MinkeyRink Minkeyrink MT_mt sat ✅ 0.27709 0.80000
Minkeyrink ST_st sat ✅ 0.87413 0.87376
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.34889 2.34886
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.54532 1.62097
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.08710 1.08699
Yices2 Yices 2.6.0_default sat ✅ 68.08100 68.07490
Z3 z3-4.7.1_default sat ✅ 895.52900 895.55200
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 10.15940 10.15870
Poolector-wrapped-sq_default sat ✅ 0.98656 3.50000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 71.44580 71.44410
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 63.45300 63.45170
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.07180 3.98375
MinkeyRink ST-wrapped-sq_default sat ✅ 2.41313 2.41313
Par4 Par4-wrapped-sq_default sat ✅ 74.22700 222.56000
STP STP-2019-wrapped-sq_default sat ✅ 7.13077 7.13103
stp-mergesat-fixed-wrapped-sq_default sat ✅ 14.95310 14.95020
stp-minisat-wrapped-sq_default sat ✅ 13.14380 26.25280
stp-mt-wrapped-sq_default sat ✅ 2.04830 7.52906
stp-portfolio-fixed-wrapped-sq_default sat ✅ 15.20090 35.97850
stp-riss-wrapped-sq_default unknown ❌ 0.17610 0.17629
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 62.00070 61.99710
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 8.39910 8.39904
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 30.06320 30.06220
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.11000 2399.97000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 11.96630 11.96660
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 421.64100 421.60500
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.97960 2.97956
Bitwuzla-wrapped_default sat ✅ 4.61719 4.61660
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 137.54400 137.54800
MathSAT MathSAT-5.6.8_default sat ✅ 4.94179 4.94148
STP STP 2022.4_default sat ✅ 0.89486 0.89484
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 63.20590 63.19830
Z3++BV z3++bv_0702_default sat ✅ 203.20000 203.16500
Z3 z3-4.8.17_default sat ✅ 175.83400 175.80800
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 3.66927 3.55187
Bitwuzla-MachBV-base sat ✅ 1.68113 1.56418
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 12.01799 11.89908
BVDecide bv_decide sat ✅ 21.05088 20.93267
bv_decide-nokernel sat ✅ 21.21573 21.09719
cvc5 cvc5 sat ✅ 336.56116 336.40234
SMTInterpol SMTInterpol unknown ❌ 1201.38533 1232.39660
Yices2 Yices2 sat ✅ 17.41712 17.27489
Z3alpha Z3-alpha sat ✅ 42.05691 166.92227
Z3 Z3-alpha-base sat ✅ 46.27146 46.14487
Z3-Owl-base sat ✅ 189.81876 189.65406
z3siri-base sat ✅ 46.51778 46.38405
Z3-Owl Z3-Owl sat ✅ 258.70207 258.51827