Benchmark

non-incremental/QF_BV/Sage2/bench_16951.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size161586
Compressed Size6356
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 161578
Compressed Size6222
Max. Term Depth147
Asserts 345
Declared Functions0
Declared Constants66
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not69 =115 let3482
bvadd1652 bvmul71 bvult28 bvuge32
bvslt34 bvsle58 bvsgt28 bvsge49
bvshl10 zero_extend1680

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 102.55200 102.54400
Boolector SMT17 final boolector unsat ✅ 333.11000 333.09000
CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.33637 12.61880
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 174.28400 174.26800
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.12809 0.10664
Q3B Q3B default unknown ❌ 600.08200 1799.40000
STP stp_st default unsat ✅ 0.16467 0.16433
stp_mt default unsat ✅ 0.20125 0.35502
Yices2 Yices2-Main default unsat ✅ 0.01701 0.01582
Z3 z3-4.5.0 default unsat ✅ 0.29294 0.29240
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 81.99920 81.99600
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 11.10140 11.10210
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 512.43600 512.46100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.08133 0.09391
Minkeyrink ST_st unsat ✅ 0.07600 0.07619
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.09616 0.09594
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.10095 0.12535
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.28113 0.28089
Yices2 Yices 2.6.0_default unsat ✅ 0.01783 0.01776
Z3 z3-4.7.1_default unsat ✅ 0.26457 0.26452
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 79.02640 79.01670
Bitwuzla-wrapped_default unsat ✅ 103.70700 103.70000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.91813 2.91867
MathSAT MathSAT-5.6.8_default unsat ✅ 994.31000 994.06600
STP STP 2022.4_default unsat ✅ 54.58390 54.57790
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02091 0.02089
Z3++BV z3++bv_0702_default unsat ✅ 0.22805 0.22799
Z3 z3-4.8.17_default unsat ✅ 0.24576 0.24757
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 115.56800 115.56100
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 7.76257 7.76295
STP STP 2022.4_default unsat ✅ 75.93450 75.91290
STP 2022.4_default unsat ✅ 77.05930 77.04540
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 5.70779 17.32800
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01847 0.01841
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.01000 1200.02000
z3-Owl-Final_default unknown ❌ 1200.02000 1200.06000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 88.28531 88.18274
cvc5 cvc5 unknown ❌ 1201.72137 1200.61629
SMTInterpol SMTInterpol unsat ✅ 1.47007 3.97467
STP STP unsat ✅ 73.07540 72.95338
Yices2 Yices2 unsat ✅ 0.22759 0.12785
Z3alpha Z3-alpha unsat ✅ 3.66535 3.56536
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 77.20139 77.06523
Bitwuzla-MachBV-base unsat ✅ 61.63215 61.50375
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 42.99030 42.86868
BVDecide bv_decide unsat ✅ 60.72405 60.55889
bv_decide-nokernel unsat ✅ 52.24566 52.10925
cvc5 cvc5 unknown ❌ 1201.76845 1200.86883
SMTInterpol SMTInterpol unsat ✅ 1.23231 3.04621
Yices2 Yices2 unsat ✅ 0.31985 0.20036
Z3alpha Z3-alpha unsat ✅ 29.70430 116.18084
Z3 Z3-alpha-base unknown ❌ 1201.25415 1200.99098
Z3-Owl-base unknown ❌ 1201.27904 1200.98318
z3siri-base unknown ❌ 1201.29900 1200.99779
Z3-Owl Z3-Owl unknown ❌ 1201.76390 1200.93870