Benchmark

non-incremental/QF_BV/Sage2/bench_4843.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size108234
Compressed Size6624
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 108226
Compressed Size6632
Max. Term Depth40
Asserts 232
Declared Functions0
Declared Constants100
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not52 =80 let2263
extract24 bvand6 bvor60 bvadd1727
bvmul252 bvult21 bvule11 bvugt3
bvuge19 bvslt3 bvsle57 bvsgt11
bvsge26 bvshl61 zero_extend81

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.29492 0.29430
Boolector SMT17 final boolector unsat ✅ 0.33387 0.33251
CVC4 CVC4-smtcomp2017-main default unsat ✅ 9.41717 18.82080
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.15854 1.15881
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.27630 0.23714
Q3B Q3B default unknown ❌ 600.06300 1791.51000
STP stp_st default unsat ✅ 0.02422 0.02119
stp_mt default unsat ✅ 0.02026 0.02003
Yices2 Yices2-Main default unsat ✅ 0.01066 0.00931
Z3 z3-4.5.0 default unsat ✅ 1.77554 1.77440
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.21477 0.21468
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.74315 0.74329
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.99490 0.99590
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.13319 0.17331
Minkeyrink ST_st unsat ✅ 0.12980 0.13001
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.01633 0.01641
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.01624 0.01633
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.01633 0.01638
Yices2 Yices 2.6.0_default unsat ✅ 0.01049 0.01042
Z3 z3-4.7.1_default unsat ✅ 9.69326 9.69224
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.21762 0.21760
Boolector Boolector-wrapped-sq_default unsat ✅ 0.29905 0.29898
Poolector-wrapped-sq_default unsat ✅ 0.18042 0.26066
CVC4 CVC4-sq-final_default unsat ✅ 0.26455 0.26486
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 24.44070 24.43940
MathSAT MathSAT5_default.sh unsat ✅ 0.45295 0.45292
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.12484 0.12499
MinkeyRink Solver 2020.3_default unsat ✅ 0.13861 0.17660
STP STP_default unsat ✅ 0.02253 0.02262
STP ++ Mergsat v1_default unsat ✅ 0.01531 0.01692
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01629 0.00984
Z3 z3-4.8.8_default unsat ✅ 7.97017 7.96915
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.22933 0.22894
Bitwuzla-wrapped_default unsat ✅ 0.23446 0.23441
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.55727 2.55766
MathSAT MathSAT-5.6.8_default unsat ✅ 0.64665 0.64653
STP STP 2022.4_default unsat ✅ 0.10178 0.10183
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01575 0.01000
Z3++BV z3++bv_0702_default unsat ✅ 1.50068 1.50061
Z3 z3-4.8.17_default unsat ✅ 5.37885 5.38047
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23342 0.23336
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 5.89092 5.89085
STP STP 2022.4_default unsat ✅ 0.10137 0.10142
STP 2022.4_default unsat ✅ 0.10063 0.10066
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1237.87000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01250 0.01043
Z3-Owl z3-Owl-Final_default unsat ✅ 189.86300 189.83000
z3-Owl-Final_default unsat ✅ 122.17900 122.18200
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23048 0.13053
cvc5 cvc5 unsat ✅ 1.30957 1.20947
SMTInterpol SMTInterpol unsat ✅ 57.37070 78.87277
STP STP unsat ✅ 0.27946 0.17961
Yices2 Yices2 unsat ✅ 0.21756 0.11735
Z3alpha Z3-alpha unsat ✅ 40.29478 40.19348