Benchmark

non-incremental/QF_BV/sage/app1/bench_2316.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size14314
Compressed Size2466
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 14306
Compressed Size2459
Max. Term Depth60
Asserts 1
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite36 not15 and1
=17 let50 bvor3 bvadd103
bvsub73 bvsdiv37 bvult74 bvule65
bvslt3 bvsle111 bvshl3 zero_extend40

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.00949 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.03035 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.02320 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.02186 —
abziz_portfolio_2012_solvers default unsat ✅ — —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.02282 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unsat ✅ 0.00948 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.06704 —
CVC4-SMT-EVAL-2013 default unsat ✅ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.01971 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.00981 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.00950 —
STP2-SMT-COMP-2012 default unsat ✅ 0.00940 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.00976 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.00946 —
Z3-SMT-COMP-2011 default unsat ✅ 0.01818 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.70717 0.70614
Boolector SMT17 final boolector unsat ✅ 0.66330 0.66178
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03386 0.04526
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 3.68252 3.68219
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.01417 0.01414
Q3B Q3B default unsat ✅ 0.05902 0.05864
STP stp_st default unsat ✅ 0.01011 0.00915
stp_mt default unsat ✅ 0.01041 0.00945
Yices2 Yices2-Main default unsat ✅ 0.00825 0.00343
Z3 z3-4.5.0 default unsat ✅ 0.03456 0.03273
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.64462 0.64454
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.07593 0.07612
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 3.60660 3.60722
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01400 0.01401
Minkeyrink ST_st unsat ✅ 0.01399 0.01410
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.00839 0.00683
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.00714 0.00676
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.00769 0.00696
Yices2 Yices 2.6.0_default unsat ✅ 0.00880 0.00654
Z3 z3-4.7.1_default unsat ✅ 0.03582 0.03572
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.47886 0.47880
Boolector Boolector-wrapped-sq_default unsat ✅ 0.86218 0.86216
Poolector-wrapped-sq_default unsat ✅ 0.48232 0.46899
CVC4 CVC4-sq-final_default unsat ✅ 0.03805 0.03839
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.15060 0.15056
MathSAT MathSAT5_default.sh unsat ✅ 2.11819 2.11806
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01644 0.01655
MinkeyRink Solver 2020.3_default unsat ✅ 0.01705 0.01713
STP STP_default unsat ✅ 0.01367 0.01381
STP ++ Mergsat v1_default unsat ✅ 0.01020 0.00840
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01202 0.00403
Z3 z3-4.8.8_default unsat ✅ 0.03330 0.03322
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.47677 0.47666
MathSAT mathsat-5.6.6_default unsat ✅ 1.98321 1.98292
STP STP 2021.0_default unsat ✅ 0.01839 0.01408
Z3 z3-4.8.11_default unsat ✅ 0.01718 0.01712
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.47114 0.47110
Bitwuzla-wrapped_default unsat ✅ 0.49599 0.49595
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.03407 0.03459
MathSAT MathSAT-5.6.8_default unsat ✅ 2.06426 2.06389
STP STP 2022.4_default unsat ✅ 0.01214 0.01217
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01124 0.00421
Z3++BV z3++bv_0702_default unsat ✅ 0.01747 0.01740
Z3 z3-4.8.17_default unsat ✅ 0.01669 0.01847
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.73269 3.73195
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.03144 0.03204
STP STP 2022.4_default unsat ✅ 0.01171 0.01178
STP 2022.4_default unsat ✅ 0.02304 0.02257
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.73609 12.73410
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01048 0.00434
Z3-Owl z3-Owl-Final_default unsat ✅ 0.68640 0.68642
z3-Owl-Final_default unsat ✅ 0.75694 0.69779
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23742 0.13781
cvc5 cvc5 unsat ✅ 0.26921 0.16978
SMTInterpol SMTInterpol unsat ✅ 1.56451 4.40525
STP STP unsat ✅ 0.23273 0.13298
Yices2 Yices2 unsat ✅ 0.21320 0.11334
Z3alpha Z3-alpha unsat ✅ 0.27099 0.17116
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29183 0.16499
Bitwuzla-MachBV-base unsat ✅ 0.29843 0.16563
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.36671 0.23619
BVDecide bv_decide unsat ✅ 13.88922 13.70434
bv_decide-nokernel unsat ✅ 6.08148 5.90175
cvc5 cvc5 unsat ✅ 0.29442 0.16852
SMTInterpol SMTInterpol unsat ✅ 1.40870 3.87095
Yices2 Yices2 unsat ✅ 0.24625 0.12627
Z3alpha Z3-alpha unsat ✅ 0.40037 0.27629
Z3 Z3-alpha-base unsat ✅ 0.30287 0.18184
Z3-Owl-base unsat ✅ 0.27830 0.15700
z3siri-base unsat ✅ 0.29958 0.17162
Z3-Owl Z3-Owl unsat ✅ 0.81238 0.68494