Benchmark

non-incremental/QF_BV/sage/app1/bench_2575.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size65452
Compressed Size8976
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 65444
Compressed Size9044
Max. Term Depth140
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite59 not69 and1
=175 let130 extract1 bvand32
bvor171 bvadd335 bvmul5 bvsub181
bvult210 bvule462 bvslt1 bvsle27
bvshl172 bvashr5 zero_extend287

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71256 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04301 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.04291 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.04338 —
abziz_portfolio_2012_solvers default unsat ✅ 0.04166 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04288 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.09198 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.08908 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.08638 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.58335 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.31986 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.37881 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.44254 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.61977 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.59083 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.25084 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.24929 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.18680 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.22666 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.53361 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.18756 —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unsat ✅ 0.03806 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.06734 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03161 —
Z3-SMT-COMP-2011 default unsat ✅ 0.03776 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.01719 0.01600
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.91125 1.77173
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.91093 1.77273
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.60349 0.60291
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.03982 0.03899
stp-cmsat4-v15 default unsat ✅ 0.03832 0.03699
stp-cmsat4-mt-v15 default unsat ✅ 0.03864 0.03799
stp-minisat-v15 default unsat ✅ 0.03814 0.03699
Yices2 Yices default unsat ✅ 0.03694 0.03599
Z3 z3 4.4.0 default unsat ✅ 0.23019 0.22997
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.77322 0.77314
ABC_glucose glucose unsat ✅ 9.64635 9.65016
Boolector Boolector boolector unsat ✅ 0.02008 0.02049
Boolector preprop boolector unsat ✅ 0.01949 0.01992
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.84597 1.64586
MapleSTP MapleSTP default unsat ✅ 0.03384 0.03380
MapleSTP-mt default unsat ✅ 0.03269 0.03267
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.60109 0.60244
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.04374 0.04429
Q3B Q3B default unknown ❌ 2400.02000 7203.64000
STP stp-cms-exp-2016 default unsat ✅ 0.03261 0.03258
stp-cms-mt-2016 default unsat ✅ 0.03238 0.03237
stp-cms-st-2016 default unsat ✅ 0.03267 0.03266
stp-minisat-st-2016 default unsat ✅ 0.03238 0.03232
Yices2 Yices-2.4.2 default unsat ✅ 0.03527 0.03522
Z3 z3-4.4.1 default unsat ✅ 0.23687 0.23829
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02154 0.02190
Boolector SMT17 final boolector unsat ✅ 0.02107 0.02017
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.86550 1.67678
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66340 0.66334
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.03674 0.03635
Q3B Q3B default unsat ✅ 0.30652 0.64184
STP stp_st default unsat ✅ 0.05585 0.05492
stp_mt default unsat ✅ 0.05658 0.05580
Yices2 Yices2-Main default unsat ✅ 0.03382 0.03271
Z3 z3-4.5.0 default unsat ✅ 0.06032 0.05259
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01578 0.01576
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.69671 1.69695
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.65549 0.65647
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.03934 0.03933
Minkeyrink ST_st unsat ✅ 0.03980 0.03985
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.03823 0.03830
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.03828 0.03830
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.03819 0.03822
Yices2 Yices 2.6.0_default unsat ✅ 0.03449 0.03444
Z3 z3-4.7.1_default unsat ✅ 0.25789 0.25783
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.02736 0.02733
Boolector Boolector-wrapped-sq_default unsat ✅ 0.03193 0.03193
Poolector-wrapped-sq_default unsat ✅ 0.17541 0.21261
CVC4 CVC4-sq-final_default unsat ✅ 0.86778 0.86798
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 15.73570 15.73440
MathSAT MathSAT5_default.sh unsat ✅ 0.32215 0.32207
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04004 0.04013
MinkeyRink Solver 2020.3_default unsat ✅ 0.04159 0.04164
STP STP_default unsat ✅ 0.08172 0.08077
STP ++ Mergsat v1_default unsat ✅ 0.04091 0.04258
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03884 0.03875
Z3 z3-4.8.8_default unsat ✅ 0.28023 0.28015
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.02832 0.02828
MathSAT mathsat-5.6.6_default unsat ✅ 0.32650 0.32646
STP STP 2021.0_default unsat ✅ 0.05072 0.05080
Z3 z3-4.8.11_default unsat ✅ 0.26635 0.26628
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31023 0.18012
Bitwuzla-MachBV-base unsat ✅ 0.30154 0.17536
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.44535 0.32556
BVDecide bv_decide unsat ✅ 12.37400 12.21091
bv_decide-nokernel unsat ✅ 6.33530 6.16049
cvc5 cvc5 unsat ✅ 0.80996 0.68303
SMTInterpol SMTInterpol unsat ✅ 11.06940 26.26227
Yices2 Yices2 unsat ✅ 0.26688 0.14821
Z3alpha Z3-alpha unsat ✅ 0.41955 0.37430
Z3 Z3-alpha-base unsat ✅ 0.28598 0.16738
Z3-Owl-base unsat ✅ 0.38088 0.25287
z3siri-base unsat ✅ 0.27819 0.16001
Z3-Owl Z3-Owl unsat ✅ 0.84306 0.71262