Benchmark

non-incremental/QF_BV/sage/app1/bench_503.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size85404
Compressed Size12153
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 85396
Compressed Size12181
Max. Term Depth216
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite91 not78 and1
=217 let206 extract1 bvand50
bvor192 bvadd410 bvmul5 bvsub293
bvult293 bvule637 bvslt2 bvsle72
bvshl193 bvashr5 zero_extend347

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.22693 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.05103 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05081 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05107 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05086 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.05072 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16099 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.15349 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15273 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.27454 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.81294 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.91027 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.68604 —
CVC4-SMT-EVAL-2013 default unsat ✅ 9.04718 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.50494 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.08817 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.47899 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.49072 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.27348 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.30585 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.02600 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.26387 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04117 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17684 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.10098 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03929 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04563 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02875 0.02799
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.20153 2.33764
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.23191 2.40463
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.08295 1.08283
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
STP stp-cryptominisat4 default unsat ✅ 0.15855 0.15798
stp-cmsat4-v15 default unsat ✅ 0.15887 0.15798
stp-cmsat4-mt-v15 default unsat ✅ 0.15839 0.15698
stp-minisat-v15 default unsat ✅ 0.15778 0.15698
Yices2 Yices default unsat ✅ 0.05017 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.33625 0.33595
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.03942 1.03985
ABC_glucose glucose unsat ✅ 14.45170 14.45730
Boolector Boolector boolector unsat ✅ 0.03626 0.03709
Boolector preprop boolector unsat ✅ 0.03411 0.03408
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.11296 2.17219
MapleSTP MapleSTP default unsat ✅ 0.13278 0.13283
MapleSTP-mt default unsat ✅ 0.13284 0.13254
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.05097 1.05283
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13717 0.13747
Q3B Q3B default unsat ✅ 0.65007 1.67735
STP stp-cms-exp-2016 default unsat ✅ 0.13421 0.13425
stp-cms-mt-2016 default unsat ✅ 0.13506 0.13508
stp-cms-st-2016 default unsat ✅ 0.13356 0.13354
stp-minisat-st-2016 default unsat ✅ 0.13591 0.13594
Yices2 Yices-2.4.2 default unsat ✅ 0.04653 0.04652
Z3 z3-4.4.1 default unsat ✅ 0.34736 0.34766
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.03466 0.03361
Boolector SMT17 final boolector unsat ✅ 0.03550 0.03403
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.31026 2.56212
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.03084 1.03049
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04353 0.04275
Q3B Q3B default unsat ✅ 0.63642 1.63621
STP stp_st default unsat ✅ 0.80834 0.80707
stp_mt default unsat ✅ 0.80584 0.80542
Yices2 Yices2-Main default unsat ✅ 0.05081 0.04999
Z3 z3-4.5.0 default unsat ✅ 0.33798 0.33702
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04952 0.04948
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.33719 2.33730
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.96780 0.96875
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04934 0.04905
Minkeyrink ST_st unsat ✅ 0.04845 0.04853
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.35410 0.35413
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.35431 0.35429
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.35376 0.35382
Yices2 Yices 2.6.0_default unsat ✅ 0.04774 0.04766
Z3 z3-4.7.1_default unsat ✅ 0.34426 0.34419
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05292 0.05290
Bitwuzla-wrapped_default unsat ✅ 0.05523 0.05520
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.00834 1.00874
MathSAT MathSAT-5.6.8_default unsat ✅ 0.62846 0.62843
STP STP 2022.4_default unsat ✅ 0.04246 0.04246
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05208 0.05205
Z3++BV z3++bv_0702_default unsat ✅ 0.53847 0.53828
Z3 z3-4.8.17_default unsat ✅ 0.70239 0.70426
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.32272 0.19107
Bitwuzla-MachBV-base unsat ✅ 0.29969 0.17694
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.37421 0.25373
BVDecide bv_decide unsat ✅ 19.07912 18.92341
bv_decide-nokernel unsat ✅ 10.31795 10.14827
cvc5 cvc5 unsat ✅ 0.99576 0.87174
SMTInterpol SMTInterpol unknown ❌ 1201.58912 1229.31590
Yices2 Yices2 unsat ✅ 0.27475 0.15748
Z3alpha Z3-alpha unsat ✅ 0.41749 0.43599
Z3 Z3-alpha-base unsat ✅ 0.29094 0.17564
Z3-Owl-base unsat ✅ 0.40065 0.28204
z3siri-base unsat ✅ 0.29670 0.17812
Z3-Owl Z3-Owl unsat ✅ 0.82928 0.70552