Benchmark

non-incremental/QF_BV/sage/app1/bench_2247.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size72272
Compressed Size10373
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 72264
Compressed Size10403
Max. Term Depth169
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite74 not72 and1
=187 let159 extract1 bvand38
bvor171 bvadd359 bvmul5 bvsub226
bvult246 bvule537 bvslt2 bvsle42
bvshl172 bvashr5 zero_extend302

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.82211 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.05056 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05019 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05282 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05258 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04475 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11252 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.11064 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.10888 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.05615 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.77568 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.83883 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.56198 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.90777 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.33049 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.77980 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.31561 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31523 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21332 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.26192 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.69356 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.21339 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03541 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04151 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.07722 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03305 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04030 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02153 0.02100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.97037 1.88771
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.97953 1.90571
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.85233 0.85187
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.04517 0.04399
stp-cmsat4-v15 default unsat ✅ 0.04382 0.04299
stp-cmsat4-mt-v15 default unsat ✅ 0.04449 0.04299
stp-minisat-v15 default unsat ✅ 0.04345 0.04199
Yices2 Yices default unsat ✅ 0.04047 0.03899
Z3 z3 4.4.0 default unsat ✅ 0.29076 0.29096
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.87244 0.87281
ABC_glucose glucose unsat ✅ 11.11300 11.11870
Boolector Boolector boolector unsat ✅ 0.02362 0.02388
Boolector preprop boolector unsat ✅ 0.02318 0.02312
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.98399 1.91965
MapleSTP MapleSTP default unsat ✅ 0.04195 0.04186
MapleSTP-mt default unsat ✅ 0.04122 0.04155
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.71008 0.71157
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05855 0.05851
Q3B Q3B default unsat ✅ 0.38766 0.88741
STP stp-cms-exp-2016 default unsat ✅ 0.04362 0.04392
stp-cms-mt-2016 default unsat ✅ 0.04312 0.04311
stp-cms-st-2016 default unsat ✅ 0.04328 0.04344
stp-minisat-st-2016 default unsat ✅ 0.04328 0.04322
Yices2 Yices-2.4.2 default unsat ✅ 0.04019 0.04050
Z3 z3-4.4.1 default unsat ✅ 0.29409 0.29554
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02361 0.02295
Boolector SMT17 final boolector unsat ✅ 0.02357 0.02314
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.04619 2.03639
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63006 0.62965
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04141 0.04057
Q3B Q3B default unsat ✅ 0.41218 0.96470
STP stp_st default unsat ✅ 0.06612 0.06612
stp_mt default unsat ✅ 0.06672 0.06556
Yices2 Yices2-Main default unsat ✅ 0.04021 0.03986
Z3 z3-4.5.0 default unsat ✅ 0.34020 0.34029
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01797 0.01793
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.05928 2.05934
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59361 0.59474
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04336 0.04344
Minkeyrink ST_st unsat ✅ 0.04353 0.04359
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07831 0.07838
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07933 0.07936
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07826 0.07834
Yices2 Yices 2.6.0_default unsat ✅ 0.03908 0.03903
Z3 z3-4.7.1_default unsat ✅ 0.29553 0.29539
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03973 0.03977
Poolector-wrapped-sq_default unsat ✅ 0.17617 0.24796
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03315 0.03316
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.88881 0.88901
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05178 0.05197
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04939 0.04948
Par4 Par4-wrapped-sq_default unsat ✅ 0.02670 0.00588
STP STP-2019-wrapped-sq_default unsat ✅ 0.08711 0.08724
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.08710 0.08723
stp-minisat-wrapped-sq_default unsat ✅ 0.08738 0.08749
stp-mt-wrapped-sq_default unsat ✅ 0.08720 0.08734
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.08688 0.08705
stp-riss-wrapped-sq_default unsat ✅ 0.08741 0.08753
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04201 0.04198
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04263 0.04261
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04408 0.04401
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09266 0.09266
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04286 0.04286
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.34921 0.34919
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.26125 0.16125
cvc5 cvc5 unsat ✅ 1.05975 0.95989
SMTInterpol SMTInterpol unsat ✅ 795.70289 830.91335
STP STP unsat ✅ 0.26395 0.16444
Yices2 Yices2 unsat ✅ 0.23626 0.13646
Z3alpha Z3-alpha unsat ✅ 0.37165 0.27220
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.28936 0.16950
Bitwuzla-MachBV-base unsat ✅ 0.27098 0.15394
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.48403 0.35622
BVDecide bv_decide unsat ✅ 14.18356 14.03285
bv_decide-nokernel unsat ✅ 7.57119 7.41939
cvc5 cvc5 unsat ✅ 0.88422 0.76470
SMTInterpol SMTInterpol unknown ❌ 1201.56742 1228.19143
Yices2 Yices2 unsat ✅ 0.33033 0.18893
Z3alpha Z3-alpha unsat ✅ 0.39700 0.36278
Z3 Z3-alpha-base unsat ✅ 0.28609 0.16692
Z3-Owl-base unsat ✅ 0.36100 0.23931
z3siri-base unsat ✅ 0.27355 0.15584
Z3-Owl Z3-Owl unsat ✅ 0.82731 0.70721