Benchmark

non-incremental/QF_BV/sage/app1/bench_2225.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size72325
Compressed Size10348
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 72317
Compressed Size10367
Max. Term Depth169
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite74 not72 and1
=187 let159 extract1 bvand38
bvor171 bvadd358 bvmul5 bvsub225
bvult246 bvule538 bvslt1 bvsle45
bvshl172 bvashr5 zero_extend302

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.82018 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04677 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05082 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05098 —
abziz_portfolio_2012_solvers default unsat ✅ 0.04641 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04569 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.10752 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.11227 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.10239 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.24364 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.93317 —
CVC3-SMT-COMP-2012 default unsat ✅ 3.00457 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.55907 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.91300 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.34133 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.85724 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.32669 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.33309 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21840 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.25051 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.69796 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.21897 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04469 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04149 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.07666 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03426 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04066 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02149 0.02100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.95882 1.86172
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.95896 1.86671
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.87098 0.87087
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.86000
STP stp-cryptominisat4 default unsat ✅ 0.04169 0.04099
stp-cmsat4-v15 default unsat ✅ 0.04045 0.03899
stp-cmsat4-mt-v15 default unsat ✅ 0.04050 0.03999
stp-minisat-v15 default unsat ✅ 0.04012 0.03899
Yices2 Yices default unsat ✅ 0.03870 0.03699
Z3 z3 4.4.0 default unsat ✅ 0.29024 0.28996
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.86924 0.86982
ABC_glucose glucose unsat ✅ 11.17090 11.17720
Boolector Boolector boolector unsat ✅ 0.02361 0.02391
Boolector preprop boolector unsat ✅ 0.02301 0.02334
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.02420 1.97477
MapleSTP MapleSTP default unsat ✅ 0.03678 0.03675
MapleSTP-mt default unsat ✅ 0.03708 0.03708
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.70730 0.70928
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05033 0.05032
Q3B Q3B default unsat ✅ 0.38996 0.89998
STP stp-cms-exp-2016 default unsat ✅ 0.03800 0.03794
stp-cms-mt-2016 default unsat ✅ 0.03659 0.03655
stp-cms-st-2016 default unsat ✅ 0.03714 0.03712
stp-minisat-st-2016 default unsat ✅ 0.03724 0.03719
Yices2 Yices-2.4.2 default unsat ✅ 0.03952 0.03948
Z3 z3-4.4.1 default unsat ✅ 0.24388 0.24523
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02569 0.02475
Boolector SMT17 final boolector unsat ✅ 0.02863 0.02464
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.96632 1.87630
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.79507 0.79504
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04038 0.03967
Q3B Q3B default unsat ✅ 0.39868 0.92131
STP stp_st default unsat ✅ 0.06915 0.06914
stp_mt default unsat ✅ 0.06997 0.06920
Yices2 Yices2-Main default unsat ✅ 0.03859 0.03850
Z3 z3-4.5.0 default unsat ✅ 0.33834 0.33746
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02010 0.02006
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.06776 2.06780
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.77302 0.77405
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04242 0.04247
Minkeyrink ST_st unsat ✅ 0.04196 0.04199
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.06221 0.06224
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.06135 0.06137
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.06099 0.06106
Yices2 Yices 2.6.0_default unsat ✅ 0.03692 0.03688
Z3 z3-4.7.1_default unsat ✅ 0.33458 0.33446
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03787 0.03776
Poolector-wrapped-sq_default unsat ✅ 0.17633 0.24945
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03345 0.03344
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.00757 1.00770
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04774 0.04787
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04570 0.04576
Par4 Par4-wrapped-sq_default unsat ✅ 0.02623 0.00606
STP STP-2019-wrapped-sq_default unsat ✅ 0.07246 0.07255
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.07224 0.07238
stp-minisat-wrapped-sq_default unsat ✅ 0.07306 0.07323
stp-mt-wrapped-sq_default unsat ✅ 0.07453 0.07467
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.07207 0.07224
stp-riss-wrapped-sq_default unsat ✅ 0.07307 0.07322
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04274 0.04273
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04301 0.04301
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04307 0.04304
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08431 0.08427
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04304 0.04304
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.33031 0.33012
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03632 0.03627
MathSAT mathsat-5.6.6_default unsat ✅ 0.43018 0.43011
STP STP 2021.0_default unsat ✅ 0.07419 0.07428
Z3 z3-4.8.11_default unsat ✅ 0.34876 0.34864
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.23496 0.13566
cvc5 cvc5 unsat ✅ 0.99775 0.89801
SMTInterpol SMTInterpol unsat ✅ 107.58825 141.87445
STP STP unsat ✅ 0.26376 0.16387
Yices2 Yices2 unsat ✅ 0.27701 0.17727
Z3alpha Z3-alpha unsat ✅ 0.29054 0.19109
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.31681 0.18990
Bitwuzla-MachBV-base unsat ✅ 0.27484 0.15403
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43241 0.31287
BVDecide bv_decide unsat ✅ 14.35514 14.19900
bv_decide-nokernel unsat ✅ 7.44899 7.29513
cvc5 cvc5 unsat ✅ 0.87687 0.74591
SMTInterpol SMTInterpol unknown ❌ 1201.76755 1228.49771
Yices2 Yices2 unsat ✅ 0.30359 0.17962
Z3alpha Z3-alpha unsat ✅ 0.43226 0.40848
Z3 Z3-alpha-base unsat ✅ 0.28935 0.17563
Z3-Owl-base unsat ✅ 0.39993 0.27531
z3siri-base unsat ✅ 0.32346 0.18633
Z3-Owl Z3-Owl unsat ✅ 0.84849 0.71824