Benchmark

non-incremental/QF_BV/sage/app1/bench_2504.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size66410
Compressed Size9183
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 66402
Compressed Size9199
Max. Term Depth142
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite59 not70 and1
=179 let132 extract1 bvand34
bvor171 bvadd345 bvmul5 bvsub183
bvult211 bvule471 bvslt1 bvsle33
bvshl172 bvashr5 zero_extend287

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.73910 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.19671 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.21194 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.19724 —
abziz_portfolio_2012_solvers default unsat ✅ 0.19689 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.19655 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.09676 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.09143 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.09625 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.66888 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.40201 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.45406 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.45237 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.64180 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.25722 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.54102 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.24830 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.24582 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.18236 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.23433 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.58871 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.18353 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03907 —
STP2-SMT-COMP-2012 default unsat ✅ 0.03838 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.06947 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.20553 —
Z3-SMT-COMP-2011 default unsat ✅ 0.19200 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.01809 0.01700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.88747 1.72474
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.90341 1.75673
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.70355 0.70289
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.99000
STP stp-cryptominisat4 default unsat ✅ 0.04046 0.03899
stp-cmsat4-v15 default unsat ✅ 0.03872 0.03799
stp-cmsat4-mt-v15 default unsat ✅ 0.03878 0.03799
stp-minisat-v15 default unsat ✅ 0.03835 0.03699
Yices2 Yices default unsat ✅ 0.03632 0.03499
Z3 z3 4.4.0 default unsat ✅ 0.25753 0.25796
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.79372 0.79390
ABC_glucose glucose unsat ✅ 10.19250 10.19820
Boolector Boolector boolector unsat ✅ 0.02134 0.02133
Boolector preprop boolector unsat ✅ 0.02066 0.02065
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.89593 1.74554
MapleSTP MapleSTP default unsat ✅ 0.03528 0.03526
MapleSTP-mt default unsat ✅ 0.03424 0.03420
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.56443 0.56557
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.04648 0.04644
Q3B Q3B default unsat ✅ 0.33983 0.74666
STP stp-cms-exp-2016 default unsat ✅ 0.03429 0.03425
stp-cms-mt-2016 default unsat ✅ 0.03643 0.03624
stp-cms-st-2016 default unsat ✅ 0.03603 0.03598
stp-minisat-st-2016 default unsat ✅ 0.03536 0.03518
Yices2 Yices-2.4.2 default unsat ✅ 0.03808 0.03801
Z3 z3-4.4.1 default unsat ✅ 0.31290 0.31429
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02195 0.02143
Boolector SMT17 final boolector unsat ✅ 0.02136 0.02095
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.87929 1.70808
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62691 0.62466
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.03701 0.03710
Q3B Q3B default unsat ✅ 0.31533 0.66576
STP stp_st default unsat ✅ 0.06587 0.06443
stp_mt default unsat ✅ 0.06494 0.06432
Yices2 Yices2-Main default unsat ✅ 0.04244 0.03856
Z3 z3-4.5.0 default unsat ✅ 0.32150 0.32145
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01598 0.01593
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.63233 1.63258
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.57057 0.57162
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04159 0.04159
Minkeyrink ST_st unsat ✅ 0.04166 0.04175
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.06472 0.06473
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.06474 0.06480
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.06457 0.06461
Yices2 Yices 2.6.0_default unsat ✅ 0.03431 0.03426
Z3 z3-4.7.1_default unsat ✅ 0.25769 0.25757
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03422 0.03423
Poolector-wrapped-sq_default unsat ✅ 0.17636 0.22468
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.02957 0.02955
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.77770 0.77794
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04673 0.04682
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04811 0.04820
Par4 Par4-wrapped-sq_default unsat ✅ 0.03217 0.00606
STP STP-2019-wrapped-sq_default unsat ✅ 0.07032 0.07048
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06985 0.06999
stp-minisat-wrapped-sq_default unsat ✅ 0.07053 0.07061
stp-mt-wrapped-sq_default unsat ✅ 0.07062 0.07080
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06996 0.07006
stp-riss-wrapped-sq_default unsat ✅ 0.07095 0.07110
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03760 0.03761
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03780 0.03781
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03821 0.03807
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09325 0.09325
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03835 0.03831
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27902 0.27902
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.27384 0.17416
cvc5 cvc5 unsat ✅ 1.09746 0.99778
SMTInterpol SMTInterpol unsat ✅ 950.21731 986.90454
STP STP unsat ✅ 0.26148 0.16102
Yices2 Yices2 unsat ✅ 0.23552 0.13566
Z3alpha Z3-alpha unsat ✅ 0.28988 0.19006
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.29806 0.17516
Bitwuzla-MachBV-base unsat ✅ 0.29973 0.17399
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43894 0.30831
BVDecide bv_decide unsat ✅ 12.84591 12.67684
bv_decide-nokernel unsat ✅ 6.56456 6.38089
cvc5 cvc5 unsat ✅ 0.77837 0.65941
SMTInterpol SMTInterpol unsat ✅ 331.30285 355.72730
Yices2 Yices2 unsat ✅ 0.26606 0.14744
Z3alpha Z3-alpha unsat ✅ 0.43071 0.38102
Z3 Z3-alpha-base unsat ✅ 0.31046 0.18986
Z3-Owl-base unsat ✅ 0.41725 0.28792
z3siri-base unsat ✅ 0.27929 0.15908
Z3-Owl Z3-Owl unsat ✅ 0.84764 0.71111