Benchmark

non-incremental/QF_BV/sage/app7/bench_3969.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3658257
Compressed Size236380
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3658249
Compressed Size236387
Max. Term Depth14091
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2515 and1
=3284 let13914 extract1705 bvand37335
bvor24545 bvxor2273 bvadd40533 bvmul7
bvsub13390 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl13084 bvashr24328
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.54446 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.81648 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.82191 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.81367 —
abziz_portfolio_2012_solvers default unsat ✅ 0.81574 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.82544 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.73171 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.88376 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.77292 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 537.01400 —
CVC3-SMT-COMP-2011 default unsat ✅ 444.51100 —
CVC3-SMT-COMP-2012 default unsat ✅ 464.46100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.13776 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.87483 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.09118 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.03908 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.36175 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.32904 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.95052 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.85979 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.68691 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.48825 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.62932 —
STP2-SMT-COMP-2012 default unsat ✅ 0.54542 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.56810 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.83570 —
Z3-SMT-COMP-2011 default unsat ✅ 0.80579 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.97276 0.97187
Boolector SMT17 final boolector unsat ✅ 0.97532 0.97372
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.75481 7.66535
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.71129 0.71086
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.41281 1.41167
Q3B Q3B default unsat ✅ 0.98069 2.59000
STP stp_st default unsat ✅ 0.62315 0.62216
stp_mt default unsat ✅ 0.64204 0.64092
Yices2 Yices2-Main default unsat ✅ 0.22692 0.22685
Z3 z3-4.5.0 default unsat ✅ 0.79440 0.79336
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.86958 0.86946
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.43904 4.43899
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.69301 0.69315
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.42961 1.42964
Minkeyrink ST_st unsat ✅ 1.42901 1.42894
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.63165 0.63175
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.63011 0.63021
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.63194 0.63193
Yices2 Yices 2.6.0_default unsat ✅ 0.22530 0.22271
Z3 z3-4.7.1_default unsat ✅ 0.88580 0.88393
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.72856 1.72832
Poolector-wrapped-sq_default unsat ✅ 2.00731 7.55000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.40248 1.40232
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.67465 4.67461
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.00650 1.00655
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.00189 1.00188
Par4 Par4-wrapped-sq_default unsat ✅ 0.23644 0.00635
STP STP-2019-wrapped-sq_default unsat ✅ 0.65102 0.65106
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.64260 0.64256
stp-minisat-wrapped-sq_default unsat ✅ 0.65085 0.65093
stp-mt-wrapped-sq_default unsat ✅ 0.65141 0.65144
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.64206 0.64223
stp-riss-wrapped-sq_default unsat ✅ 0.65411 0.65421
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.22449 0.22444
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.22760 0.22757
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.22697 0.22692
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.22478 0.22478
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.22702 0.22701
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.57323 0.57320
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.36138 1.36125
Bitwuzla-wrapped_default unsat ✅ 1.44821 1.44804
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.75496 4.75469
MathSAT MathSAT-5.6.8_default unsat ✅ 0.73595 0.73574
STP STP 2022.4_default unsat ✅ 0.71017 0.71021
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.26523 0.26517
Z3++BV z3++bv_0702_default unsat ✅ 0.44782 0.44778
Z3 z3-4.8.17_default unsat ✅ 0.45984 0.46044
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.10177 0.97206
Bitwuzla-MachBV-base unsat ✅ 1.33436 1.21255
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.52315 1.39544
BVDecide bv_decide unknown ❌ 1201.38949 1201.03768
bv_decide-nokernel unknown ❌ 1201.38109 1201.00561
cvc5 cvc5 unsat ✅ 1.42345 1.29426
SMTInterpol SMTInterpol unknown ❌ 1201.88473 1529.25022
Yices2 Yices2 unsat ✅ 0.42273 0.29444
Z3alpha Z3-alpha unsat ✅ 1.00221 0.99737
Z3 Z3-alpha-base unsat ✅ 0.61070 0.48914
Z3-Owl-base unsat ✅ 1.94145 1.82208
z3siri-base unsat ✅ 0.62754 0.50164
Z3-Owl Z3-Owl unsat ✅ 1.24593 1.11795