Benchmark

non-incremental/QF_BV/sage/app7/bench_8002.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4437871
Compressed Size278264
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4437863
Compressed Size278276
Max. Term Depth16969
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2765 and1
=3559 let16749 extract1718 bvand46016
bvor30351 bvxor2315 bvadd49539 bvmul9
bvsub16220 bvsdiv28 bvult641 bvule652
bvslt220 bvsle126 bvshl15895 bvashr30025
zero_extend1521

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71618 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.67605 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68386 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.67884 —
abziz_portfolio_2012_solvers default unsat ✅ 0.68887 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.67839 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94345 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.07214 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99118 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 579.79700 —
CVC3-SMT-COMP-2011 default unsat ✅ 480.76400 —
CVC3-SMT-COMP-2012 default unsat ✅ 500.24100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.65889 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.57258 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31493 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.25644 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.64396 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.59337 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14812 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.61008 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.26579 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87138 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73910 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71360 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76163 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74014 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67609 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.21517 1.21318
Boolector SMT17 final boolector unsat ✅ 1.19628 1.19517
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.72073 9.06521
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.96484 0.93765
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.78917 1.77929
Q3B Q3B default unsat ✅ 1.13394 2.94000
STP stp_st default unsat ✅ 0.80203 0.80144
stp_mt default unsat ✅ 0.85651 0.85570
Yices2 Yices2-Main default unsat ✅ 0.27665 0.27580
Z3 z3-4.5.0 default unsat ✅ 0.71205 0.70958
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.03941 1.03920
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.37157 5.37142
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83322 0.83415
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.70624 1.70615
Minkeyrink ST_st unsat ✅ 1.70184 1.70188
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82957 0.82936
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82910 0.82909
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83252 0.83248
Yices2 Yices 2.6.0_default unsat ✅ 0.26571 0.26567
Z3 z3-4.7.1_default unsat ✅ 0.92303 0.92279
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.99632 1.99632
Poolector-wrapped-sq_default unsat ✅ 2.31379 8.60701
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.61829 1.61819
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.56251 5.56244
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.17142 1.17158
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.16859 1.16865
Par4 Par4-wrapped-sq_default unsat ✅ 0.28292 0.00610
STP STP-2019-wrapped-sq_default unsat ✅ 0.83384 0.83403
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82573 0.82583
stp-minisat-wrapped-sq_default unsat ✅ 0.83218 0.83230
stp-mt-wrapped-sq_default unsat ✅ 0.83496 0.83503
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81689 0.81702
stp-riss-wrapped-sq_default unsat ✅ 0.82639 0.82644
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.27349 0.27346
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.27375 0.27370
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.27230 0.27230
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.26765 0.26759
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.27379 0.27376
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.93954 0.93942
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69608 1.69577
Boolector Boolector-wrapped-sq_default unsat ✅ 1.99368 1.99356
Poolector-wrapped-sq_default unsat ✅ 2.38169 8.93295
CVC4 CVC4-sq-final_default unsat ✅ 7.29449 7.29451
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04302 1.04286
MathSAT MathSAT5_default.sh unsat ✅ 0.85536 0.85522
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.96493 0.96507
MinkeyRink Solver 2020.3_default unsat ✅ 1.00205 1.00215
STP STP_default unsat ✅ 0.78340 0.78351
STP ++ Mergsat v1_default unsat ✅ 0.77877 0.78036
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31957 0.31955
Z3 z3-4.8.8_default unsat ✅ 0.74434 0.74417
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.49030 1.39026
cvc5 cvc5 unsat ✅ 2.06957 1.96984
SMTInterpol SMTInterpol unknown ❌ 1202.71849 1434.62006
STP STP unsat ✅ 63.72648 63.59511
Yices2 Yices2 unsat ✅ 0.42715 0.32721
Z3alpha Z3-alpha unsat ✅ 0.75403 0.65452
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.15364 1.03745
Bitwuzla-MachBV-base unsat ✅ 1.48416 1.35309
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.68264 1.55934
BVDecide bv_decide unknown ❌ 1201.39046 1200.92749
bv_decide-nokernel unknown ❌ 1201.34632 1200.99455
cvc5 cvc5 unsat ✅ 1.59034 1.45722
SMTInterpol SMTInterpol unknown ❌ 1201.86404 1666.03548
Yices2 Yices2 unsat ✅ 0.41369 0.29264
Z3alpha Z3-alpha unsat ✅ 1.02254 1.04866
Z3 Z3-alpha-base unsat ✅ 0.78122 0.65133
Z3-Owl-base unsat ✅ 2.37219 2.24421
z3siri-base unsat ✅ 0.77526 0.64238
Z3-Owl Z3-Owl unsat ✅ 1.29987 1.18056