Benchmark

non-incremental/QF_BV/sage/app7/bench_1066.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2277287
Compressed Size150142
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2277279
Compressed Size150144
Max. Term Depth8765
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1756 and1
=2360 let8666 extract1291 bvand23232
bvor15216 bvxor1530 bvadd24965 bvmul1
bvsub8051 bvult441 bvule482 bvslt205
bvsle103 bvshl7890 bvashr14793 zero_extend1013

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.34353 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.38121 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.38646 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.37062 —
abziz_portfolio_2012_solvers default unsat ✅ 0.37910 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.37588 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.46635 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.53879 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.49250 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 188.59900 —
CVC3-SMT-COMP-2011 default unsat ✅ 158.26000 —
CVC3-SMT-COMP-2012 default unsat ✅ 165.25900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.92505 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.00684 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.66648 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.64424 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.84756 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.82794 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.60140 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.98750 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.24754 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.93945 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.36859 —
STP2-SMT-COMP-2012 default unsat ✅ 0.34634 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.36651 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.41143 —
Z3-SMT-COMP-2011 default unsat ✅ 0.37262 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.66690 0.66590
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.00349 4.85126
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.00387 4.85826
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.46939 0.46893
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.00000
STP stp-cryptominisat4 default unsat ✅ 0.30813 0.30695
stp-cmsat4-v15 default unsat ✅ 0.30668 0.30595
stp-cmsat4-mt-v15 default unsat ✅ 0.30962 0.30895
stp-minisat-v15 default unsat ✅ 0.30696 0.30595
Yices2 Yices default unsat ✅ 0.13392 0.13298
Z3 z3 4.4.0 default unsat ✅ 0.38253 0.38294
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.29111 1.29189
ABC_glucose glucose unsat ✅ 1.28109 2.44196
Boolector Boolector boolector unsat ✅ 0.75771 0.75865
Boolector preprop boolector unsat ✅ 0.74288 0.74383
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.95057 4.78342
MapleSTP MapleSTP default unsat ✅ 0.29271 0.29285
MapleSTP-mt default unsat ✅ 0.29309 0.29325
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.42400 0.42542
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.41883 0.41903
Q3B Q3B default unsat ✅ 0.65336 1.55000
STP stp-cms-exp-2016 default unsat ✅ 0.29968 0.29982
stp-cms-mt-2016 default unsat ✅ 0.30417 0.30503
stp-cms-st-2016 default unsat ✅ 0.30243 0.30255
stp-minisat-st-2016 default unsat ✅ 0.30400 0.30412
Yices2 Yices-2.4.2 default unsat ✅ 0.13323 0.13325
Z3 z3-4.4.1 default unsat ✅ 0.36101 0.36254
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.61854 0.61718
Boolector SMT17 final boolector unsat ✅ 0.57057 0.56975
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.95456 4.71371
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.45710 0.45679
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.93342 0.92975
Q3B Q3B default unsat ✅ 0.86220 1.72000
STP stp_st default unsat ✅ 0.45145 0.45003
stp_mt default unsat ✅ 0.43336 0.43230
Yices2 Yices2-Main default unsat ✅ 0.12724 0.12584
Z3 z3-4.5.0 default unsat ✅ 0.40611 0.40005
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.51299 0.51297
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.71358 2.70551
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.41982 0.42093
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.88190 0.88194
Minkeyrink ST_st unsat ✅ 0.88406 0.88394
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.39949 0.39955
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.40085 0.40093
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.40069 0.40064
Yices2 Yices 2.6.0_default unsat ✅ 0.12171 0.12162
Z3 z3-4.7.1_default unsat ✅ 0.55577 0.55558
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.81384 0.81377
MathSAT mathsat-5.6.6_default unsat ✅ 0.50811 0.50466
STP STP 2021.0_default unsat ✅ 0.38743 0.38748
Z3 z3-4.8.11_default unsat ✅ 0.32079 0.32070
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24441 1.24421
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.05168 2.05201
STP STP 2022.4_default unsat ✅ 0.41542 0.41546
STP 2022.4_default unsat ✅ 0.40906 0.40910
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 583.58000 664.40700
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.14742 0.14736
Z3-Owl z3-Owl-Final_default unsat ✅ 0.96830 0.96824
z3-Owl-Final_default unsat ✅ 0.98418 0.98439
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.88192 0.78186
cvc5 cvc5 unsat ✅ 1.12850 1.02872
SMTInterpol SMTInterpol unknown ❌ 1202.74727 1862.64709
STP STP unsat ✅ 15.03208 14.92680
Yices2 Yices2 unsat ✅ 0.32048 0.22099
Z3alpha Z3-alpha unsat ✅ 0.44053 0.34074
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.76752 0.63981
Bitwuzla-MachBV-base unsat ✅ 0.83378 0.70816
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.06023 0.92867
BVDecide bv_decide unknown ❌ 1201.37124 1200.93767
bv_decide-nokernel unknown ❌ 1201.35023 1200.98884
cvc5 cvc5 unsat ✅ 0.95423 0.83549
SMTInterpol SMTInterpol unknown ❌ 1201.79074 2998.36704
Yices2 Yices2 unsat ✅ 0.32259 0.20372
Z3alpha Z3-alpha unsat ✅ 0.66079 0.61457
Z3 Z3-alpha-base unsat ✅ 0.52942 0.40685
Z3-Owl-base unsat ✅ 1.35921 1.23848
z3siri-base unsat ✅ 0.51706 0.38953
Z3-Owl Z3-Owl unsat ✅ 1.06437 0.94129