Benchmark

non-incremental/QF_BV/sage/app7/bench_985.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2462806
Compressed Size159321
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2462798
Compressed Size159325
Max. Term Depth9464
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1777 and1
=2385 let9365 extract1300 bvand25321
bvor16615 bvxor1541 bvadd27078 bvmul1
bvsub8746 bvult442 bvule487 bvslt206
bvsle104 bvshl8581 bvashr16161 zero_extend1024

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37090 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.35976 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.38044 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.36333 —
abziz_portfolio_2012_solvers default unsat ✅ 0.35970 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.36162 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.50365 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58136 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.52831 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 117.00800 —
CVC3-SMT-COMP-2011 default unsat ✅ 98.95250 —
CVC3-SMT-COMP-2012 default unsat ✅ 103.48100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.04586 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.17473 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.75982 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.72529 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93031 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90906 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.64524 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.16123 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.60499 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01257 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39523 —
STP2-SMT-COMP-2012 default unsat ✅ 0.37540 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.37914 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.38965 —
Z3-SMT-COMP-2011 default unsat ✅ 0.35580 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.71844 0.71789
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.25019 5.24920
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.20872 5.19021
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50269 0.50192
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.58000
STP stp-cryptominisat4 default unsat ✅ 0.35110 0.34995
stp-cmsat4-v15 default unsat ✅ 0.35084 0.34995
stp-cmsat4-mt-v15 default unsat ✅ 0.35058 0.34995
stp-minisat-v15 default unsat ✅ 0.35095 0.34995
Yices2 Yices default unsat ✅ 0.14401 0.14298
Z3 z3 4.4.0 default unsat ✅ 0.38167 0.38194
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.42252 1.42276
ABC_glucose glucose unsat ✅ 1.42036 1.42223
Boolector Boolector boolector unsat ✅ 0.81446 0.81490
Boolector preprop boolector unsat ✅ 0.79272 0.79298
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.16858 5.12996
MapleSTP MapleSTP default unsat ✅ 0.34044 0.34060
MapleSTP-mt default unsat ✅ 0.33563 0.33582
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.45525 0.45639
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45426 0.45446
Q3B Q3B default unsat ✅ 0.69893 1.69000
STP stp-cms-exp-2016 default unsat ✅ 0.34243 0.34259
stp-cms-mt-2016 default unsat ✅ 0.36009 0.36043
stp-cms-st-2016 default unsat ✅ 0.36063 0.36076
stp-minisat-st-2016 default unsat ✅ 0.34828 0.34841
Yices2 Yices-2.4.2 default unsat ✅ 0.14293 0.14291
Z3 z3-4.4.1 default unsat ✅ 0.40316 0.40544
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.69505 0.69257
Boolector SMT17 final boolector unsat ✅ 0.66591 0.66333
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.14189 5.02281
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.46287 0.46259
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.93560 0.93561
Q3B Q3B default unsat ✅ 0.67592 1.68000
STP stp_st default unsat ✅ 0.49797 0.49592
stp_mt default unsat ✅ 0.46689 0.46664
Yices2 Yices2-Main default unsat ✅ 0.13706 0.13615
Z3 z3-4.5.0 default unsat ✅ 0.39778 0.39551
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.59007 0.58993
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.88761 2.88752
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.44955 0.45059
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.95324 0.95319
Minkeyrink ST_st unsat ✅ 0.94959 0.94953
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43230 0.43236
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43247 0.43244
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.42835 0.42843
Yices2 Yices 2.6.0_default unsat ✅ 0.12991 0.12987
Z3 z3-4.7.1_default unsat ✅ 0.42539 0.42525
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.91526 0.91134
MathSAT mathsat-5.6.6_default unsat ✅ 0.47602 0.47592
STP STP 2021.0_default unsat ✅ 0.41995 0.42001
Z3 z3-4.8.11_default unsat ✅ 0.37016 0.37010
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.35081 1.35076
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.29969 2.29953
STP STP 2022.4_default unsat ✅ 0.44175 0.44173
STP 2022.4_default unsat ✅ 0.44863 0.44859
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 604.75900 692.97600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.15847 0.15843
Z3-Owl z3-Owl-Final_default unsat ✅ 1.03901 1.03873
z3-Owl-Final_default unsat ✅ 1.04425 1.04453
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.90340 0.80281
cvc5 cvc5 unsat ✅ 0.79542 0.69579
SMTInterpol SMTInterpol unknown ❌ 1202.74870 1719.47184
STP STP unsat ✅ 17.14090 17.04067
Yices2 Yices2 unsat ✅ 0.32187 0.22211
Z3alpha Z3-alpha unsat ✅ 0.45669 0.35732