Benchmark

non-incremental/QF_BV/sage/app7/bench_978.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2463884
Compressed Size159410
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2463876
Compressed Size159416
Max. Term Depth9490
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1777 and1
=2389 let9391 extract1306 bvand25324
bvor16615 bvxor1548 bvadd27081 bvmul1
bvsub8747 bvult442 bvule489 bvslt206
bvsle104 bvshl8583 bvashr16161 zero_extend1027

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.36948 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.39686 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39796 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.39736 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40063 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.39781 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.49900 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58152 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.53130 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 117.06800 —
CVC3-SMT-COMP-2011 default unsat ✅ 99.02240 —
CVC3-SMT-COMP-2012 default unsat ✅ 103.52500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.04196 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.17308 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.75091 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.72739 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93383 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90853 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.65485 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.14498 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.59748 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01345 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.38956 —
STP2-SMT-COMP-2012 default unsat ✅ 0.36973 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.38226 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.39966 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39711 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.72480 0.72389
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.23612 5.22820
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.21585 5.20321
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50569 0.50492
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.74000
STP stp-cryptominisat4 default unsat ✅ 0.35188 0.35095
stp-cmsat4-v15 default unsat ✅ 0.35009 0.34895
stp-cmsat4-mt-v15 default unsat ✅ 0.35019 0.34895
stp-minisat-v15 default unsat ✅ 0.35341 0.35195
Yices2 Yices default unsat ✅ 0.14322 0.14198
Z3 z3 4.4.0 default unsat ✅ 0.42120 0.42094
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.39942 1.39992
ABC_glucose glucose unsat ✅ 1.40538 1.40592
Boolector Boolector boolector unsat ✅ 0.81311 0.81340
Boolector preprop boolector unsat ✅ 0.78973 0.79067
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.17745 5.14460
MapleSTP MapleSTP default unsat ✅ 0.33576 0.33584
MapleSTP-mt default unsat ✅ 0.33466 0.33478
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.45704 0.45783
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45582 0.45608
Q3B Q3B default unsat ✅ 0.67816 1.62000
STP stp-cms-exp-2016 default unsat ✅ 0.34322 0.34339
stp-cms-mt-2016 default unsat ✅ 0.34807 0.34824
stp-cms-st-2016 default unsat ✅ 0.34825 0.34839
stp-minisat-st-2016 default unsat ✅ 0.34688 0.34703
Yices2 Yices-2.4.2 default unsat ✅ 0.14360 0.14366
Z3 z3-4.4.1 default unsat ✅ 0.38855 0.38984
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.64917 0.64888
Boolector SMT17 final boolector unsat ✅ 0.65054 0.64990
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.13850 5.01800
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49293 0.49141
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.94179 0.94113
Q3B Q3B default unsat ✅ 0.70596 1.61000
STP stp_st default unsat ✅ 0.43564 0.42928
stp_mt default unsat ✅ 0.42922 0.42832
Yices2 Yices2-Main default unsat ✅ 0.14052 0.14021
Z3 z3-4.5.0 default unsat ✅ 0.34742 0.34527
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.58742 0.58734
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.95202 2.95197
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.45029 0.45118
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.95088 0.95098
Minkeyrink ST_st unsat ✅ 0.94899 0.94897
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43261 0.43262
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43552 0.43557
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.43232 0.43234
Yices2 Yices 2.6.0_default unsat ✅ 0.13091 0.13086
Z3 z3-4.7.1_default unsat ✅ 0.40929 0.40915
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90469 0.90461
Bitwuzla-wrapped_default unsat ✅ 0.97156 0.97145
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.07588 3.07410
MathSAT MathSAT-5.6.8_default unsat ✅ 0.51175 0.50880
STP STP 2022.4_default unsat ✅ 0.44766 0.44766
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.16571 0.16567
Z3++BV z3++bv_0702_default unsat ✅ 0.34995 0.34983
Z3 z3-4.8.17_default unsat ✅ 0.35664 0.35836
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.03073 0.93125
cvc5 cvc5 unsat ✅ 1.02172 0.92154
SMTInterpol SMTInterpol unknown ❌ 1202.75077 1617.07549
STP STP unsat ✅ 17.74891 17.64436
Yices2 Yices2 unsat ✅ 0.33039 0.23063
Z3alpha Z3-alpha unsat ✅ 0.45439 0.35480
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.78808 0.66085
Bitwuzla-MachBV-base unsat ✅ 0.93561 0.80584
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.11850 0.98844
BVDecide bv_decide unknown ❌ 1201.39163 1200.94273
bv_decide-nokernel unknown ❌ 1201.39125 1200.93397
cvc5 cvc5 unsat ✅ 0.74222 0.61672
SMTInterpol SMTInterpol unknown ❌ 1201.88790 2960.19786
Yices2 Yices2 unsat ✅ 0.37531 0.23942
Z3alpha Z3-alpha unsat ✅ 0.73808 0.70079
Z3 Z3-alpha-base unsat ✅ 0.48240 0.36387
Z3-Owl-base unsat ✅ 1.19887 1.07358
z3siri-base unsat ✅ 0.49781 0.37750
Z3-Owl Z3-Owl unsat ✅ 1.02305 0.89706