Benchmark

non-incremental/QF_BV/sage/app7/bench_1034.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2457686
Compressed Size158534
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2457678
Compressed Size158539
Max. Term Depth9472
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1768 and1
=2374 let9373 extract1296 bvand25264
bvor16570 bvxor1538 bvadd27014 bvmul1
bvsub8735 bvult443 bvule486 bvslt206
bvsle104 bvshl8568 bvashr16141 zero_extend1019

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.36522 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.39645 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40595 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40086 —
abziz_portfolio_2012_solvers default unsat ✅ 0.39676 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40078 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.50026 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58105 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.52593 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 211.43100 —
CVC3-SMT-COMP-2011 default unsat ✅ 177.39900 —
CVC3-SMT-COMP-2012 default unsat ✅ 185.29100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.05339 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.18559 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.74938 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.72570 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.92837 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90773 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.64611 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.15571 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.58660 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.00844 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39049 —
STP2-SMT-COMP-2012 default unsat ✅ 0.37048 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.37755 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.45802 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39117 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.72134 0.72089
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.22606 5.20721
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.21700 5.20821
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.49831 0.49792
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.56000
STP stp-cryptominisat4 default unsat ✅ 0.35161 0.35095
stp-cmsat4-v15 default unsat ✅ 0.35033 0.34895
stp-cmsat4-mt-v15 default unsat ✅ 0.35361 0.35295
stp-minisat-v15 default unsat ✅ 0.34920 0.34795
Yices2 Yices default unsat ✅ 0.14375 0.14298
Z3 z3 4.4.0 default unsat ✅ 0.52492 0.52492
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.40779 1.40858
ABC_glucose glucose unsat ✅ 1.39971 1.40120
Boolector Boolector boolector unsat ✅ 0.81047 0.81078
Boolector preprop boolector unsat ✅ 0.78919 0.78958
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.16210 5.11863
MapleSTP MapleSTP default unsat ✅ 0.33419 0.33431
MapleSTP-mt default unsat ✅ 0.33380 0.33393
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.45057 0.45187
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45378 0.45396
Q3B Q3B default unsat ✅ 0.68607 1.71000
STP stp-cms-exp-2016 default unsat ✅ 0.34083 0.34102
stp-cms-mt-2016 default unsat ✅ 0.34655 0.34656
stp-cms-st-2016 default unsat ✅ 0.34927 0.34998
stp-minisat-st-2016 default unsat ✅ 0.34749 0.34763
Yices2 Yices-2.4.2 default unsat ✅ 0.14345 0.14351
Z3 z3-4.4.1 default unsat ✅ 0.51177 0.51335
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.65793 0.65363
Boolector SMT17 final boolector unsat ✅ 0.67815 0.67623
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.16528 5.05163
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.48170 0.48320
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.93742 0.93467
Q3B Q3B default unsat ✅ 0.66943 1.67000
STP stp_st default unsat ✅ 0.43710 0.43282
stp_mt default unsat ✅ 0.42202 0.42127
Yices2 Yices2-Main default unsat ✅ 0.13693 0.13604
Z3 z3-4.5.0 default unsat ✅ 0.40231 0.40133
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.58927 0.58924
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.93759 2.93770
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.44825 0.44919
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.95178 0.95183
Minkeyrink ST_st unsat ✅ 0.94936 0.94935
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43123 0.43128
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43216 0.43219
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.43231 0.43237
Yices2 Yices 2.6.0_default unsat ✅ 0.12998 0.12992
Z3 z3-4.7.1_default unsat ✅ 0.40442 0.40425
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90052 0.90030
Boolector Boolector-wrapped-sq_default unsat ✅ 1.09298 1.09285
Poolector-wrapped-sq_default unsat ✅ 1.39015 4.93882
CVC4 CVC4-sq-final_default unsat ✅ 3.96645 3.96569
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.57627 0.57623
MathSAT MathSAT5_default.sh unsat ✅ 0.46086 0.46084
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.55788 0.55790
MinkeyRink Solver 2020.3_default unsat ✅ 0.57898 0.57906
STP STP_default unsat ✅ 0.40454 0.40461
STP ++ Mergsat v1_default unsat ✅ 0.40307 0.40481
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.16305 0.16287
Z3 z3-4.8.8_default unsat ✅ 0.32323 0.32311
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.98251 0.98241
Bitwuzla-wrapped_default unsat ✅ 0.97182 0.97171
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.07774 3.07748
MathSAT MathSAT-5.6.8_default unsat ✅ 0.48118 0.48105
STP STP 2022.4_default unsat ✅ 0.44985 0.44985
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.16387 0.16383
Z3++BV z3++bv_0702_default unsat ✅ 0.44437 0.44433
Z3 z3-4.8.17_default unsat ✅ 0.42067 0.42248
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.31914 1.31905
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.29327 4.47054
STP STP 2022.4_default unsat ✅ 0.44167 0.44171
STP 2022.4_default unsat ✅ 0.44337 0.44333
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 589.61300 676.95200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.15756 0.15747
Z3-Owl z3-Owl-Final_default unsat ✅ 0.99251 0.99261
z3-Owl-Final_default unsat ✅ 1.00206 1.00220
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.94466 0.84289
cvc5 cvc5 unsat ✅ 0.79411 0.69410
SMTInterpol SMTInterpol unknown ❌ 1202.74532 1720.08334
STP STP unsat ✅ 23.14739 23.04666
Yices2 Yices2 unsat ✅ 0.31477 0.21486
Z3alpha Z3-alpha unsat ✅ 0.45280 0.35299
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.77801 0.64701
Bitwuzla-MachBV-base unsat ✅ 0.94710 0.81744
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.06077 0.93212
BVDecide bv_decide unknown ❌ 1201.38883 1200.91805
bv_decide-nokernel unknown ❌ 1201.38620 1201.02872
cvc5 cvc5 unsat ✅ 0.65840 0.53823
SMTInterpol SMTInterpol unknown ❌ 1201.85510 2756.33631
Yices2 Yices2 unsat ✅ 0.35088 0.22433
Z3alpha Z3-alpha unsat ✅ 0.75620 0.70521
Z3 Z3-alpha-base unsat ✅ 0.50174 0.37622
Z3-Owl-base unsat ✅ 1.10939 0.98351
z3siri-base unsat ✅ 0.48722 0.36137
Z3-Owl Z3-Owl unsat ✅ 1.02225 0.89117