Benchmark

non-incremental/QF_BV/sage/app7/bench_696.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3107070
Compressed Size192890
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3107062
Compressed Size192896
Max. Term Depth11913
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1880 and1
=2515 let11808 extract1371 bvand32417
bvor21374 bvxor1648 bvadd34315 bvmul1
bvsub11132 bvult453 bvule505 bvslt210
bvsle110 bvshl10951 bvashr20809 zero_extend1092

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46492 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50718 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50718 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51642 —
abziz_portfolio_2012_solvers default unsat ✅ 0.51651 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50577 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.63229 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.75087 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.66807 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 296.46900 —
CVC3-SMT-COMP-2011 default unsat ✅ 248.37000 —
CVC3-SMT-COMP-2012 default unsat ✅ 259.24100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.69826 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.09673 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.93559 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.89232 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.16298 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.13150 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.82074 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.70538 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.82250 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.26935 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49290 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46610 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49048 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54947 —
Z3-SMT-COMP-2011 default unsat ✅ 0.50077 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.91203 0.91086
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.06821 6.59400
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.04443 6.56900
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65446 0.65390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.86000
STP stp-cryptominisat4 default unsat ✅ 0.44318 0.44193
stp-cmsat4-v15 default unsat ✅ 0.43739 0.43693
stp-cmsat4-mt-v15 default unsat ✅ 0.43690 0.43593
stp-minisat-v15 default unsat ✅ 0.43300 0.43193
Yices2 Yices default unsat ✅ 0.17924 0.17797
Z3 z3 4.4.0 default unsat ✅ 0.54059 0.54092
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.77965 1.75292
ABC_glucose glucose unsat ✅ 1.74616 1.74771
Boolector Boolector boolector unsat ✅ 1.11528 1.11607
Boolector preprop boolector unsat ✅ 1.08447 2.10498
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.03877 6.57107
MapleSTP MapleSTP default unsat ✅ 0.41659 0.41676
MapleSTP-mt default unsat ✅ 0.41499 0.41520
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.59905 0.60038
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.58709 0.58735
Q3B Q3B default unsat ✅ 0.83166 2.16000
STP stp-cms-exp-2016 default unsat ✅ 0.42345 0.42379
stp-cms-mt-2016 default unsat ✅ 0.42991 0.43013
stp-cms-st-2016 default unsat ✅ 0.43133 0.43154
stp-minisat-st-2016 default unsat ✅ 0.43569 0.43620
Yices2 Yices-2.4.2 default unsat ✅ 0.17875 0.17882
Z3 z3-4.4.1 default unsat ✅ 0.64367 0.64520
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.82983 0.82906
Boolector SMT17 final boolector unsat ✅ 0.82386 0.82291
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.12045 6.61607
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.62305 0.62251
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.23024 1.22841
Q3B Q3B default unsat ✅ 0.76957 1.73000
STP stp_st default unsat ✅ 0.55621 0.55612
stp_mt default unsat ✅ 0.55606 0.55341
Yices2 Yices2-Main default unsat ✅ 0.17370 0.17293
Z3 z3-4.5.0 default unsat ✅ 0.57269 0.57063
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.74496 0.74489
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.70736 3.70762
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59668 0.59757
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.18810 1.18809
Minkeyrink ST_st unsat ✅ 1.18745 1.18753
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.54221 0.54231
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54204 0.54202
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.54223 0.54222
Yices2 Yices 2.6.0_default unsat ✅ 0.16204 0.16196
Z3 z3-4.7.1_default unsat ✅ 0.60107 0.60086
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.44237 1.44228
Poolector-wrapped-sq_default unsat ✅ 1.72801 6.37000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.16454 1.16424
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.82226 3.82175
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.82678 0.82690
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.82798 0.82797
Par4 Par4-wrapped-sq_default unsat ✅ 0.17011 0.00600
STP STP-2019-wrapped-sq_default unsat ✅ 0.54880 0.54891
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.54702 0.54712
stp-minisat-wrapped-sq_default unsat ✅ 0.55145 0.54913
stp-mt-wrapped-sq_default unsat ✅ 0.54195 0.54196
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.54321 0.54336
stp-riss-wrapped-sq_default unsat ✅ 0.54812 0.54825
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16833 0.16831
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16717 0.16712
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16790 0.16788
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16605 0.16606
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16801 0.16798
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.58539 0.58529
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14091 2.21068
Boolector Boolector-wrapped-sq_default unsat ✅ 1.42333 1.42324
Poolector-wrapped-sq_default unsat ✅ 1.78155 6.55414
CVC4 CVC4-sq-final_default unsat ✅ 5.06487 5.06507
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.73770 0.73763
MathSAT MathSAT5_default.sh unsat ✅ 0.61854 0.61849
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.68673 0.68687
MinkeyRink Solver 2020.3_default unsat ✅ 0.70722 0.70729
STP STP_default unsat ✅ 0.51361 0.51367
STP ++ Mergsat v1_default unsat ✅ 0.50979 0.51158
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.20297 0.20289
Z3 z3-4.8.8_default unsat ✅ 0.54255 0.54248
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14841 1.14836
MathSAT mathsat-5.6.6_default unsat ✅ 0.62620 0.62613
STP STP 2021.0_default unsat ✅ 0.52913 0.52921
Z3 z3-4.8.11_default unsat ✅ 0.62648 0.62331
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.87028 1.87026
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.82299 2.82305
STP STP 2022.4_default unsat ✅ 0.56377 0.56375
STP 2022.4_default unsat ✅ 0.58736 0.58731
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 734.17000 848.59400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19623 0.19618
Z3-Owl z3-Owl-Final_default unsat ✅ 1.02889 1.02895
z3-Owl-Final_default unsat ✅ 1.02714 1.02740
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.53269 1.43327
cvc5 cvc5 unsat ✅ 1.70865 1.60877
SMTInterpol SMTInterpol unknown ❌ 1202.74516 1578.50993
STP STP unsat ✅ 27.72038 27.61896
Yices2 Yices2 unsat ✅ 0.34905 0.24921
Z3alpha Z3-alpha unsat ✅ 0.61760 0.51854
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.90120 0.77449
Bitwuzla-MachBV-base unsat ✅ 1.08319 0.95598
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.21825 1.08547
BVDecide bv_decide unknown ❌ 1201.34945 1201.00263
bv_decide-nokernel unknown ❌ 1201.38949 1201.01241
cvc5 cvc5 unsat ✅ 0.80109 0.68423
SMTInterpol SMTInterpol unknown ❌ 1201.88751 2469.57006
Yices2 Yices2 unsat ✅ 0.37893 0.25678
Z3alpha Z3-alpha unsat ✅ 0.94672 0.92766
Z3 Z3-alpha-base unsat ✅ 0.50418 0.39154
Z3-Owl-base unsat ✅ 1.44309 1.31407
z3siri-base unsat ✅ 0.54846 0.42372
Z3-Owl Z3-Owl unsat ✅ 1.07146 0.93358