Benchmark

non-incremental/QF_BV/sage/app7/bench_1357.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1822320
Compressed Size128105
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1822312
Compressed Size128114
Max. Term Depth7019
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1656 and1
=2240 let6920 extract1256 bvand18143
bvor11821 bvxor1453 bvadd19772 bvmul1
bvsub6367 bvult438 bvule474 bvslt204
bvsle99 bvshl6204 bvashr11448 zero_extend969

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.25700 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.32303 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.31457 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.31544 —
abziz_portfolio_2012_solvers default unsat ✅ 0.31612 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.31536 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.35190 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.42635 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.37302 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 166.03300 —
CVC3-SMT-COMP-2011 default unsat ✅ 139.32200 —
CVC3-SMT-COMP-2012 default unsat ✅ 145.40600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.42947 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.39874 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.54363 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.51902 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.68630 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.66702 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.48392 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.50866 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.34097 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.76552 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.29527 —
STP2-SMT-COMP-2012 default unsat ✅ 0.25751 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26520 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.33948 —
Z3-SMT-COMP-2011 default unsat ✅ 0.30742 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.50079 0.49992
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.45637 4.02239
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.42689 3.97640
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38217 0.38094
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.06000
STP stp-cryptominisat4 default unsat ✅ 0.24753 0.24596
stp-cmsat4-v15 default unsat ✅ 0.25051 0.24996
stp-cmsat4-mt-v15 default unsat ✅ 0.24522 0.24396
stp-minisat-v15 default unsat ✅ 0.24796 0.24696
Yices2 Yices default unsat ✅ 0.10890 0.10798
Z3 z3 4.4.0 default unsat ✅ 0.29420 0.29396
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.04522 1.04593
ABC_glucose glucose unsat ✅ 1.03668 1.03764
Boolector Boolector boolector unsat ✅ 0.62257 0.62311
Boolector preprop boolector unsat ✅ 0.61100 0.61137
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.38028 3.90571
MapleSTP MapleSTP default unsat ✅ 0.23366 0.23418
MapleSTP-mt default unsat ✅ 0.23506 0.23517
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.34599 0.34728
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.33967 0.34004
Q3B Q3B default unsat ✅ 0.56077 1.31000
STP stp-cms-exp-2016 default unsat ✅ 0.23888 0.23900
stp-cms-mt-2016 default unsat ✅ 0.24241 0.24252
stp-cms-st-2016 default unsat ✅ 0.24333 0.24344
stp-minisat-st-2016 default unsat ✅ 0.24301 0.24313
Yices2 Yices-2.4.2 default unsat ✅ 0.10882 0.10881
Z3 z3-4.4.1 default unsat ✅ 0.26744 0.26910
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.46935 0.46814
Boolector SMT17 final boolector unsat ✅ 0.46848 0.46759
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.49745 4.05079
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.41454 0.40314
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.70915 0.70921
Q3B Q3B default unsat ✅ 0.58099 1.39000
STP stp_st default unsat ✅ 0.31544 0.31478
stp_mt default unsat ✅ 0.33883 0.33806
Yices2 Yices2-Main default unsat ✅ 0.10226 0.10223
Z3 z3-4.5.0 default unsat ✅ 0.30146 0.29703
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.40874 0.40863
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.23647 2.23639
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.34075 0.34155
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70803 0.70792
Minkeyrink ST_st unsat ✅ 0.70816 0.70813
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.30195 0.30200
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.30110 0.30114
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.30172 0.30180
Yices2 Yices 2.6.0_default unsat ✅ 0.10239 0.10233
Z3 z3-4.7.1_default unsat ✅ 0.32475 0.32459
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62936 0.62923
Boolector Boolector-wrapped-sq_default unsat ✅ 0.79331 0.79332
Poolector-wrapped-sq_default unsat ✅ 0.98321 3.50000
CVC4 CVC4-sq-final_default unsat ✅ 2.96886 2.96883
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.43069 0.43059
MathSAT MathSAT5_default.sh unsat ✅ 0.35370 0.35360
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.43182 0.43185
MinkeyRink Solver 2020.3_default unsat ✅ 0.44440 0.44446
STP STP_default unsat ✅ 0.28838 0.28851
STP ++ Mergsat v1_default unsat ✅ 0.28391 0.28557
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12351 0.12343
Z3 z3-4.8.8_default unsat ✅ 0.23227 0.23222
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62566 0.62563
Bitwuzla-wrapped_default unsat ✅ 0.67020 0.67020
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.24089 2.24127
MathSAT MathSAT-5.6.8_default unsat ✅ 0.36352 0.36344
STP STP 2022.4_default unsat ✅ 0.33300 0.33304
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.12462 0.12458
Z3++BV z3++bv_0702_default unsat ✅ 0.38945 0.38938
Z3 z3-4.8.17_default unsat ✅ 0.37341 0.37275
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.74960 0.64933
cvc5 cvc5 unsat ✅ 0.54520 0.44533
SMTInterpol SMTInterpol unsat ✅ 1057.88777 1553.44510
STP STP unsat ✅ 9.48446 9.38445
Yices2 Yices2 unsat ✅ 0.30012 0.20046
Z3alpha Z3-alpha unsat ✅ 0.42448 0.32464
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.64716 0.52221
Bitwuzla-MachBV-base unsat ✅ 0.75429 0.62638
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.87511 0.74698
BVDecide bv_decide unsat ✅ 663.86943 663.63236
bv_decide-nokernel unsat ✅ 584.51789 584.27832
cvc5 cvc5 unsat ✅ 0.77667 0.65433
SMTInterpol SMTInterpol unknown ❌ 1201.91059 3009.91959
Yices2 Yices2 unsat ✅ 0.34947 0.23095
Z3alpha Z3-alpha unsat ✅ 0.71074 0.63184
Z3 Z3-alpha-base unsat ✅ 0.41870 0.29576
Z3-Owl-base unsat ✅ 0.82555 0.69652
z3siri-base unsat ✅ 0.41178 0.28388
Z3-Owl Z3-Owl unsat ✅ 0.93186 0.80654