Benchmark

non-incremental/QF_BV/sage/app7/bench_1434.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1566958
Compressed Size115640
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1566950
Compressed Size115648
Max. Term Depth6009
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1622 and1
=2197 let5952 extract1246 bvand15241
bvor9875 bvxor1447 bvadd16832 bvmul1
bvsub5434 bvult437 bvule474 bvslt204
bvsle99 bvshl5266 bvashr9559 zero_extend959

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.22364 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.27940 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.27566 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.28903 —
abziz_portfolio_2012_solvers default unsat ✅ 0.27820 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.27818 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.30282 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.37476 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.31693 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 145.98300 —
CVC3-SMT-COMP-2011 default unsat ✅ 122.33700 —
CVC3-SMT-COMP-2012 default unsat ✅ 127.75900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.27052 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.11053 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.47724 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45632 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59497 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.58239 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.42105 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.29881 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.83983 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.61762 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.24565 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22256 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22718 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.30439 —
Z3-SMT-COMP-2011 default unsat ✅ 0.27334 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.42548 0.42393
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.11707 3.46347
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.08800 3.41748
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.33903 0.33795
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.90000
STP stp-cryptominisat4 default unsat ✅ 0.21132 0.20997
stp-cmsat4-v15 default unsat ✅ 0.20945 0.20797
stp-cmsat4-mt-v15 default unsat ✅ 0.20932 0.20797
stp-minisat-v15 default unsat ✅ 0.20968 0.20897
Yices2 Yices default unsat ✅ 0.09654 0.09599
Z3 z3 4.4.0 default unsat ✅ 0.30213 0.30195
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89587 0.89543
ABC_glucose glucose unsat ✅ 0.88574 0.88666
Boolector Boolector boolector unsat ✅ 0.53283 0.53306
Boolector preprop boolector unsat ✅ 0.51795 0.51824
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.04405 3.34798
MapleSTP MapleSTP default unsat ✅ 0.20119 0.20127
MapleSTP-mt default unsat ✅ 0.20111 0.20120
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29962 0.30066
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27457 0.27470
Q3B Q3B default unsat ✅ 0.51119 0.51335
STP stp-cms-exp-2016 default unsat ✅ 0.20644 0.20651
stp-cms-mt-2016 default unsat ✅ 0.21047 0.21073
stp-cms-st-2016 default unsat ✅ 0.20919 0.20927
stp-minisat-st-2016 default unsat ✅ 0.20746 0.20767
Yices2 Yices-2.4.2 default unsat ✅ 0.09573 0.09574
Z3 z3-4.4.1 default unsat ✅ 0.28122 0.28280
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.42768 0.42386
Boolector SMT17 final boolector unsat ✅ 0.39118 0.38946
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.05228 3.30169
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.32380 0.32266
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.61003 0.60898
Q3B Q3B default unsat ✅ 0.52361 0.52304
STP stp_st default unsat ✅ 0.26635 0.26521
stp_mt default unsat ✅ 0.28150 0.28078
Yices2 Yices2-Main default unsat ✅ 0.09535 0.09377
Z3 z3-4.5.0 default unsat ✅ 0.30011 0.29904
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.35172 0.35165
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.92518 1.92523
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29880 0.29978
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.61091 0.61070
Minkeyrink ST_st unsat ✅ 0.61227 0.61211
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.25687 0.25689
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.25833 0.25834
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25827 0.25826
Yices2 Yices 2.6.0_default unsat ✅ 0.08841 0.08830
Z3 z3-4.7.1_default unsat ✅ 0.30918 0.30905
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.67480 0.67457
Poolector-wrapped-sq_default unsat ✅ 0.88494 3.12345
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.54297 0.54295
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.95468 1.95452
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.46841 0.46850
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45657 0.45667
Par4 Par4-wrapped-sq_default unsat ✅ 0.09745 0.00590
STP STP-2019-wrapped-sq_default unsat ✅ 0.26732 0.26744
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26683 0.26693
stp-minisat-wrapped-sq_default unsat ✅ 0.26759 0.26771
stp-mt-wrapped-sq_default unsat ✅ 0.26898 0.26908
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.26587 0.26597
stp-riss-wrapped-sq_default unsat ✅ 0.26686 0.26703
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09244 0.09240
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09196 0.09193
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09204 0.09201
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09072 0.09068
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09235 0.09232
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.31107 0.31104
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53833 0.53828
Boolector Boolector-wrapped-sq_default unsat ✅ 0.68610 0.68611
Poolector-wrapped-sq_default unsat ✅ 0.87980 3.12584
CVC4 CVC4-sq-final_default unsat ✅ 2.53553 2.53571
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.37538 0.37531
MathSAT MathSAT5_default.sh unsat ✅ 0.31016 0.31012
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.37994 0.37999
MinkeyRink Solver 2020.3_default unsat ✅ 0.39206 0.39205
STP STP_default unsat ✅ 0.25293 0.25300
STP ++ Mergsat v1_default unsat ✅ 0.24159 0.24330
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.10839 0.10834
Z3 z3-4.8.8_default unsat ✅ 0.30556 0.30546
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53587 0.53586
Bitwuzla-wrapped_default unsat ✅ 0.56831 0.56831
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.93546 1.93598
MathSAT MathSAT-5.6.8_default unsat ✅ 0.33321 0.33313
STP STP 2022.4_default unsat ✅ 0.27167 0.27171
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.10946 0.10944
Z3++BV z3++bv_0702_default unsat ✅ 0.28078 0.28072
Z3 z3-4.8.17_default unsat ✅ 0.25983 0.26164
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.93353 0.93330
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.42040 1.42085
STP STP 2022.4_default unsat ✅ 0.27149 0.27151
STP 2022.4_default unsat ✅ 0.27096 0.27099
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 481.26500 544.02100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10581 0.10577
Z3-Owl z3-Owl-Final_default unsat ✅ 0.95126 0.94683
z3-Owl-Final_default unsat ✅ 0.89585 0.89617
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.59707 0.49720
cvc5 cvc5 unsat ✅ 0.70526 0.60384
SMTInterpol SMTInterpol unsat ✅ 1064.22501 1539.82760
STP STP unsat ✅ 7.57651 7.47346
Yices2 Yices2 unsat ✅ 0.30481 0.20490
Z3alpha Z3-alpha unsat ✅ 0.46219 0.36136