Benchmark

non-incremental/QF_BV/Sage2/bench_1383.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2936
Compressed Size712
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2928
Compressed Size710
Max. Term Depth34
Asserts 3
Declared Functions0
Declared Constants2
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 let58 bvadd32 bvmul6
bvslt1 bvsge1 bvshl4 bvashr8
zero_extend8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.66270 0.66190
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.22191 0.42793
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19017 0.36594
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.11322 0.11198
SMT-RAT SMT-RAT-final default unsat ✅ 54.99690 55.01760
STP stp-cryptominisat4 default unsat ✅ 0.04373 0.04299
stp-cmsat4-v15 default unsat ✅ 0.03675 0.03599
stp-cmsat4-mt-v15 default unknown ❌ 0.04077 0.03999
stp-minisat-v15 default unsat ✅ 0.03400 0.03299
Yices2 Yices default unsat ✅ 0.22513 0.22396
Z3 z3 4.4.0 default unsat ✅ 1.29654 1.29680
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 2.02270 2.02409
ABC_glucose glucose unsat ✅ 0.86556 0.86616
Boolector Boolector boolector unsat ✅ 1.25322 1.25392
Boolector preprop boolector unsat ✅ 1.24878 1.24956
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.18922 0.36618
MapleSTP MapleSTP default unsat ✅ 0.03485 0.03482
MapleSTP-mt default unsat ✅ 0.03882 0.08527
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.10084 0.10186
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.12922 0.16675
Q3B Q3B default unsat ✅ 0.07291 0.07365
STP stp-cms-exp-2016 default unsat ✅ 0.03708 0.03706
stp-cms-mt-2016 default unsat ✅ 0.03720 0.08038
stp-cms-st-2016 default unsat ✅ 0.03363 0.03359
stp-minisat-st-2016 default unsat ✅ 0.05261 0.05260
Yices2 Yices-2.4.2 default unsat ✅ 0.03965 0.03963
Z3 z3-4.4.1 default unsat ✅ 1.29243 1.29457
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.40946 0.40713
Boolector SMT17 final boolector unsat ✅ 1.29787 1.29552
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.19466 0.37434
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.11531 0.11567
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.09536 0.06968
Q3B Q3B default unknown ❌ 0.09015 0.09185
STP stp_st default unsat ✅ 0.13547 0.04612
stp_mt default unsat ✅ 0.05129 0.08132
Yices2 Yices2-Main default unsat ✅ 0.03293 0.03289
Z3 z3-4.5.0 default unsat ✅ 0.61493 0.61445
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.40260 0.40253
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.19184 0.19203
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.11478 0.11444
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05065 0.06810
Minkeyrink ST_st unsat ✅ 0.04744 0.04765
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.02987 0.03002
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.03867 0.05617
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.09629 0.09636
Yices2 Yices 2.6.0_default unsat ✅ 0.03337 0.03332
Z3 z3-4.7.1_default unsat ✅ 2.08638 2.08623
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.39922 0.39924
Poolector-wrapped-sq_default unsat ✅ 0.48081 0.49655
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20616 1.20620
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.36418 0.36434
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04727 0.06125
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04359 0.04369
Par4 Par4-wrapped-sq_default unsat ✅ 0.05325 0.00920
STP STP-2019-wrapped-sq_default unsat ✅ 0.03668 0.03696
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.34539 0.34499
stp-minisat-wrapped-sq_default unsat ✅ 0.03228 0.03249
stp-mt-wrapped-sq_default unsat ✅ 0.04180 0.05665
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.38945 0.41576
stp-riss-wrapped-sq_default unknown ❌ 0.02734 0.02758
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04422 0.04422
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04372 0.04372
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04465 0.04464
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 5.64561 5.64587
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05427 0.05428
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.05912 1.05913
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41771 0.41762
Boolector Boolector-wrapped-sq_default unsat ✅ 0.32632 0.32635
Poolector-wrapped-sq_default unsat ✅ 0.49040 0.46754
CVC4 CVC4-sq-final_default unsat ✅ 0.20110 0.20145
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.14477 0.14471
MathSAT MathSAT5_default.sh unsat ✅ 0.05855 0.05851
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04116 0.04137
MinkeyRink Solver 2020.3_default unsat ✅ 0.04655 0.06249
STP STP_default unsat ✅ 0.03254 0.04962
STP ++ Mergsat v1_default unsat ✅ 0.02309 0.02474
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.16928 0.16921
Z3 z3-4.8.8_default unsat ✅ 1.50578 1.50554
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41703 0.41699
MathSAT mathsat-5.6.6_default unsat ✅ 0.05714 0.05705
STP STP 2021.0_default unsat ✅ 0.03308 0.04996
Z3 z3-4.8.11_default unsat ✅ 2.01951 2.01954
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41995 0.41987
Bitwuzla-wrapped_default unsat ✅ 0.36029 0.36024
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19535 0.19592
MathSAT MathSAT-5.6.8_default unsat ✅ 0.05785 0.05779
STP STP 2022.4_default unsat ✅ 0.03241 0.03247
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.17227 0.17222
Z3++BV z3++bv_0702_default unsat ✅ 0.95735 0.95731
Z3 z3-4.8.17_default unsat ✅ 5.56170 5.56335
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.25454 0.15444
cvc5 cvc5 unsat ✅ 0.41236 0.31213
SMTInterpol SMTInterpol unsat ✅ 740.56535 761.10527
STP STP unsat ✅ 0.30891 0.20773
Yices2 Yices2 unsat ✅ 0.35288 0.25197
Z3alpha Z3-alpha unsat ✅ 4.93170 4.83138