Benchmark

non-incremental/QF_BV/sage/app7/bench_727.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3073361
Compressed Size190734
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3073353
Compressed Size190739
Max. Term Depth11785
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1869 and1
=2503 let11680 extract1359 bvand32068
bvor21141 bvxor1629 bvadd33949 bvmul1
bvsub11003 bvult447 bvule504 bvslt210
bvsle106 bvshl10824 bvashr20572 zero_extend1079

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46277 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.51184 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51244 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50261 —
abziz_portfolio_2012_solvers default unsat ✅ 0.52425 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50438 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.63680 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.74244 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65629 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.00000 —
CVC3-SMT-COMP-2011 default unsat ✅ 128.51700 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.39100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.67961 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.05253 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.92408 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.91622 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.15504 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.13690 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.79582 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.70225 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.76939 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.25067 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.48935 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46391 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49385 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.51013 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49726 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.88530 0.88487
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.04674 6.56700
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.01541 6.52801
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65013 0.64890
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.96000
STP stp-cryptominisat4 default unsat ✅ 0.43512 0.43393
stp-cmsat4-v15 default unsat ✅ 0.43094 0.42993
stp-cmsat4-mt-v15 default unsat ✅ 0.43473 0.43393
stp-minisat-v15 default unsat ✅ 0.42886 0.42793
Yices2 Yices default unsat ✅ 0.17711 0.17597
Z3 z3 4.4.0 default unsat ✅ 0.53671 0.53692
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.73746 1.73824
ABC_glucose glucose unsat ✅ 1.74310 1.74391
Boolector Boolector boolector unsat ✅ 1.00703 1.00778
Boolector preprop boolector unsat ✅ 0.98066 0.98125
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.95591 6.43399
MapleSTP MapleSTP default unsat ✅ 0.41296 0.41320
MapleSTP-mt default unsat ✅ 0.41255 0.41282
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.58428 0.58560
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.57115 0.57146
Q3B Q3B default unsat ✅ 0.82041 2.04000
STP stp-cms-exp-2016 default unsat ✅ 0.42443 0.42463
stp-cms-mt-2016 default unsat ✅ 0.42685 0.42708
stp-cms-st-2016 default unsat ✅ 0.42640 0.42661
stp-minisat-st-2016 default unsat ✅ 0.46990 0.47014
Yices2 Yices-2.4.2 default unsat ✅ 0.17639 0.17646
Z3 z3-4.4.1 default unsat ✅ 0.58431 0.58594
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.81716 0.81534
Boolector SMT17 final boolector unsat ✅ 0.81605 0.81511
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.96433 6.36776
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.60415 0.60346
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.16053 1.15284
Q3B Q3B default unsat ✅ 0.76194 1.82000
STP stp_st default unsat ✅ 0.53232 0.53096
stp_mt default unsat ✅ 0.52768 0.52262
Yices2 Yices2-Main default unsat ✅ 0.16641 0.16634
Z3 z3-4.5.0 default unsat ✅ 0.51199 0.51043
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.72753 0.72738
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.64379 3.63723
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59071 0.59180
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.17512 1.17495
Minkeyrink ST_st unsat ✅ 1.17567 1.17574
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.53633 0.53631
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.53620 0.53620
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.53400 0.53404
Yices2 Yices 2.6.0_default unsat ✅ 0.16254 0.16243
Z3 z3-4.7.1_default unsat ✅ 0.53915 0.53892
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.37103 1.37097
Poolector-wrapped-sq_default unsat ✅ 1.69088 6.15352
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.13034 1.13025
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.82320 3.82332
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.82133 0.82142
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.82068 0.82068
Par4 Par4-wrapped-sq_default unsat ✅ 0.17296 0.00616
STP STP-2019-wrapped-sq_default unsat ✅ 0.54638 0.54654
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.53967 0.53985
stp-minisat-wrapped-sq_default unsat ✅ 0.54688 0.54693
stp-mt-wrapped-sq_default unsat ✅ 0.54623 0.54636
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.54080 0.54087
stp-riss-wrapped-sq_default unsat ✅ 0.54590 0.54605
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16976 0.16969
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16703 0.16698
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16791 0.16789
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16828 0.16828
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16738 0.16740
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54801 0.54799
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13831 1.13807
Boolector Boolector-wrapped-sq_default unsat ✅ 1.36811 1.36822
Poolector-wrapped-sq_default unsat ✅ 1.59145 5.84624
CVC4 CVC4-sq-final_default unsat ✅ 4.94947 4.94935
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.73707 0.73697
MathSAT MathSAT5_default.sh unsat ✅ 0.60421 0.60417
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.68079 0.68088
MinkeyRink Solver 2020.3_default unsat ✅ 0.70293 0.70281
STP STP_default unsat ✅ 0.50717 0.50730
STP ++ Mergsat v1_default unsat ✅ 0.50422 0.50599
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.20023 0.20014
Z3 z3-4.8.8_default unsat ✅ 0.39349 0.39348
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13628 1.13616
MathSAT mathsat-5.6.6_default unsat ✅ 0.62003 0.61999
STP STP 2021.0_default unsat ✅ 0.52128 0.52128
Z3 z3-4.8.11_default unsat ✅ 0.43377 0.43369
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.15584 1.15571
Bitwuzla-wrapped_default unsat ✅ 1.22552 1.22544
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.84607 3.84642
MathSAT MathSAT-5.6.8_default unsat ✅ 0.64492 0.64438
STP STP 2022.4_default unsat ✅ 0.58072 0.58062
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20342 0.20333
Z3++BV z3++bv_0702_default unsat ✅ 0.44687 0.44677
Z3 z3-4.8.17_default unsat ✅ 0.45386 0.45594
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.76211 1.76213
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.83842 2.83437
STP STP 2022.4_default unsat ✅ 0.61547 0.61217
STP 2022.4_default unsat ✅ 0.57486 0.57378
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 724.01700 822.45900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19552 0.19549
Z3-Owl z3-Owl-Final_default unsat ✅ 1.08399 1.08392
z3-Owl-Final_default unsat ✅ 1.09138 1.09173