Benchmark

non-incremental/QF_BV/sage/app9/bench_272.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size32883
Compressed Size5820
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 32875
Compressed Size5844
Max. Term Depth87
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not91 and1
=149 let77 extract1 bvand3
bvor63 bvadd267 bvmul11 bvsub80
bvult66 bvule181 bvslt4 bvsle9
bvshl69 zero_extend146 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37885 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.77744 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.76153 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.76592 —
abziz_portfolio_2012_solvers default unsat ✅ 0.76430 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.76505 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 1.41128 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.89917 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.35877 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.21873 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.32160 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.07764 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.13700 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.08478 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.07650 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.12084 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.47492 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.47297 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.17700 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12549 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22922 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.83025 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.73680 —
Z3-SMT-COMP-2011 default unsat ✅ 0.75628 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.62667 0.62590
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.41271 0.79288
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.39415 0.75588
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.22683 0.22596
SMT-RAT SMT-RAT-final default unsat ✅ 67.57220 67.59870
STP stp-cryptominisat4 default unsat ✅ 0.21051 0.20997
stp-cmsat4-v15 default unsat ✅ 0.18986 0.18897
stp-cmsat4-mt-v15 default unknown ❌ 0.13917 0.13798
stp-minisat-v15 default unsat ✅ 0.16406 0.16297
Yices2 Yices default unsat ✅ 0.02045 0.01900
Z3 z3 4.4.0 default unsat ✅ 1.01427 1.01484
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.41455 0.41454
ABC_glucose glucose unsat ✅ 2.59350 2.59484
Boolector Boolector boolector unsat ✅ 0.59739 0.59769
Boolector preprop boolector unsat ✅ 0.60399 0.60417
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.41124 0.79205
MapleSTP MapleSTP default unsat ✅ 0.18709 0.18718
MapleSTP-mt default unsat ✅ 0.20464 0.48666
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.21153 0.21259
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.74286 1.11237
Q3B Q3B default unknown ❌ 2400.09000 7203.29000
STP stp-cms-exp-2016 default unsat ✅ 0.22933 0.22944
stp-cms-mt-2016 default unsat ✅ 0.21848 0.54102
stp-cms-st-2016 default unsat ✅ 0.20189 0.20256
stp-minisat-st-2016 default unsat ✅ 0.50394 0.50417
Yices2 Yices-2.4.2 default unsat ✅ 0.03026 0.03024
Z3 z3-4.4.1 default unsat ✅ 0.78190 0.78359
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.30261 0.30184
Boolector SMT17 final boolector unsat ✅ 0.69575 0.69479
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.41839 0.80398
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.20409 0.20405
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.29564 0.28677
Q3B Q3B default unknown ❌ 600.05700 1785.82000
STP stp_st default unsat ✅ 0.51675 0.51421
stp_mt default unsat ✅ 0.55206 1.69672
Yices2 Yices2-Main default unsat ✅ 0.02250 0.02138
Z3 z3-4.5.0 default unsat ✅ 0.65713 0.65033
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.12621 0.12606
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.58676 0.58694
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.19783 0.19889
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19469 0.37004
Minkeyrink ST_st unsat ✅ 0.17904 0.17928
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.72563 0.72553
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.72924 2.45967
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.91636 0.91637
Yices2 Yices 2.6.0_default unsat ✅ 0.03715 0.03709
Z3 z3-4.7.1_default unsat ✅ 0.76923 0.76920
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.19595 0.19593
Boolector Boolector-wrapped-sq_default unsat ✅ 0.29617 0.29614
Poolector-wrapped-sq_default unsat ✅ 0.28666 0.21418
CVC4 CVC4-sq-final_default unsat ✅ 0.35870 0.35896
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 20.87640 20.87480
MathSAT MathSAT5_default.sh unsat ✅ 0.08576 0.08567
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.13394 0.13419
MinkeyRink Solver 2020.3_default unsat ✅ 0.19820 0.37733
STP STP_default unsat ✅ 0.32840 0.95681
STP ++ Mergsat v1_default unsat ✅ 0.18438 0.18606
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02478 0.02475
Z3 z3-4.8.8_default unsat ✅ 0.57849 0.57840
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.19919 0.19916
Bitwuzla-wrapped_default unsat ✅ 0.29483 0.29480
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26789 0.26846
MathSAT MathSAT-5.6.8_default unsat ✅ 0.08709 0.08702
STP STP 2022.4_default unsat ✅ 0.16514 0.16517
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04045 0.04041
Z3++BV z3++bv_0702_default unsat ✅ 0.69223 0.69212
Z3 z3-4.8.17_default unsat ✅ 0.46129 0.46306