Benchmark

non-incremental/QF_BV/sage/app7/bench_3636.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4004481
Compressed Size252664
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4004473
Compressed Size252671
Max. Term Depth15359
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2539 and1
=3310 let15159 extract1709 bvand41117
bvor27102 bvxor2276 bvadd44332 bvmul7
bvsub14627 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl14319 bvashr26794
zero_extend1513

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.65642
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.58842
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.59355
abziz_portfolio_2012_minfeatures default unsat ✅ 0.59402
abziz_portfolio_2012_solvers default unsat ✅ 0.59005
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.59601
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.79513
Boolector-SMT-COMP-2011 default unsat ✅ 0.96382
Boolector-SMT-COMP-2012 default unsat ✅ 0.84036
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 214.81900
CVC3-SMT-COMP-2011 default unsat ✅ 181.59600
CVC3-SMT-COMP-2012 default unsat ✅ 189.87900
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.39189
CVC4-SMT-EVAL-2013 default unsat ✅ 5.24862
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.20464
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.14909
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.48936
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.45253
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.05391
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.12009
SONOLAR-SMT-COMP-2011 default unsat ✅ 7.40388
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.68894
STP STP2-SMT-COMP-2011 default unsat ✅ 0.68369
STP2-SMT-COMP-2012 default unsat ✅ 0.65073
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.63316
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.62988
Z3-SMT-COMP-2011 default unsat ✅ 0.58624
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.04352 1.04175
Boolector SMT17 final boolector unsat ✅ 1.05061 1.04872
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.22107 8.42281
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.79064 0.79051
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.51889 1.51694
Q3B Q3B default unsat ✅ 1.05412 2.72000
STP stp_st default unsat ✅ 0.68871 0.68863
stp_mt default unsat ✅ 0.68798 0.68795
Yices2 Yices2-Main default unsat ✅ 0.42963 0.42810
Z3 z3-4.5.0 default unsat ✅ 0.77756 0.77659
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.94850 0.94385
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.86674 4.86655
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.76370 0.76394
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.54907 1.54635
Minkeyrink ST_st unsat ✅ 1.54261 1.54245
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.70988 0.70963
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.71199 0.71180
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.69458 0.69455
Yices2 Yices 2.6.0_default unsat ✅ 0.43419 0.43414
Z3 z3-4.7.1_default unsat ✅ 0.89304 0.89206
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.49050 1.49039
Bitwuzla-wrapped_default unsat ✅ 1.64121 1.64098
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.17483 10.23840
MathSAT MathSAT-5.6.8_default unsat ✅ 0.80806 0.80704
STP STP 2022.4_default unsat ✅ 0.76410 0.76408
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.44319 0.44312
Z3++BV z3++bv_0702_default unsat ✅ 0.53487 0.53319
Z3 z3-4.8.17_default unsat ✅ 0.51807 0.51978
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.33518 2.33369
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.85284 3.85280
STP STP 2022.4_default unsat ✅ 0.76117 0.76106
STP 2022.4_default unsat ✅ 0.75712 0.75706
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.09000 1338.75000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.44324 0.44320
Z3-Owl z3-Owl-Final_default unsat ✅ 1.42037 1.42016
z3-Owl-Final_default unsat ✅ 1.43864 1.43659
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.42004 1.32026
cvc5 cvc5 unsat ✅ 1.95925 1.85950
SMTInterpol SMTInterpol unknown ❌ 1202.78069 1436.22019
STP STP unsat ✅ 61.87410 61.77058
Yices2 Yices2 unsat ✅ 0.53754 0.43811
Z3alpha Z3-alpha unsat ✅ 0.62615 0.52665