Benchmark

non-incremental/QF_BV/sage/app2/bench_946.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size123025
Compressed Size15914
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 123017
Compressed Size15930
Max. Term Depth403
Asserts 1
Declared Functions0
Declared Constants406
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true14 ite1 not143 and1
=250 let303 extract115 bvand608
bvor18 bvxor42 bvadd1136 bvmul8
bvsub776 bvsdiv8 bvult66 bvule203
bvslt116 bvsle37 bvshl681 bvashr402
zero_extend503

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.03111
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.04012
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.03647
abziz_portfolio_2012_minfeatures default unsat ✅ 0.03599
abziz_portfolio_2012_solvers default unsat ✅ 0.03628
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.03610
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.01928
Boolector-SMT-COMP-2011 default unsat ✅ 0.03203
Boolector-SMT-COMP-2012 default unsat ✅ 0.02008
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unsat ✅ 0.16824
CVC3-SMT-COMP-2012 default unsat ✅ 0.16630
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.09350
CVC4-SMT-EVAL-2013 default unsat ✅ 1.36646
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.05487
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.04746
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.65067
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.05744
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.14949
SONOLAR-SMT-COMP-2010 default unknown ❌
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.47508
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.13703
STP STP2-SMT-COMP-2011 default unsat ✅ 0.09483
STP2-SMT-COMP-2012 default unsat ✅ 0.01998
simplifyingSTP-SMT-COMP-2010 default unsat ✅
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.02684
Z3-SMT-COMP-2011 default unsat ✅ 0.03124
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02882 0.02799
Boolector SMT17 final boolector unsat ✅ 0.02861 0.02820
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.79047 1.50958
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.04346 0.04373
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.08295 0.08296
Q3B Q3B default unsat ✅ 0.14145 0.15174
STP stp_st default unsat ✅ 0.05397 0.05257
stp_mt default unsat ✅ 0.05314 0.05253
Yices2 Yices2-Main default unsat ✅ 0.02088 0.01392
Z3 z3-4.5.0 default unsat ✅ 0.07530 0.07429
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02724 0.02715
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.52473 0.52483
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.04205 0.04304
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.08495 0.08496
Minkeyrink ST_st unsat ✅ 0.08466 0.08465
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.04965 0.04973
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.04985 0.04992
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.04963 0.04965
Yices2 Yices 2.6.0_default unsat ✅ 0.01464 0.01457
Z3 z3-4.7.1_default unsat ✅ 0.08659 0.08649