Benchmark

non-incremental/QF_BV/sage/app7/bench_3669.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4467651
Compressed Size279717
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4467643
Compressed Size279705
Max. Term Depth17013
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2779 and1
=3586 let16862 extract1725 bvand46148
bvor30442 bvxor2340 bvadd49699 bvmul9
bvsub16271 bvsdiv28 bvult647 bvule657
bvslt221 bvsle126 bvshl15947 bvashr30120
zero_extend1528

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70997
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69569
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69849
abziz_portfolio_2012_minfeatures default unsat ✅ 0.69729
abziz_portfolio_2012_solvers default unsat ✅ 0.69673
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68885
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95134
Boolector-SMT-COMP-2011 default unsat ✅ 1.07466
Boolector-SMT-COMP-2012 default unsat ✅ 1.00368
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 420.58400
CVC3-SMT-COMP-2011 default unsat ✅ 352.28400
CVC3-SMT-COMP-2012 default unsat ✅ 367.54400
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.66855
CVC4-SMT-EVAL-2013 default unsat ✅ 5.62900
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31047
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27567
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.65486
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60775
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.15545
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.65257
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.25090
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.87558
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74366
STP2-SMT-COMP-2012 default unsat ✅ 0.71271
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.76957
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76315
Z3-SMT-COMP-2011 default unsat ✅ 0.68898
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.22925 1.22850
Boolector SMT17 final boolector unsat ✅ 1.25450 1.25385
CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.17340 9.82555
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.85187 0.85244
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.68951 1.68816
Q3B Q3B default unsat ✅ 1.09549 2.86892
STP stp_st default unsat ✅ 0.80537 0.80403
stp_mt default unsat ✅ 0.81727 0.81647
Yices2 Yices2-Main default unsat ✅ 0.27647 0.27566
Z3 z3-4.5.0 default unsat ✅ 0.69445 0.69344
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.06746 1.06733
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.39373 5.39339
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83573 0.83668
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.72010 1.71987
Minkeyrink ST_st unsat ✅ 1.71957 1.71945
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83076 0.83067
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83106 0.83108
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82747 0.82736
Yices2 Yices 2.6.0_default unsat ✅ 0.26932 0.26920
Z3 z3-4.7.1_default unsat ✅ 0.75115 0.75086
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.02484 2.02456
Poolector-wrapped-sq_default unsat ✅ 2.41515 9.13754
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.66902 1.66900
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.62263 5.62040
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.19280 1.19284
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.17530 1.17543
Par4 Par4-wrapped-sq_default unsat ✅ 0.29122 0.00602
STP STP-2019-wrapped-sq_default unsat ✅ 0.83545 0.83553
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81928 0.81933
stp-minisat-wrapped-sq_default unsat ✅ 0.83471 0.83482
stp-mt-wrapped-sq_default unsat ✅ 0.82905 0.82902
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81902 0.81913
stp-riss-wrapped-sq_default unsat ✅ 0.83762 0.83774
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.27599 0.27598
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.27463 0.27465
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.27487 0.27490
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.27125 0.27127
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.27354 0.27355
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.93778 0.93752
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.56199 1.46238
cvc5 cvc5 unsat ✅ 2.26634 2.16505
SMTInterpol SMTInterpol unknown ❌ 1202.74385 1419.08464
STP STP unsat ✅ 64.20352 64.07537
Yices2 Yices2 unsat ✅ 0.42357 0.32379
Z3alpha Z3-alpha unsat ✅ 0.63028 0.52988