Benchmark

non-incremental/QF_BV/sage/app7/bench_6780.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4419388
Compressed Size279896
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4419380
Compressed Size279901
Max. Term Depth17046
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2770 and1
=3568 let16826 extract1720 bvand46142
bvor30435 bvxor2324 bvadd49670 bvmul9
bvsub16266 bvsdiv28 bvult643 bvule652
bvslt220 bvsle126 bvshl15939 bvashr30112
zero_extend1523

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71108
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68868
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69073
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68993
abziz_portfolio_2012_solvers default unsat ✅ 0.68648
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.68686
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95044
Boolector-SMT-COMP-2011 default unsat ✅ 1.07304
Boolector-SMT-COMP-2012 default unsat ✅ 1.00361
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 581.35400
CVC3-SMT-COMP-2011 default unsat ✅ 482.98000
CVC3-SMT-COMP-2012 default unsat ✅ 502.44000
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.67389
CVC4-SMT-EVAL-2013 default unsat ✅ 5.58694
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.31422
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26635
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.65370
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60843
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14885
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.63956
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.25633
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.88376
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74838
STP2-SMT-COMP-2012 default unsat ✅ 0.71170
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.75900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74362
Z3-SMT-COMP-2011 default unsat ✅ 0.67991
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.18808 1.18540
Boolector SMT17 final boolector unsat ✅ 1.22527 1.22460
CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.50533 10.29160
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.87298 0.87230
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.75402 1.75446
Q3B Q3B default unsat ✅ 1.10904 2.93000
STP stp_st default unsat ✅ 0.92447 0.91042
stp_mt default unsat ✅ 0.84840 0.84770
Yices2 Yices2-Main default unsat ✅ 0.27385 0.27282
Z3 z3-4.5.0 default unsat ✅ 0.97243 0.97148
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05611 1.05588
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.38641 5.38656
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83180 0.83272
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.71323 1.71339
Minkeyrink ST_st unsat ✅ 1.71770 1.71758
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82908 0.82909
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83429 0.83433
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83686 0.83681
Yices2 Yices 2.6.0_default unsat ✅ 0.26545 0.26535
Z3 z3-4.7.1_default unsat ✅ 0.99847 0.99828
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69769 1.69745
Boolector Boolector-wrapped-sq_default unsat ✅ 2.02699 2.02692
Poolector-wrapped-sq_default unsat ✅ 2.38327 8.80000
CVC4 CVC4-sq-final_default unsat ✅ 7.34465 7.34426
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04609 1.04603
MathSAT MathSAT5_default.sh unsat ✅ 0.85676 0.85666
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.96910 0.96915
MinkeyRink Solver 2020.3_default unsat ✅ 1.00130 1.00139
STP STP_default unsat ✅ 0.78369 0.78371
STP ++ Mergsat v1_default unsat ✅ 0.78610 0.78754
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31973 0.31963
Z3 z3-4.8.8_default unsat ✅ 0.71863 0.71854
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.49330 1.39208
cvc5 cvc5 unsat ✅ 2.19222 2.09248
SMTInterpol SMTInterpol unknown ❌ 1202.74588 1411.04335
STP STP unsat ✅ 67.90000 67.79650
Yices2 Yices2 unsat ✅ 0.41912 0.31921
Z3alpha Z3-alpha unsat ✅ 0.62526 0.52570
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.18695 1.05070
Bitwuzla-MachBV-base unsat ✅ 1.45008 1.32716
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.65489 1.53486
BVDecide bv_decide unknown ❌ 1201.38723 1201.06551
bv_decide-nokernel unknown ❌ 1201.38719 1201.04756
cvc5 cvc5 unsat ✅ 1.66029 1.53173
SMTInterpol SMTInterpol unknown ❌ 1201.89011 1653.54372
Yices2 Yices2 unsat ✅ 0.46323 0.32804
Z3alpha Z3-alpha unsat ✅ 1.07621 1.08884
Z3 Z3-alpha-base unsat ✅ 0.71552 0.58429
Z3-Owl-base unsat ✅ 2.19716 2.06000
z3siri-base unsat ✅ 0.67229 0.54253
Z3-Owl Z3-Owl unsat ✅ 1.26190 1.14198