Benchmark

non-incremental/QF_BV/sage/app11/bench_607.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1536233
Compressed Size151834
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1536225
Compressed Size151840
Max. Term Depth4219
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1316
and1 =2120 let2886 extract1506
bvand993 bvor282 bvxor2297 bvadd14670
bvmul1186 bvsdiv16 bvult1100 bvule1515
bvslt123 bvsle162 bvshl8919 bvashr13285
zero_extend10191

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16058 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40730 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40732 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40899 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40725 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40808 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21926 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30063 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23649 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.83990 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.31260 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.27080 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.71531 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.55550 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46038 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45003 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.58670 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54868 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46846 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.97015 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.81280 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54517 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.09563 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16571 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25257 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.43890 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40670 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.33517 0.33281
Boolector SMT17 final boolector unsat ✅ 0.33057 0.33010
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.56428 6.36119
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.36288 0.35024
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.70920 0.70838
Q3B Q3B default unsat ✅ 53.74680 160.81000
STP stp_st default unsat ✅ 19.53100 19.52860
stp_mt default unsat ✅ 19.44580 19.44460
Yices2 Yices2-Main default unsat ✅ 0.13858 0.13698
Z3 z3-4.5.0 default unsat ✅ 0.35969 0.35752
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29164 0.29157
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.28757 3.28784
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.32536 0.32651
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68219 0.68214
Minkeyrink ST_st unsat ✅ 0.68388 0.68389
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.39040 12.38950
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.38810 12.38850
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.38560 12.38500
Yices2 Yices 2.6.0_default unsat ✅ 0.12334 0.12310
Z3 z3-4.7.1_default unsat ✅ 0.31081 0.31052
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.59074 0.59074
Poolector-wrapped-sq_default unsat ✅ 0.77934 2.79142
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.52114 0.52063
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.30792 3.30806
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36135 1.36143
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.35431 1.35437
Par4 Par4-wrapped-sq_default unsat ✅ 0.13856 0.00606
STP STP-2019-wrapped-sq_default unsat ✅ 12.57410 12.57430
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 12.55710 12.55450
stp-minisat-wrapped-sq_default unsat ✅ 12.59660 12.59650
stp-mt-wrapped-sq_default unsat ✅ 12.63910 12.63820
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 12.59620 12.59540
stp-riss-wrapped-sq_default unsat ✅ 12.68490 12.68100
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12665 0.12664
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12664 0.12662
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12930 0.12920
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12634 0.12632
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12710 0.12698
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.26868 0.26861
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.58538 0.46388
Bitwuzla-MachBV-base unsat ✅ 0.66524 0.53725
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.83575 0.70177
BVDecide bv_decide unknown ❌ 1201.37478 1201.05607
bv_decide-nokernel unknown ❌ 1201.38924 1200.92686
cvc5 cvc5 unsat ✅ 0.89960 0.77835
SMTInterpol SMTInterpol unknown ❌ 1201.85390 2828.19286
Yices2 Yices2 unsat ✅ 0.40546 0.26163
Z3alpha Z3-alpha unsat ✅ 0.62421 0.54690
Z3 Z3-alpha-base unsat ✅ 0.40057 0.28079
Z3-Owl-base unsat ✅ 0.93489 0.81984
z3siri-base unsat ✅ 0.43879 0.30584
Z3-Owl Z3-Owl unsat ✅ 0.99432 0.86318