Benchmark

non-incremental/QF_BV/sage/app7/bench_771.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3017149
Compressed Size187703
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3017141
Compressed Size187691
Max. Term Depth11566
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1854 and1
=2485 let11462 extract1348 bvand31463
bvor20737 bvxor1615 bvadd33319 bvmul1
bvsub10793 bvult446 bvule500 bvslt209
bvsle106 bvshl10617 bvashr20172 zero_extend1067

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.45034 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50108 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50065 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49639 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49987 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50230 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.60645 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.73476 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.64265 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 151.90000 —
CVC3-SMT-COMP-2011 default unsat ✅ 128.51100 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.36900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.64567 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.98964 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.90734 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.86355 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.13145 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.10178 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.79067 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.63031 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.65600 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.21276 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.48501 —
STP2-SMT-COMP-2012 default unsat ✅ 0.45744 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.47528 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.50127 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49864 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89241 0.89186
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.93504 6.37603
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.92680 6.37103
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.63734 0.63690
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.72000
STP stp-cryptominisat4 default unsat ✅ 0.42574 0.42493
stp-cmsat4-v15 default unsat ✅ 0.42748 0.42693
stp-cmsat4-mt-v15 default unsat ✅ 0.42453 0.42393
stp-minisat-v15 default unsat ✅ 0.42140 0.42094
Yices2 Yices default unsat ✅ 0.17409 0.17297
Z3 z3 4.4.0 default unsat ✅ 0.50927 0.50892
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.70636 1.70741
ABC_glucose glucose unsat ✅ 1.70193 3.30206
Boolector Boolector boolector unsat ✅ 0.99819 0.99884
Boolector preprop boolector unsat ✅ 0.96721 0.96770
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.89667 6.33882
MapleSTP MapleSTP default unsat ✅ 0.41339 0.41359
MapleSTP-mt default unsat ✅ 0.40594 0.40618
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.57792 0.57913
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.56089 0.56112
Q3B Q3B default unsat ✅ 0.79225 2.01000
STP stp-cms-exp-2016 default unsat ✅ 0.41190 0.41266
stp-cms-mt-2016 default unsat ✅ 0.42375 0.42393
stp-cms-st-2016 default unsat ✅ 0.42007 0.42027
stp-minisat-st-2016 default unsat ✅ 0.42087 0.42105
Yices2 Yices-2.4.2 default unsat ✅ 0.17233 0.17241
Z3 z3-4.4.1 default unsat ✅ 0.50853 0.51007
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.79889 0.79917
Boolector SMT17 final boolector unsat ✅ 0.80028 0.79971
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.90800 6.28502
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.59852 0.59552
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.13513 1.13408
Q3B Q3B default unsat ✅ 0.78547 2.01000
STP stp_st default unsat ✅ 0.51825 0.51779
stp_mt default unsat ✅ 0.51609 0.51564
Yices2 Yices2-Main default unsat ✅ 0.16622 0.16489
Z3 z3-4.5.0 default unsat ✅ 0.46783 0.46610
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.71485 0.71476
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.14382 4.14410
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.58217 0.58311
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.15392 1.15395
Minkeyrink ST_st unsat ✅ 1.15893 1.15898
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.52607 0.52609
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.52564 0.52568
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.52765 0.52769
Yices2 Yices 2.6.0_default unsat ✅ 0.15779 0.15772
Z3 z3-4.7.1_default unsat ✅ 0.55125 0.55116
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.11153 1.11145
Bitwuzla-wrapped_default unsat ✅ 1.19409 1.19411
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.73817 3.73293
MathSAT MathSAT-5.6.8_default unsat ✅ 0.62105 0.62103
STP STP 2022.4_default unsat ✅ 0.55251 0.55258
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.19821 0.19817
Z3++BV z3++bv_0702_default unsat ✅ 0.58898 0.58889
Z3 z3-4.8.17_default unsat ✅ 0.52642 0.52830
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.63943 1.63915
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.74718 2.74548
STP STP 2022.4_default unsat ✅ 0.54572 0.54579
STP 2022.4_default unsat ✅ 0.54764 0.54766
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 690.55800 787.12200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19253 0.19247
Z3-Owl z3-Owl-Final_default unsat ✅ 1.05856 1.05852
z3-Owl-Final_default unsat ✅ 1.06933 1.06941
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.89678 0.76832
Bitwuzla-MachBV-base unsat ✅ 1.02939 0.90058
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.19463 1.06905
BVDecide bv_decide unknown ❌ 1201.34491 1201.00588
bv_decide-nokernel unknown ❌ 1201.39521 1200.92631
cvc5 cvc5 unsat ✅ 0.71179 0.58209
SMTInterpol SMTInterpol unknown ❌ 1201.85062 2465.31273
Yices2 Yices2 unsat ✅ 0.35509 0.23802
Z3alpha Z3-alpha unsat ✅ 0.91421 0.88448
Z3 Z3-alpha-base unsat ✅ 0.46980 0.34529
Z3-Owl-base unsat ✅ 1.11037 0.98423
z3siri-base unsat ✅ 0.49414 0.36607
Z3-Owl Z3-Owl unsat ✅ 1.01199 0.88416