Benchmark

non-incremental/QF_BV/sage/app7/bench_4514.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3586388
Compressed Size230244
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3586380
Compressed Size230250
Max. Term Depth13714
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2498 and1
=3267 let13609 extract1705 bvand36406
bvor23931 bvxor2273 bvadd39578 bvmul7
bvsub13056 bvsdiv19 bvult603 bvule626
bvslt219 bvsle124 bvshl12750 bvashr23676
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.53991 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.58716 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.57328 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.58484 —
abziz_portfolio_2012_solvers default unsat ✅ 0.58877 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.58048 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.71693 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.86068 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.75460 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.85100 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.80900 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.82900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.16820 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.84209 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.07444 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.03412 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.33580 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.30771 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.93815 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.76078 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.55018 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.47032 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.61201 —
STP2-SMT-COMP-2012 default unsat ✅ 0.54038 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.57465 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.63281 —
Z3-SMT-COMP-2011 default unsat ✅ 0.57642 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.95547 0.95504
Boolector SMT17 final boolector unsat ✅ 1.42214 1.05162
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.61783 7.43009
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.69935 0.70032
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.49406 1.44803
Q3B Q3B default unsat ✅ 0.89496 2.31000
STP stp_st default unsat ✅ 0.61381 0.61325
stp_mt default unsat ✅ 0.61163 0.61032
Yices2 Yices2-Main default unsat ✅ 0.38553 0.38438
Z3 z3-4.5.0 default unsat ✅ 0.74796 0.74714
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.83390 0.83380
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.35338 4.35321
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67571 0.67675
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.37817 1.37818
Minkeyrink ST_st unsat ✅ 1.38056 1.38064
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.62435 0.62437
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.62681 0.62683
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62004 0.62004
Yices2 Yices 2.6.0_default unsat ✅ 0.39021 0.39014
Z3 z3-4.7.1_default unsat ✅ 0.81862 0.81855
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.61400 1.61383
Poolector-wrapped-sq_default unsat ✅ 1.89428 7.08000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.30679 1.30663
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.52210 4.52205
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.95901 0.95912
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.95916 0.95917
Par4 Par4-wrapped-sq_default unsat ✅ 0.39818 0.00468
STP STP-2019-wrapped-sq_default unsat ✅ 0.64105 0.64116
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.63115 0.63129
stp-minisat-wrapped-sq_default unsat ✅ 0.64214 0.64232
stp-mt-wrapped-sq_default unsat ✅ 0.63723 0.63742
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.63071 0.63086
stp-riss-wrapped-sq_default unsat ✅ 0.64083 0.64100
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36288 0.36284
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36328 0.36329
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.36473 0.36473
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36227 0.36221
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.35970 0.35963
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.60731 0.60732
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.33556 1.33546
MathSAT mathsat-5.6.6_default unsat ✅ 0.72025 0.72020
STP STP 2021.0_default unsat ✅ 0.60584 0.60596
Z3 z3-4.8.11_default unsat ✅ 0.47796 0.47780
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.33252 1.33231
Bitwuzla-wrapped_default unsat ✅ 1.43343 1.42514
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.69091 4.69126
MathSAT MathSAT-5.6.8_default unsat ✅ 0.74375 0.74364
STP STP 2022.4_default unsat ✅ 0.71393 0.70804
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39867 0.39858
Z3++BV z3++bv_0702_default unsat ✅ 0.83425 0.83421
Z3 z3-4.8.17_default unsat ✅ 0.77696 0.77879
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.07014 2.06994
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.40345 3.40208
STP STP 2022.4_default unsat ✅ 0.68471 0.68469
STP 2022.4_default unsat ✅ 0.69924 0.69922
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1305.06000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.40367 0.40366
Z3-Owl z3-Owl-Final_default unsat ✅ 1.40892 1.40895
z3-Owl-Final_default unsat ✅ 1.42295 1.42306
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.29456 1.19447
cvc5 cvc5 unsat ✅ 1.93628 1.83649
SMTInterpol SMTInterpol unknown ❌ 1202.71791 1418.73754
STP STP unsat ✅ 49.25425 49.14223
Yices2 Yices2 unsat ✅ 0.47440 0.37462
Z3alpha Z3-alpha unsat ✅ 0.56113 0.46148