Benchmark

non-incremental/QF_BV/sage/app7/bench_417.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3246487
Compressed Size204345
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3246479
Compressed Size204351
Max. Term Depth12459
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2009 and1
=2680 let12354 extract1433 bvand33898
bvor22368 bvxor1746 bvadd35980 bvmul2
bvsub11691 bvsdiv3 bvult483 bvule519
bvslt211 bvsle121 bvshl11491 bvashr21798
zero_extend1155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48459 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.72301 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.72437 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.72838 —
abziz_portfolio_2012_solvers default unsat ✅ 0.73260 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.72598 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65554 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.78948 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69132 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 353.12100 —
CVC3-SMT-COMP-2011 default unsat ✅ 295.39000 —
CVC3-SMT-COMP-2012 default unsat ✅ 308.09200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.73622 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.38451 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.96793 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.93724 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.22450 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.19319 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.83682 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.86634 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.08563 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.32074 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51224 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48734 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50048 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74357 —
Z3-SMT-COMP-2011 default unsat ✅ 0.71628 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89442 0.89324
Boolector SMT17 final boolector unsat ✅ 0.92195 0.92056
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.32292 6.94136
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.61923 0.61949
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24814 1.24720
Q3B Q3B default unsat ✅ 0.81140 2.01000
STP stp_st default unsat ✅ 0.55400 0.55270
stp_mt default unsat ✅ 0.58560 0.57959
Yices2 Yices2-Main default unsat ✅ 0.17020 0.16952
Z3 z3-4.5.0 default unsat ✅ 0.72362 0.72276
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78309 0.78295
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.86415 3.86406
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.61405 0.61513
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26115 1.26110
Minkeyrink ST_st unsat ✅ 1.25887 1.25896
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57102 0.57146
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56615 0.56614
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56539 0.56542
Yices2 Yices 2.6.0_default unsat ✅ 0.16070 0.16062
Z3 z3-4.7.1_default unsat ✅ 0.60441 0.60432
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21037 1.21010
Boolector Boolector-wrapped-sq_default unsat ✅ 1.52032 1.52016
Poolector-wrapped-sq_default unsat ✅ 1.78172 6.45866
CVC4 CVC4-sq-final_default unsat ✅ 5.30398 5.30375
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.77505 0.77490
MathSAT MathSAT5_default.sh unsat ✅ 0.63316 0.63306
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73016 0.73021
MinkeyRink Solver 2020.3_default unsat ✅ 0.75488 0.75494
STP STP_default unsat ✅ 0.53540 0.53550
STP ++ Mergsat v1_default unsat ✅ 0.53089 0.53249
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.20292 0.20286
Z3 z3-4.8.8_default unsat ✅ 0.41419 0.41411
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21868 1.21857
MathSAT mathsat-5.6.6_default unsat ✅ 0.64598 0.64587
STP STP 2021.0_default unsat ✅ 0.55421 0.55428
Z3 z3-4.8.11_default unsat ✅ 0.65468 0.65462
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.20076 1.20048
Bitwuzla-wrapped_default unsat ✅ 1.29804 1.29789
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.05198 4.05182
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67695 0.67678
STP STP 2022.4_default unsat ✅ 0.63180 0.63147
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20861 0.20857
Z3++BV z3++bv_0702_default unsat ✅ 0.41113 0.41101
Z3 z3-4.8.17_default unsat ✅ 0.42745 0.42784
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.88560 1.88542
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.11507 3.10418
STP STP 2022.4_default unsat ✅ 0.59116 0.59124
STP 2022.4_default unsat ✅ 0.58973 0.58976
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 812.12000 937.00900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.20028 0.20022
Z3-Owl z3-Owl-Final_default unsat ✅ 1.25579 1.25575
z3-Owl-Final_default unsat ✅ 1.28578 1.28587
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.15862 1.05842
cvc5 cvc5 unsat ✅ 0.90626 0.80440
SMTInterpol SMTInterpol unknown ❌ 1202.74149 1503.71043
STP STP unsat ✅ 37.64373 37.51613
Yices2 Yices2 unsat ✅ 0.36589 0.26587
Z3alpha Z3-alpha unsat ✅ 0.55381 0.45413