Benchmark

non-incremental/QF_BV/sage/app1/bench_2614.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size10125
Compressed Size2035
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 10117
Compressed Size2029
Max. Term Depth38
Asserts 1
Declared Functions0
Declared Constants5
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite24 not10 and1
=13 let28 bvor3 bvadd75
bvsub49 bvsdiv33 bvult57 bvule44
bvslt3 bvsle69 bvshl3 zero_extend28

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.28734 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.02285 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.02291 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.02989 —
abziz_portfolio_2012_solvers default unsat ✅ 0.02274 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.02237 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.25996 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.00969 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24343 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 28.62620 —
CVC3-SMT-COMP-2011 default unsat ✅ 25.74280 —
CVC3-SMT-COMP-2012 default unsat ✅ 26.23960 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01738 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.01923 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 4.78259 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.01890 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.46501 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.21440 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.78955 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.82247 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.23048 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.01004 —
STP2-SMT-COMP-2012 default unsat ✅ 0.01051 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.01302 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.00981 —
Z3-SMT-COMP-2011 default unsat ✅ 0.01713 —
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.65006 0.64833
Boolector SMT17 final boolector unsat ✅ 0.58365 0.58268
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.02804 0.03596
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 3.36071 3.36096
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.01260 0.01207
Q3B Q3B default unknown ❌ 600.05500 1433.24000
STP stp_st default unsat ✅ 0.01148 0.01150
stp_mt default unsat ✅ 0.01396 0.01162
Yices2 Yices2-Main default unsat ✅ 0.00874 0.00364
Z3 z3-4.5.0 default unsat ✅ 0.04655 0.03627
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.58439 0.58409
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.07178 0.07192
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 3.33997 3.34077
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01353 0.01341
Minkeyrink ST_st unsat ✅ 0.01402 0.01406
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.01386 0.00816
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.00815 0.00821
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.00919 0.00921
Yices2 Yices 2.6.0_default unsat ✅ 0.00896 0.00594
Z3 z3-4.7.1_default unsat ✅ 0.03576 0.03566
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.44591 0.44582
MathSAT mathsat-5.6.6_default unsat ✅ 1.44352 1.44336
STP STP 2021.0_default unsat ✅ 0.02253 0.01572
Z3 z3-4.8.11_default unsat ✅ 0.01704 0.01700
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.45167 0.45162
Bitwuzla-wrapped_default unsat ✅ 0.53373 0.53369
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.03032 0.03082
MathSAT MathSAT-5.6.8_default unsat ✅ 1.66620 1.65955
STP STP 2022.4_default unsat ✅ 0.01239 0.01243
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01140 0.00423
Z3++BV z3++bv_0702_default unsat ✅ 0.01738 0.01730
Z3 z3-4.8.17_default unsat ✅ 0.01713 0.01873
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 3.61061 3.61004
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.02637 0.02693
STP STP 2022.4_default unsat ✅ 0.01304 0.01288
STP 2022.4_default unsat ✅ 0.01261 0.01266
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 5.33586 14.24570
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01038 0.00430
Z3-Owl z3-Owl-Final_default unsat ✅ 0.68885 0.68886
z3-Owl-Final_default unsat ✅ 0.69444 0.69463