Benchmark

non-incremental/QF_BV/sage/app9/bench_2967.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size50132
Compressed Size8871
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 50124
Compressed Size8881
Max. Term Depth157
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not168 and1
=239 let147 extract3 bvand9
bvor63 bvadd486 bvmul11 bvsub132
bvult153 bvule335 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.81543 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.59930 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.58791 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.59151 —
abziz_portfolio_2012_solvers default sat ✅ 0.59446 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.59128 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.13978 —
Boolector-SMT-COMP-2011 default sat ✅ 4.98816 —
Boolector-SMT-COMP-2012 default sat ✅ 0.22689 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.46903 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.53032 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.15136 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.27656 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.15588 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.15924 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.26994 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.95893 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.73837 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.34435 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.24701 —
STP2-SMT-COMP-2012 default sat ✅ 0.39067 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 1.56999 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.55879 —
Z3-SMT-COMP-2011 default sat ✅ 0.58935 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.75641 0.75589
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.74990 1.45878
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.79728 1.55476
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.39480 0.39394
SMT-RAT SMT-RAT-final default sat ✅ 112.67900 112.71300
STP stp-cryptominisat4 default sat ✅ 0.29768 0.29695
stp-cmsat4-v15 default sat ✅ 0.32396 0.32295
stp-cmsat4-mt-v15 default unknown ❌ 0.24274 0.24196
stp-minisat-v15 default sat ✅ 0.26328 0.26196
Yices2 Yices default sat ✅ 0.03611 0.03499
Z3 z3 4.4.0 default sat ✅ 0.74679 0.74689
SMT-COMP 2016 ABC ABC_default default_abc sat ✅ 0.72403 0.72421
ABC_glucose glucose sat ✅ 5.59666 5.59899
Boolector Boolector boolector sat ✅ 1.41860 1.41938
Boolector preprop boolector sat ✅ 1.42689 1.42767
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.73893 1.44198
MapleSTP MapleSTP default sat ✅ 0.39300 0.39316
MapleSTP-mt default sat ✅ 0.43681 1.08663
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.32846 0.32955
MinkeyRink Minkeyrink 2016 default sat ✅ 1.93277 2.85489
Q3B Q3B default sat ✅ 449.67700 1349.43000
STP stp-cms-exp-2016 default sat ✅ 0.50199 0.50226
stp-cms-mt-2016 default sat ✅ 0.40869 0.97150
stp-cms-st-2016 default sat ✅ 0.41293 0.41297
stp-minisat-st-2016 default sat ✅ 0.32171 0.32187
Yices2 Yices-2.4.2 default sat ✅ 0.03557 0.03555
Z3 z3-4.4.1 default sat ✅ 0.81603 0.81781
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.31811 0.31728
Boolector SMT17 final boolector sat ✅ 1.56188 1.56047
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.85353 1.66866
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.42007 0.42044
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.62682 0.61593
Q3B Q3B default unknown ❌ 600.05700 1786.57000
STP stp_st default sat ✅ 0.63751 0.63700
stp_mt default sat ✅ 0.90149 1.91760
Yices2 Yices2-Main default sat ✅ 0.11961 0.05358
Z3 z3-4.5.0 default sat ✅ 0.91406 0.91322
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.27676 0.27664
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.82009 0.82026
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.36314 0.36421
MinkeyRink Minkeyrink MT_mt sat ✅ 0.38564 0.61707
Minkeyrink ST_st sat ✅ 0.37074 0.37077
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.38750 0.38759
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.39602 0.76174
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.04655 1.04656
Yices2 Yices 2.6.0_default sat ✅ 0.04767 0.04761
Z3 z3-4.7.1_default sat ✅ 0.82834 0.82815
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.46144 0.46131
Boolector Boolector-wrapped-sq_default sat ✅ 0.38600 0.38599
Poolector-wrapped-sq_default sat ✅ 0.38731 0.34012
CVC4 CVC4-sq-final_default sat ✅ 0.89864 0.89889
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.95000
MathSAT MathSAT5_default.sh sat ✅ 0.18440 0.18431
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.27611 0.27636
MinkeyRink Solver 2020.3_default sat ✅ 0.35685 0.59704
STP STP_default sat ✅ 0.25253 0.36533
STP ++ Mergsat v1_default sat ✅ 0.21196 0.21361
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.06950 0.06947
Z3 z3-4.8.8_default sat ✅ 0.98646 0.98643
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.59183 0.59170
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.72071 0.72126
STP STP 2022.4_default sat ✅ 0.25570 0.25568
STP 2022.4_default sat ✅ 0.25581 0.25587
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1251.43000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.04958 0.04955
Z3-Owl z3-Owl-Final_default sat ✅ 12.25920 12.25610
z3-Owl-Final_default sat ✅ 12.27330 12.27230
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.42560 0.32541
cvc5 cvc5 sat ✅ 1.21498 1.11511
SMTInterpol SMTInterpol unknown ❌ 1201.74680 1233.99987
STP STP sat ✅ 0.48866 0.38868
Yices2 Yices2 sat ✅ 0.26017 0.16058
Z3alpha Z3-alpha sat ✅ 0.40845 0.30866