Benchmark

non-incremental/QF_BV/sage/app1/bench_2461.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size67709
Compressed Size9621
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 67701
Compressed Size9631
Max. Term Depth150
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite64 not70 and1
=179 let140 extract1 bvand34
bvor171 bvadd344 bvmul5 bvsub194
bvult224 bvule485 bvslt1 bvsle32
bvshl172 bvashr5 zero_extend292

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.15049 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.54162 —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.55313 —
abziz_portfolio_2012_minfeatures default sat ✅ 2.54246 —
abziz_portfolio_2012_solvers default sat ✅ 2.54780 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.54614 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 4.89781 —
Boolector-SMT-COMP-2011 default sat ✅ — —
Boolector-SMT-COMP-2012 default sat ✅ 0.20221 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.55248 —
CVC4-SMT-EVAL-2013 default sat ✅ 1.78137 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.20253 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 2.01636 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.82127 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.82234 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.95348 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.92836 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.45509 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.71254 —
STP STP2-SMT-COMP-2011 default sat ✅ 2.37138 —
STP2-SMT-COMP-2012 default sat ✅ 1.72483 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 6.10473 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 3.35138 —
Z3-SMT-COMP-2011 default sat ✅ 2.56440 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.92473 0.92386
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 6.37860 12.73310
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 4.46671 8.90265
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2.05250 2.05269
SMT-RAT SMT-RAT-final default sat ✅ 421.87300 422.08400
STP stp-cryptominisat4 default sat ✅ 6.65051 6.65199
stp-cmsat4-v15 default sat ✅ 19.66250 19.66500
stp-cmsat4-mt-v15 default unknown ❌ 0.41323 0.41194
stp-minisat-v15 default sat ✅ 4.94250 4.94225
Yices2 Yices default sat ✅ 0.32021 0.31895
Z3 z3 4.4.0 default sat ✅ 7.58879 7.59285
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.83729 0.83764
ABC_glucose glucose sat ✅ 10.56840 10.57490
Boolector Boolector boolector sat ✅ 1.50577 1.50660
Boolector preprop boolector sat ✅ 1.51178 1.51259
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 5.10890 10.20080
MapleSTP MapleSTP default sat ✅ 5.26815 5.27115
MapleSTP-mt default sat ✅ 4.23962 15.59070
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.89543 1.89750
MinkeyRink Minkeyrink 2016 default sat ✅ 2.00539 3.76949
Q3B Q3B default unknown ❌ 2400.02000 7204.25000
STP stp-cms-exp-2016 default sat ✅ 58.02380 58.06210
stp-cms-mt-2016 default sat ✅ 12.92480 50.23530
stp-cms-st-2016 default sat ✅ 20.25790 20.27110
stp-minisat-st-2016 default sat ✅ 26.89250 26.90790
Yices2 Yices-2.4.2 default sat ✅ 0.52851 0.52871
Z3 z3-4.4.1 default sat ✅ 3.70567 3.70964
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.68684 0.68603
Boolector SMT17 final boolector sat ✅ 1.54486 1.54340
CVC4 CVC4-smtcomp2017-main default sat ✅ 9.01603 18.01030
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.09196 2.09141
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.04056 0.98254
Q3B Q3B default unknown ❌ 600.04800 1785.47000
STP stp_st default sat ✅ 9.88363 9.88299
stp_mt default sat ✅ 7.19094 20.57360
Yices2 Yices2-Main default sat ✅ 0.29342 0.29197
Z3 z3-4.5.0 default sat ✅ 4.11354 4.11262
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.32364 0.32353
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.50075 3.50023
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.79799 1.79896
MinkeyRink Minkeyrink MT_mt sat ✅ 1.39058 4.71189
Minkeyrink ST_st sat ✅ 1.36724 1.36710
STP STP-CMS-st-2018_default-no-stderr sat ✅ 5.08968 5.08941
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.82302 13.86700
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.21543 4.21517
Yices2 Yices 2.6.0_default sat ✅ 0.34145 0.34137
Z3 z3-4.7.1_default sat ✅ 8.94151 8.94080
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.48985 0.48981
MathSAT mathsat-5.6.6_default sat ✅ 0.67017 0.66904
STP STP 2021.0_default sat ✅ 0.30424 0.55290
Z3 z3-4.8.11_default sat ✅ 2.17143 2.17147
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.11486 1.11476
Bitwuzla-wrapped_default sat ✅ 0.45149 0.45142
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 3.86570 3.86637
MathSAT MathSAT-5.6.8_default sat ✅ 0.89728 0.89716
STP STP 2022.4_default sat ✅ 0.32350 0.32348
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.44934 0.44928
Z3++BV z3++bv_0702_default sat ✅ 0.83914 0.83906
Z3 z3-4.8.17_default sat ✅ 2.15234 2.15391
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.39850 1.39825
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 3.59220 3.58949
STP STP 2022.4_default sat ✅ 0.34817 0.34820
STP 2022.4_default sat ✅ 0.34805 0.34810
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1262.04000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.85441 0.85431
Z3-Owl z3-Owl-Final_default sat ✅ 17.72410 17.72040
z3-Owl-Final_default sat ✅ 15.77490 15.77340
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.54976 0.44996
cvc5 cvc5 sat ✅ 6.02437 5.91968
SMTInterpol SMTInterpol unknown ❌ 1201.71844 1235.22084
STP STP sat ✅ 0.48568 0.38388
Yices2 Yices2 sat ✅ 0.66200 0.56211
Z3alpha Z3-alpha sat ✅ 4.97243 4.87010
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.43725 0.31540
Bitwuzla-MachBV-base sat ✅ 0.46813 0.35501
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.58508 0.45964
BVDecide bv_decide sat ✅ 6.81729 6.66324
bv_decide-nokernel sat ✅ 6.45343 6.29702
cvc5 cvc5 sat ✅ 2.56831 2.43838
SMTInterpol SMTInterpol unknown ❌ 1201.59031 1225.25931
Yices2 Yices2 sat ✅ 0.75276 0.63286
Z3alpha Z3-alpha sat ✅ 4.70498 17.29308
Z3 Z3-alpha-base sat ✅ 2.54068 2.41129
Z3-Owl-base sat ✅ 9.73660 9.60844
z3siri-base sat ✅ 2.55132 2.42584
Z3-Owl Z3-Owl sat ✅ 8.06998 7.92939