Benchmark

non-incremental/QF_BV/sage/app1/bench_1130.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size39380
Compressed Size4442
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 39372
Compressed Size4454
Max. Term Depth61
Asserts 1
Declared Functions0
Declared Constants270
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite23 not38 and1
=97 let51 bvor162 bvadd182
bvsub57 bvult102 bvule180 bvshl163
bvashr3 zero_extend242

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.52568 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 1.82212 —
abziz_portfolio_2011_solvers_2 default sat ✅ 1.81827 —
abziz_portfolio_2012_minfeatures default sat ✅ 1.82724 —
abziz_portfolio_2012_solvers default sat ✅ 1.83038 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 1.82665 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.07080 —
Boolector-SMT-COMP-2011 default sat ✅ 4.01047 —
Boolector-SMT-COMP-2012 default sat ✅ 0.07046 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 6.78265 —
CVC3-SMT-COMP-2011 default sat ✅ 6.65806 —
CVC3-SMT-COMP-2012 default sat ✅ 6.63220 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.38434 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.37072 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.72862 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.93501 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.24564 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.24111 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.45078 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.78011 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.56920 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.28405 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.20066 —
STP2-SMT-COMP-2012 default sat ✅ 0.79301 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 3.61584 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 2.26482 —
Z3-SMT-COMP-2011 default sat ✅ 1.81876 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.97734 0.97685
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.33905 2.64360
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.72601 3.42148
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.59267 0.59191
SMT-RAT SMT-RAT-final default sat ✅ 71.28560 71.31420
STP stp-cryptominisat4 default sat ✅ 1.58608 1.58576
stp-cmsat4-v15 default sat ✅ 7.59109 7.59284
stp-cmsat4-mt-v15 default unknown ❌ 0.42700 0.42593
stp-minisat-v15 default sat ✅ 1.10864 1.10383
Yices2 Yices default sat ✅ 0.02807 0.02700
Z3 z3 4.4.0 default sat ✅ 2.00342 2.00369
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.43213 0.43169
ABC_glucose glucose sat ✅ 4.54249 4.54019
Boolector Boolector boolector sat ✅ 1.99806 1.99916
Boolector preprop boolector sat ✅ 2.00790 2.00966
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.53974 3.05055
MapleSTP MapleSTP default sat ✅ 1.29074 1.29134
MapleSTP-mt default sat ✅ 0.75406 1.79086
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.65284 0.65286
MinkeyRink Minkeyrink 2016 default sat ✅ 1.60608 2.17190
Q3B Q3B default unknown ❌ 2400.03000 7202.54000
STP stp-cms-exp-2016 default sat ✅ 1.50463 1.50556
stp-cms-mt-2016 default sat ✅ 0.86867 2.17866
stp-cms-st-2016 default sat ✅ 0.73646 0.73683
stp-minisat-st-2016 default sat ✅ 8.63761 8.64260
Yices2 Yices-2.4.2 default sat ✅ 0.02750 0.02763
Z3 z3-4.4.1 default sat ✅ 2.30355 2.30620
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.21390 0.21190
Boolector SMT17 final boolector sat ✅ 2.08487 2.08450
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.32734 4.62627
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.52524 0.52570
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.39120 0.39298
Q3B Q3B default unknown ❌ 600.07500 1799.52000
STP stp_st default sat ✅ 0.77863 0.77882
stp_mt default sat ✅ 0.86879 1.89540
Yices2 Yices2-Main default sat ✅ 0.03166 0.03037
Z3 z3-4.5.0 default sat ✅ 4.03243 4.03116
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.19032 0.19025
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.52877 1.52886
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.01107 1.01210
MinkeyRink Minkeyrink MT_mt sat ✅ 0.28460 0.41067
Minkeyrink ST_st sat ✅ 0.25746 0.25766
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1.51856 1.51830
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.82355 5.80323
STP-Riss-st-2018_riss-no-stderr sat ✅ 8.02757 8.02648
Yices2 Yices 2.6.0_default sat ✅ 0.03121 0.03110
Z3 z3-4.7.1_default sat ✅ 2.15904 2.15888
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.26780 0.26782
Poolector-wrapped-sq_default sat ✅ 0.28117 0.26158
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.92270 1.92262
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.85906 0.85837
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.29945 0.51705
MinkeyRink ST-wrapped-sq_default sat ✅ 0.26794 0.26798
Par4 Par4-wrapped-sq_default sat ✅ 0.03912 0.00613
STP STP-2019-wrapped-sq_default sat ✅ 1.94008 1.94018
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.51270 10.51240
stp-minisat-wrapped-sq_default sat ✅ 1.49081 1.49096
stp-mt-wrapped-sq_default sat ✅ 2.33217 7.71971
stp-portfolio-fixed-wrapped-sq_default sat ✅ 10.62230 13.54140
stp-riss-wrapped-sq_default unknown ❌ 0.49663 0.49684
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.03309 0.03309
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.06395 0.06396
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.26363 0.26367
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.13276 0.13276
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.09801 0.09802
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.02910 2.02750
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.24909 0.24897
MathSAT mathsat-5.6.6_default sat ✅ 0.23584 0.23579
STP STP 2021.0_default sat ✅ 0.21343 0.31864
Z3 z3-4.8.11_default sat ✅ 2.22408 2.22399
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.24578 0.24574
Bitwuzla-wrapped_default sat ✅ 0.33070 0.33058
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.76044 0.75943
MathSAT MathSAT-5.6.8_default sat ✅ 0.37344 0.37331
STP STP 2022.4_default sat ✅ 0.23146 0.23145
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.06513 0.06510
Z3++BV z3++bv_0702_default sat ✅ 0.43623 0.43614
Z3 z3-4.8.17_default sat ✅ 3.40189 3.40177
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.44596 0.44590
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.73029 0.73088
STP STP 2022.4_default sat ✅ 0.22875 0.22877
STP 2022.4_default sat ✅ 0.22892 0.22897
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1253.31000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.03191 0.03188
Z3-Owl z3-Owl-Final_default sat ✅ 16.20720 16.20360
z3-Owl-Final_default sat ✅ 15.84650 15.84540
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.33200 0.21426
Bitwuzla-MachBV-base sat ✅ 0.37837 0.25626
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.50670 0.38758
BVDecide bv_decide sat ✅ 3.61150 3.47162
bv_decide-nokernel sat ✅ 3.38416 3.25141
cvc5 cvc5 sat ✅ 0.79834 0.67526
SMTInterpol SMTInterpol unknown ❌ 1201.44290 1229.40893
Yices2 Yices2 sat ✅ 0.44556 0.32550
Z3alpha Z3-alpha sat ✅ 1.68274 5.19895
Z3 Z3-alpha-base sat ✅ 6.89822 6.77107
Z3-Owl-base sat ✅ 29.19880 29.06464
z3siri-base sat ✅ 7.02286 6.89968
Z3-Owl Z3-Owl sat ✅ 6.97501 6.84436