Benchmark

non-incremental/QF_BV/sage/app7/bench_1354.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1823155
Compressed Size128406
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1823147
Compressed Size128412
Max. Term Depth7022
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1658 and1
=2243 let6923 extract1258 bvand18149
bvor11825 bvxor1453 bvadd19781 bvmul1
bvsub6369 bvult438 bvule474 bvslt204
bvsle99 bvshl6207 bvashr11452 zero_extend971

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.25717 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.31908 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.31253 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.31622 —
abziz_portfolio_2012_solvers default unsat ✅ 0.31378 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.31726 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.35049 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.42732 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.37204 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 165.92600 —
CVC3-SMT-COMP-2011 default unsat ✅ 139.31600 —
CVC3-SMT-COMP-2012 default unsat ✅ 145.31100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.43547 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.38387 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.54646 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.51892 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.68756 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.66564 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.48815 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.51780 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.34475 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.76197 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.29459 —
STP2-SMT-COMP-2012 default unsat ✅ 0.25709 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26400 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.33686 —
Z3-SMT-COMP-2011 default unsat ✅ 0.30533 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.50012 0.49892
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.40180 3.92240
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.40968 3.94140
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38316 0.38194
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.88000
STP stp-cryptominisat4 default unsat ✅ 0.24460 0.24396
stp-cmsat4-v15 default unsat ✅ 0.24450 0.24396
stp-cmsat4-mt-v15 default unsat ✅ 0.24566 0.24496
stp-minisat-v15 default unsat ✅ 0.24364 0.24296
Yices2 Yices default unsat ✅ 0.10856 0.10798
Z3 z3 4.4.0 default unsat ✅ 0.28508 0.28496
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.03828 1.03843
ABC_glucose glucose unsat ✅ 1.03201 1.03262
Boolector Boolector boolector unsat ✅ 0.62464 0.62537
Boolector preprop boolector unsat ✅ 0.60900 0.60932
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.36889 3.88194
MapleSTP MapleSTP default unsat ✅ 0.23315 0.23308
MapleSTP-mt default unsat ✅ 0.23450 0.23461
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.33949 0.34130
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.33828 0.33844
Q3B Q3B default unsat ✅ 0.56495 0.56723
STP stp-cms-exp-2016 default unsat ✅ 0.23812 0.23820
stp-cms-mt-2016 default unsat ✅ 0.24221 0.24232
stp-cms-st-2016 default unsat ✅ 0.24335 0.24330
stp-minisat-st-2016 default unsat ✅ 0.24244 0.24266
Yices2 Yices-2.4.2 default unsat ✅ 0.10886 0.10885
Z3 z3-4.4.1 default unsat ✅ 0.25266 0.25408
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.48657 0.48496
Boolector SMT17 final boolector unsat ✅ 0.46215 0.46136
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.58899 4.17557
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.34938 0.34946
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.73356 0.73224
Q3B Q3B default unsat ✅ 0.58913 0.58312
STP stp_st default unsat ✅ 0.32500 0.32303
stp_mt default unsat ✅ 0.32641 0.32468
Yices2 Yices2-Main default unsat ✅ 0.10372 0.10298
Z3 z3-4.5.0 default unsat ✅ 0.36350 0.36223
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.40998 0.40990
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.18185 2.18208
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.34231 0.34331
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70748 0.70752
Minkeyrink ST_st unsat ✅ 0.70826 0.70827
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.30265 0.30266
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.30200 0.30198
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.30354 0.30353
Yices2 Yices 2.6.0_default unsat ✅ 0.10057 0.10047
Z3 z3-4.7.1_default unsat ✅ 0.32712 0.32695
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.80003 0.79993
Poolector-wrapped-sq_default unsat ✅ 0.98593 3.41000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.64099 0.64096
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.27071 2.27072
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.52032 0.52048
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.51625 0.51627
Par4 Par4-wrapped-sq_default unsat ✅ 0.12067 0.00591
STP STP-2019-wrapped-sq_default unsat ✅ 0.33720 0.33728
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.30386 0.30392
stp-minisat-wrapped-sq_default unsat ✅ 0.31309 0.31324
stp-mt-wrapped-sq_default unsat ✅ 0.30645 0.30647
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.30971 0.30981
stp-riss-wrapped-sq_default unsat ✅ 0.31093 0.31107
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.10470 0.10466
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.10442 0.10443
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.10437 0.10438
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10323 0.10321
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.10485 0.10483
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.34702 0.34699
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.63112 0.63109
Boolector Boolector-wrapped-sq_default unsat ✅ 0.79533 0.79530
Poolector-wrapped-sq_default unsat ✅ 0.98203 3.59964
CVC4 CVC4-sq-final_default unsat ✅ 2.94433 2.94445
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.43237 0.43234
MathSAT MathSAT5_default.sh unsat ✅ 0.35597 0.35590
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.43185 0.43191
MinkeyRink Solver 2020.3_default unsat ✅ 0.44546 0.44556
STP STP_default unsat ✅ 0.28889 0.28888
STP ++ Mergsat v1_default unsat ✅ 0.28414 0.28585
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12348 0.12344
Z3 z3-4.8.8_default unsat ✅ 0.24731 0.24720
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62410 0.62397
MathSAT mathsat-5.6.6_default unsat ✅ 0.36012 0.36008
STP STP 2021.0_default unsat ✅ 0.29874 0.29874
Z3 z3-4.8.11_default unsat ✅ 0.21757 0.21618
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62377 0.62371
Bitwuzla-wrapped_default unsat ✅ 0.66510 0.66492
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.26265 2.26305
MathSAT MathSAT-5.6.8_default unsat ✅ 0.36742 0.36738
STP STP 2022.4_default unsat ✅ 0.35003 0.34226
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.12468 0.12463
Z3++BV z3++bv_0702_default unsat ✅ 0.40573 0.40567
Z3 z3-4.8.17_default unsat ✅ 0.38590 0.38344
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.00402 1.00386
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.64191 1.64238
STP STP 2022.4_default unsat ✅ 0.33213 0.33211
STP 2022.4_default unsat ✅ 0.33617 0.33619
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 496.87700 568.74100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12037 0.12033
Z3-Owl z3-Owl-Final_default unsat ✅ 1.02284 1.02274
z3-Owl-Final_default unsat ✅ 1.06100 1.06102
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.72410 0.62416
cvc5 cvc5 unsat ✅ 0.74188 0.64148
SMTInterpol SMTInterpol unsat ✅ 1010.50283 1515.22036
STP STP unsat ✅ 9.42782 9.32788
Yices2 Yices2 unsat ✅ 0.29663 0.19677
Z3alpha Z3-alpha unsat ✅ 0.45148 0.35257
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.63040 0.50952
Bitwuzla-MachBV-base unsat ✅ 0.74409 0.61470
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.89101 0.76238
BVDecide bv_decide unsat ✅ 662.69188 662.49439
bv_decide-nokernel unsat ✅ 563.26811 563.04326
cvc5 cvc5 unsat ✅ 0.54922 0.43076
SMTInterpol SMTInterpol unknown ❌ 1201.89031 3061.62849
Yices2 Yices2 unsat ✅ 0.31977 0.19588
Z3alpha Z3-alpha unsat ✅ 0.65064 0.57539
Z3 Z3-alpha-base unsat ✅ 0.41878 0.29701
Z3-Owl-base unsat ✅ 0.87730 0.75581
z3siri-base unsat ✅ 0.38410 0.26728
Z3-Owl Z3-Owl unsat ✅ 0.91477 0.79357