Benchmark

non-incremental/QF_BV/Sage2/bench_9714.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size58340
Compressed Size4374
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 58332
Compressed Size4388
Max. Term Depth42
Asserts 138
Declared Functions0
Declared Constants43
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not50 =55 let1200
bvor3 bvadd451 bvmul187 bvult16
bvule24 bvuge19 bvsgt4 bvsge19
bvshl77 zero_extend432

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.60959 0.60850
Boolector SMT17 final boolector unsat ✅ 2.03526 2.03042
CVC4 CVC4-smtcomp2017-main default unsat ✅ 9.11777 18.23950
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 79.93580 79.94300
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.61057 0.59206
Q3B Q3B default unknown ❌ 600.10100 1799.65000
STP stp_st default unsat ✅ 59.23970 59.23840
stp_mt default unsat ✅ 34.59680 136.95700
Yices2 Yices2-Main default unsat ✅ 0.42122 0.42103
Z3 z3-4.5.0 default unsat ✅ 4.74450 4.74355
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.27925 4.27869
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 13.99650 13.99620
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 88.90200 88.90250
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69788 6.40656
Minkeyrink ST_st unsat ✅ 1.63691 1.63521
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 198.63400 198.61000
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 62.97790 249.00300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 101.39000 101.39100
Yices2 Yices 2.6.0_default unsat ✅ 0.22575 0.22570
Z3 z3-4.7.1_default unsat ✅ 303.52700 303.52300
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 13.44780 13.44790
Poolector-wrapped-sq_default unsat ✅ 13.84860 54.51000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 16.92370 16.92260
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 6.39347 6.39376
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.35732 1.17889
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.34110 0.34119
Par4 Par4-wrapped-sq_default unsat ✅ 0.86444 2.51000
STP STP-2019-wrapped-sq_default unsat ✅ 16.90270 16.90310
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 74.61120 74.60660
stp-minisat-wrapped-sq_default unsat ✅ 1681.21000 1681.24000
stp-mt-wrapped-sq_default unsat ✅ 25.64420 101.18700
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1678.58000 1774.00000
stp-riss-wrapped-sq_default unknown ❌ 0.20386 0.20406
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.88692 0.88698
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33840 0.33834
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.38859 0.38855
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.78000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16368 0.16371
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 21.00460 20.99220
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 10.57170 10.57030
Boolector Boolector-wrapped-sq_default unsat ✅ 5.56978 5.56795
Poolector-wrapped-sq_default unsat ✅ 5.70137 22.20070
CVC4 CVC4-sq-final_default unsat ✅ 28.87890 28.86830
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.87000
MathSAT MathSAT5_default.sh unsat ✅ 308.51100 308.42900
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.07306 0.07322
MinkeyRink Solver 2020.3_default unsat ✅ 0.70176 2.54474
STP STP_default unsat ✅ 0.44433 1.50318
STP ++ Mergsat v1_default unsat ✅ 0.54245 0.54411
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37452 0.37448
Z3 z3-4.8.8_default unsat ✅ 9.09287 9.09147
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 11.51470 11.51320
MathSAT mathsat-5.6.6_default unsat ✅ 521.93800 521.80500
STP STP 2021.0_default unsat ✅ 0.99199 3.68097
Z3 z3-4.8.11_default unsat ✅ 56.44090 56.42150
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.77912 1.77877
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 7.41441 7.41365
STP STP 2022.4_default unsat ✅ 0.47897 0.47898
STP 2022.4_default unsat ✅ 0.48002 0.48009
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 63.86320 92.63740
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.22245 0.22239
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.03000 1199.71000
z3-Owl-Final_default unsat ✅ 69.83930 69.82310
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.31515 1.21516
cvc5 cvc5 unsat ✅ 3.91996 3.81693
SMTInterpol SMTInterpol unsat ✅ 13.12773 31.85295
STP STP unsat ✅ 0.52701 0.42750
Yices2 Yices2 unsat ✅ 0.70034 0.60075
Z3alpha Z3-alpha unsat ✅ 14.59635 14.49629
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 1.33821 1.21388
Bitwuzla-MachBV-base unsat ✅ 1.00222 0.88254
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.33973 1.20979
BVDecide bv_decide unsat ✅ 8.85027 8.69229
bv_decide-nokernel unsat ✅ 7.51422 7.33840
cvc5 cvc5 unsat ✅ 1.63975 1.51777
SMTInterpol SMTInterpol unsat ✅ 9.96020 25.79099
Yices2 Yices2 unsat ✅ 0.52560 0.39963
Z3alpha Z3-alpha unsat ✅ 13.75050 53.60324
Z3 Z3-alpha-base unsat ✅ 143.22720 143.08880
Z3-Owl-base unsat ✅ 649.66977 649.51992
z3siri-base unsat ✅ 144.61293 144.46910
Z3-Owl Z3-Owl unknown ❌ 1201.75503 1201.02707