Benchmark

non-incremental/QF_BV/Sage2/bench_14349.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size44192
Compressed Size3514
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 44184
Compressed Size3529
Max. Term Depth40
Asserts 115
Declared Functions0
Declared Constants34
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not37 =42 let898
bvor3 bvadd326 bvmul140 bvult14
bvule24 bvuge19 bvsgt2 bvsge13
bvshl60 zero_extend332

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.73126 0.71737
Boolector SMT17 final boolector unsat ✅ 1.60913 1.60735
CVC4 CVC4-smtcomp2017-main default unsat ✅ 128.58500 197.81500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 92.92970 92.89780
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.57244 2.60603
Q3B Q3B default unknown ❌ 600.02500 1799.55000
STP stp_st default unsat ✅ 259.77900 259.74300
stp_mt default unsat ✅ 283.34300 902.61600
Yices2 Yices2-Main default unsat ✅ 1.05269 1.05185
Z3 z3-4.5.0 default unsat ✅ 72.93340 72.92780
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 6.38195 6.38077
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.73412 4.73428
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 115.58600 115.58100
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.71146 2.58402
Minkeyrink ST_st unsat ✅ 2.08658 2.08628
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 102.86400 102.83100
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 109.61500 435.74400
STP-Riss-st-2018_riss-no-stderr unsat ✅ 154.00000 153.99200
Yices2 Yices 2.6.0_default unsat ✅ 0.28115 0.28104
Z3 z3-4.7.1_default unsat ✅ 24.17220 24.16990
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 11.62390 11.62360
Poolector-wrapped-sq_default unsat ✅ 9.01717 35.13000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 22.74590 22.74550
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.54996 7.54985
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.68612 2.49842
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.66998 0.67009
Par4 Par4-wrapped-sq_default unsat ✅ 0.67430 1.80000
STP STP-2019-wrapped-sq_default unsat ✅ 357.05500 357.01500
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 816.17100 816.09700
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2400.09000
stp-mt-wrapped-sq_default unsat ✅ 348.09900 1381.99000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.02000 3634.00000
stp-riss-wrapped-sq_default unknown ❌ 0.13772 0.13793
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.72100 0.72098
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.21488 0.21486
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.29258 0.29233
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.06000 2400.06000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.18473 0.18474
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 31.12720 31.12640
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 12.01260 12.00880
Boolector Boolector-wrapped-sq_default unsat ✅ 13.41800 13.41370
Poolector-wrapped-sq_default unsat ✅ 13.91340 54.43290
CVC4 CVC4-sq-final_default unsat ✅ 41.22000 41.21800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1200.00000
MathSAT MathSAT5_default.sh unsat ✅ 724.30800 724.18200
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.05916 0.05941
MinkeyRink Solver 2020.3_default unsat ✅ 1.34311 5.10392
STP STP_default unsat ✅ 0.54217 1.95153
STP ++ Mergsat v1_default unsat ✅ 0.77253 0.77400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.33235 0.33189
Z3 z3-4.8.8_default unsat ✅ 8.06565 8.06601
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.39830 16.39890
Bitwuzla-wrapped_default unsat ✅ 16.12260 16.11930
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.62070 12.61870
MathSAT MathSAT-5.6.8_default unsat ✅ 458.04500 457.96000
STP STP 2022.4_default unsat ✅ 0.46073 0.46069
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.30960 0.30953
Z3++BV z3++bv_0702_default unsat ✅ 7.95702 7.95738
Z3 z3-4.8.17_default unsat ✅ 6.26429 6.26501
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.00894 0.90909
cvc5 cvc5 unsat ✅ 13.36789 13.26800
SMTInterpol SMTInterpol unsat ✅ 8.78180 24.90974
STP STP unsat ✅ 0.73944 0.63977
Yices2 Yices2 unsat ✅ 0.43210 0.33228
Z3alpha Z3-alpha unsat ✅ 5.85393 5.75143
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.98770 1.86249
Bitwuzla-MachBV-base unsat ✅ 0.94963 0.83157
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.23819 1.11924
BVDecide bv_decide unsat ✅ 9.03173 8.89571
bv_decide-nokernel unsat ✅ 7.75713 7.61509
cvc5 cvc5 unsat ✅ 6.14127 6.01750
SMTInterpol SMTInterpol unsat ✅ 5.90453 17.10391
Yices2 Yices2 unsat ✅ 0.54628 0.41858
Z3alpha Z3-alpha unknown ❌ 1201.00525 4801.33062
Z3 Z3-alpha-base unsat ✅ 956.20603 955.93759
Z3-Owl-base unknown ❌ 1201.29148 1200.99057
z3siri-base unsat ✅ 962.17888 961.96303
Z3-Owl Z3-Owl unknown ❌ 1201.76264 1201.02475