Benchmark

non-incremental/QF_BV/Sage2/bench_17900.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size154326
Compressed Size13000
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 154318
Compressed Size12927
Max. Term Depth87
Asserts 529
Declared Functions0
Declared Constants172
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite12 not57 =131
let2875 extract67 bvand17 bvor85
bvadd1143 bvmul538 bvult128 bvule153
bvugt41 bvuge87 bvshl105 bvlshr52
zero_extend787

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.22107 0.22030
Boolector SMT17 final boolector unsat ✅ 0.94362 0.94276
CVC4 CVC4-smtcomp2017-main default unsat ✅ 82.97000 166.47500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.59436 2.59458
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.39120 0.34429
Q3B Q3B default unknown ❌ 600.03100 1799.63000
STP stp_st default unsat ✅ 51.45670 51.45540
stp_mt default unsat ✅ 46.19100 182.88200
Yices2 Yices2-Main default unsat ✅ 0.05581 0.05578
Z3 z3-4.5.0 default unsat ✅ 415.78500 415.74700
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.19750 0.19743
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1154.12000 1154.02000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 2.69983 2.70067
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.21565 0.31694
Minkeyrink ST_st unsat ✅ 0.21098 0.21108
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 74.01090 74.00020
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 55.62950 220.22800
STP-Riss-st-2018_riss-no-stderr unsat ✅ 28.13140 28.12700
Yices2 Yices 2.6.0_default unsat ✅ 0.04793 0.04785
Z3 z3-4.7.1_default unsat ✅ 7.07021 7.07010
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.31568 0.31572
Poolector-wrapped-sq_default unsat ✅ 0.28758 0.26166
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.03787 1.03785
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 516.11600 516.01800
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.21961 0.33191
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.20546 0.20551
Par4 Par4-wrapped-sq_default unsat ✅ 0.05806 0.00583
STP STP-2019-wrapped-sq_default unsat ✅ 94.53400 94.53730
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 375.61600 375.52000
stp-minisat-wrapped-sq_default unsat ✅ 148.10600 148.11600
stp-mt-wrapped-sq_default unsat ✅ 73.41270 284.47200
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 382.55400 637.52000
stp-riss-wrapped-sq_default unknown ❌ 0.31458 0.31475
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05396 0.05398
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09805 0.09807
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08670 0.08671
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 6.81077 6.81071
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.11541 0.11545
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.31330 1.31334
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.33745 0.33735
Bitwuzla-wrapped_default unsat ✅ 0.25948 0.25941
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 257.57400 257.54100
MathSAT MathSAT-5.6.8_default unsat ✅ 2.63656 2.63621
STP STP 2022.4_default unsat ✅ 0.18560 0.18562
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.08321 0.08317
Z3++BV z3++bv_0702_default unsat ✅ 10.33600 10.33490
Z3 z3-4.8.17_default unsat ✅ 1.08911 1.09084
SMT-COMP 2023 0.33 (4/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.54032 0.54020
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 270.79700 270.75200
STP STP 2022.4_default unsat ✅ 0.19654 0.19653
STP 2022.4_default unsat ✅ 0.20083 0.20086
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1239.46000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.06270 0.06267
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.01000 1199.88000
z3-Owl-Final_default unknown ❌ 1200.11000 1200.17000