Benchmark

non-incremental/QF_BV/Sage2/bench_17525.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size263888
Compressed Size6560
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 263880
Compressed Size6551
Max. Term Depth140
Asserts 190
Declared Functions0
Declared Constants92
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not25 =26 let6191
extract1 bvor2 bvadd2250 bvmul180
bvult30 bvule56 bvugt7 bvuge69
bvsge1 bvshl1590 bvlshr18 zero_extend2125

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.30104 0.30042
Boolector SMT17 final boolector unsat ✅ 2.18706 2.18564
CVC4 CVC4-smtcomp2017-main default unsat ✅ 31.73140 63.71420
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01400 599.83000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.87137 0.86166
Q3B Q3B default unknown ❌ 600.04000 1788.40000
STP stp_st default unsat ✅ 146.59100 146.59600
stp_mt default unsat ✅ 112.16800 445.20700
Yices2 Yices2-Main default unsat ✅ 1.29652 1.29585
Z3 z3-4.5.0 default unsat ✅ 132.79000 132.76300
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.56815 0.56789
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 27.92030 27.91740
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.96000
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.63707 1.91052
Minkeyrink ST_st unsat ✅ 1.72577 1.72575
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 25.28770 25.28730
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 30.67640 121.25300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 7.96341 7.96339
Yices2 Yices 2.6.0_default unsat ✅ 1.73692 1.73672
Z3 z3-4.7.1_default unsat ✅ 371.91300 371.90700
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.45547 0.45548
Poolector-wrapped-sq_default unsat ✅ 0.47942 0.40263
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 2.74189 2.74171
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 57.63410 57.62450
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.45306 1.26542
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.43792 0.43796
Par4 Par4-wrapped-sq_default unsat ✅ 0.61654 1.63000
STP STP-2019-wrapped-sq_default unsat ✅ 993.95200 993.93600
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 2119.57000 2119.48000
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2400.02000
stp-mt-wrapped-sq_default unsat ✅ 1184.79000 4707.52000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.05000 5914.39000
stp-riss-wrapped-sq_default unknown ❌ 0.24304 0.24323
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 2.95264 2.95255
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 1.60156 1.60156
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 1.48727 1.48730
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2400.01000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 1.41621 1.41623
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.90000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.52250 0.52248
Boolector Boolector-wrapped-sq_default unsat ✅ 0.38663 0.38664
Poolector-wrapped-sq_default unsat ✅ 0.47996 0.42937
CVC4 CVC4-sq-final_default unsat ✅ 83.30150 83.28560
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1200.02000
MathSAT MathSAT5_default.sh unknown ❌ 1200.08000 1199.91000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.17675 0.17685
MinkeyRink Solver 2020.3_default unsat ✅ 0.36902 0.93412
STP STP_default unsat ✅ 0.47879 1.47663
STP ++ Mergsat v1_default unsat ✅ 0.42403 0.42568
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.55666 1.55658
Z3 z3-4.8.8_default unsat ✅ 38.00260 38.00390
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41412 0.41402
Bitwuzla-wrapped_default unsat ✅ 0.84407 0.84397
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 58.59480 58.58660
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.10000 1199.95000
STP STP 2022.4_default unsat ✅ 0.55950 0.55937
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.68885 1.68881
Z3++BV z3++bv_0702_default unsat ✅ 10.03120 10.03150
Z3 z3-4.8.17_default unsat ✅ 37.10510 37.10780
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14256 1.14244
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 182.10600 182.10600
STP STP 2022.4_default unsat ✅ 0.30981 0.30976
STP 2022.4_default unsat ✅ 0.30777 0.30782
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 9.08305 27.38040
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 2.40142 2.40114
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.01000 1199.93000
z3-Owl-Final_default unsat ✅ 152.25800 152.24100
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.89294 0.79329
cvc5 cvc5 unsat ✅ 45.61575 45.51535
SMTInterpol SMTInterpol unsat ✅ 5.49314 16.14029
STP STP unsat ✅ 0.62307 0.52308
Yices2 Yices2 unsat ✅ 1.41525 1.31301
Z3alpha Z3-alpha unknown ❌ 1201.71880 1200.74250