Benchmark

non-incremental/QF_BV/Sage2/bench_6712.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size190097
Compressed Size6851
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 190089
Compressed Size6783
Max. Term Depth183
Asserts 265
Declared Functions0
Declared Constants57
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not62 =63 let4427
bvand1 bvadd2693 bvmul40 bvult56
bvule62 bvugt20 bvuge63 bvlshr36
zero_extend1595

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.10418 0.10365
Boolector SMT17 final boolector unsat ✅ 0.10157 0.10113
CVC4 CVC4-smtcomp2017-main default unsat ✅ 36.83490 73.80560
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.79487 0.79410
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.03676 0.03517
Q3B Q3B default unknown ❌ 600.06100 1787.32000
STP stp_st default unknown ❌ 600.02300 600.03300
stp_mt default unknown ❌ 600.05900 2385.56000
Yices2 Yices2-Main default unsat ✅ 0.02065 0.02002
Z3 z3-4.5.0 default unknown ❌ 600.10500 599.99700
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unsat ✅ 0.06507 0.06501
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 7.80529 7.80493
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.48858 0.48979
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.03596 0.03599
Minkeyrink ST_st unsat ✅ 0.03538 0.03541
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.02000 1199.91000
STP-CMS-mt-2018_multicore-no-stderr unknown ❌ 1200.05000 4772.48000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.10000 1200.01000
Yices2 Yices 2.6.0_default unsat ✅ 0.02101 0.02096
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.94000
SMT-COMP 2019 0.25 (6/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.12968 0.12967
Poolector-wrapped-sq_default unsat ✅ 0.17846 0.25544
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 3.63635 3.63613
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 18.67290 18.67420
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04244 0.04261
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04115 0.04121
Par4 Par4-wrapped-sq_default unsat ✅ 0.03122 0.00496
STP STP-2019-wrapped-sq_default unknown ❌ 2400.03000 2400.00000
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.01000 2399.94000
stp-minisat-wrapped-sq_default unknown ❌ 2400.02000 2399.67000
stp-mt-wrapped-sq_default unknown ❌ 2400.06000 9534.05000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.08000 7198.90000
stp-riss-wrapped-sq_default unknown ❌ 0.50447 0.50472
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02168 0.02170
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.02178 0.02181
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.02232 0.02233
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.14665 0.14641
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.02203 0.02200
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.01000 2399.84000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.13748 0.13739
Boolector Boolector-wrapped-sq_default unsat ✅ 0.12666 0.12668
Poolector-wrapped-sq_default unsat ✅ 0.17978 0.25371
CVC4 CVC4-sq-final_default unsat ✅ 16.81300 16.81160
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.68000
MathSAT MathSAT5_default.sh unsat ✅ 0.20463 0.20453
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.03660 0.03667
MinkeyRink Solver 2020.3_default unsat ✅ 0.03802 0.03815
STP STP_default unsat ✅ 0.11960 0.14410
STP ++ Mergsat v1_default unsat ✅ 0.10233 0.10417
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02161 0.02155
Z3 z3-4.8.8_default unsat ✅ 430.13400 429.98400
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.13858 0.13855
MathSAT mathsat-5.6.6_default unsat ✅ 0.21395 0.21394
STP STP 2021.0_default unsat ✅ 0.12297 0.14816
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.13687 0.13662
Bitwuzla-wrapped_default unsat ✅ 0.14677 0.14671
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 19.12820 19.12860
MathSAT MathSAT-5.6.8_default unsat ✅ 0.23483 0.23473
STP STP 2022.4_default unsat ✅ 0.02971 0.02974
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.02251 0.02247
Z3++BV z3++bv_0702_default unknown ❌ 1200.05000 1199.91000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.99000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 9.93158 9.82554
cvc5 cvc5 unsat ✅ 18.56498 18.46514
SMTInterpol SMTInterpol unsat ✅ 4.60372 13.60018
STP STP unsat ✅ 0.29636 0.19655
Yices2 Yices2 unsat ✅ 0.24423 0.14442
Z3alpha Z3-alpha unknown ❌ 1201.71287 1201.08204
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 9.00365 8.87147
Bitwuzla-MachBV-base unsat ✅ 5.16964 5.04933
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 2.06056 1.94341
BVDecide bv_decide unsat ✅ 5.23032 5.07082
bv_decide-nokernel unsat ✅ 2.68475 2.52631
cvc5 cvc5 unsat ✅ 12.86953 12.74587
SMTInterpol SMTInterpol unsat ✅ 2.35457 6.66014
Yices2 Yices2 unsat ✅ 0.29047 0.16511
Z3alpha Z3-alpha unknown ❌ 1201.00612 4802.24012
Z3 Z3-alpha-base unknown ❌ 1201.27407 1201.03141
Z3-Owl-base unknown ❌ 1201.29502 1201.04920
z3siri-base unknown ❌ 1201.27288 1201.02274
Z3-Owl Z3-Owl unknown ❌ 1201.75806 1201.05030