Benchmark

non-incremental/QF_BV/Sage2/bench_9346.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size58340
Compressed Size4371
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 58332
Compressed Size4385
Max. Term Depth42
Asserts 138
Declared Functions0
Declared Constants43
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not50 =55 let1200
bvor3 bvadd451 bvmul187 bvult16
bvule24 bvuge19 bvsgt4 bvsge19
bvshl77 zero_extend432

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.58452 0.58442
Boolector SMT17 final boolector unsat ✅ 1.43779 1.43683
CVC4 CVC4-smtcomp2017-main default unsat ✅ 9.00111 18.00810
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 67.63670 67.62620
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.37456 1.37486
Q3B Q3B default unknown ❌ 600.08600 1796.10000
STP stp_st default unsat ✅ 54.30500 54.28960
stp_mt default unsat ✅ 39.06530 125.17500
Yices2 Yices2-Main default unsat ✅ 0.42524 0.42526
Z3 z3-4.5.0 default unsat ✅ 4.70675 4.70570
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.39197 4.39065
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 13.93750 13.93550
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 89.19870 89.20250
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.15862 4.24253
Minkeyrink ST_st unsat ✅ 1.30228 1.30186
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 182.96200 182.95000
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 59.07520 234.42200
STP-Riss-st-2018_riss-no-stderr unsat ✅ 96.73760 96.73540
Yices2 Yices 2.6.0_default unsat ✅ 0.22409 0.22401
Z3 z3-4.7.1_default unsat ✅ 315.20100 315.17500
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 11.71030 11.71030
Boolector Boolector-wrapped-sq_default unsat ✅ 7.69994 7.69955
Poolector-wrapped-sq_default unsat ✅ 7.99605 31.32000
CVC4 CVC4-sq-final_default unsat ✅ 29.97020 29.96880
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1200.05000
MathSAT MathSAT5_default.sh unsat ✅ 310.58200 310.50000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.07273 0.07296
MinkeyRink Solver 2020.3_default unsat ✅ 0.50416 1.77742
STP STP_default unsat ✅ 0.52307 1.66522
STP ++ Mergsat v1_default unsat ✅ 0.58194 0.58358
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37361 0.37346
Z3 z3-4.8.8_default unsat ✅ 9.25567 9.25587
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.77759 1.77758
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 7.36231 7.35717
STP STP 2022.4_default unsat ✅ 0.49473 0.49468
STP 2022.4_default unsat ✅ 0.49717 0.49722
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 63.24090 91.82480
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.22225 0.22219
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.10000 1199.95000
z3-Owl-Final_default unsat ✅ 55.50130 55.49220
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.31118 1.21082
cvc5 cvc5 unsat ✅ 4.01544 3.91236
SMTInterpol SMTInterpol unsat ✅ 23.58871 45.47119
STP STP unsat ✅ 0.61219 0.51207
Yices2 Yices2 unsat ✅ 0.60498 0.50509
Z3alpha Z3-alpha unsat ✅ 8.52369 8.42044
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 1.36184 1.23889
Bitwuzla-MachBV-base unsat ✅ 1.09233 0.95796
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.31336 1.18796
BVDecide bv_decide unsat ✅ 8.29368 8.11856
bv_decide-nokernel unsat ✅ 6.86568 6.72370
cvc5 cvc5 unsat ✅ 1.61500 1.49670
SMTInterpol SMTInterpol unsat ✅ 9.01803 25.62433
Yices2 Yices2 unsat ✅ 0.51636 0.39674
Z3alpha Z3-alpha unsat ✅ 26.38209 104.13789
Z3 Z3-alpha-base unsat ✅ 291.04549 290.90118
Z3-Owl-base unknown ❌ 1201.29334 1201.05810
z3siri-base unsat ✅ 294.21883 294.03255
Z3-Owl Z3-Owl unknown ❌ 1201.78925 1200.90346