Benchmark

non-incremental/QF_BV/Sage2/bench_10741.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size57153
Compressed Size4434
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 57145
Compressed Size4447
Max. Term Depth42
Asserts 138
Declared Functions0
Declared Constants43
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not50 =55 let1200
bvor3 bvadd451 bvmul187 bvult16
bvule24 bvuge19 bvsgt4 bvsge19
bvshl77 zero_extend432

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.62482 0.62408
Boolector SMT17 final boolector unsat ✅ 2.02582 2.02479
CVC4 CVC4-smtcomp2017-main default unsat ✅ 80.90720 162.30200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 104.81000 104.80800
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.81403 0.79899
Q3B Q3B default unknown ❌ 600.08900 1787.91000
STP stp_st default unsat ✅ 23.11510 23.11210
stp_mt default unsat ✅ 25.94410 81.42260
Yices2 Yices2-Main default unsat ✅ 0.54934 0.54854
Z3 z3-4.5.0 default unsat ✅ 5.02381 5.01915
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.04569 4.04533
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 16.19910 16.19970
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 58.54650 58.54170
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.02040 3.73829
Minkeyrink ST_st unsat ✅ 3.82500 3.82449
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 75.57430 75.57350
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 55.77510 221.08300
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.02000 1199.97000
Yices2 Yices 2.6.0_default unsat ✅ 0.23477 0.23470
Z3 z3-4.7.1_default unsat ✅ 331.00000 330.94200
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 9.65563 9.65612
Poolector-wrapped-sq_default unsat ✅ 9.98333 39.18000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 12.07620 12.07280
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 26.25890 26.25900
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.36146 1.18600
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.34342 0.34353
Par4 Par4-wrapped-sq_default unsat ✅ 0.83830 2.30000
STP STP-2019-wrapped-sq_default unsat ✅ 24.46970 24.46860
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 72.54740 72.54660
stp-minisat-wrapped-sq_default unsat ✅ 1351.05000 1351.04000
stp-mt-wrapped-sq_default unsat ✅ 28.82480 113.81700
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1390.90000 1488.07000
stp-riss-wrapped-sq_default unknown ❌ 0.21052 0.21076
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.87134 0.87131
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.30680 0.30681
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.22022 0.22023
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.85000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.18559 0.18560
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 23.73210 23.72870
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 8.75374 8.75291
Bitwuzla-wrapped_default unsat ✅ 6.21487 6.21425
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 10.70180 10.70060
MathSAT MathSAT-5.6.8_default unsat ✅ 192.21500 192.22300
STP STP 2022.4_default unsat ✅ 0.74503 0.74501
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.35586 0.35578
Z3++BV z3++bv_0702_default unsat ✅ 14.61690 14.61580
Z3 z3-4.8.17_default unsat ✅ 14.56020 14.56060
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.84717 1.84702
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.40321 2.40372
STP STP 2022.4_default unsat ✅ 0.44967 0.44965
STP 2022.4_default unsat ✅ 0.44886 0.44881
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 34.76070 62.81500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30612 0.30609
Z3-Owl z3-Owl-Final_default unsat ✅ 1115.94000 1115.91000
z3-Owl-Final_default unsat ✅ 55.62200 55.61810
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 1.11909 1.01931
cvc5 cvc5 unsat ✅ 5.13207 5.03219
SMTInterpol SMTInterpol unsat ✅ 13.24924 33.27985
STP STP unsat ✅ 0.53151 0.43168
Yices2 Yices2 unsat ✅ 0.44659 0.34687
Z3alpha Z3-alpha unsat ✅ 4.50915 4.40918
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 1.36487 1.24716
Bitwuzla-MachBV-base unsat ✅ 1.19633 1.06821
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.31956 1.20561
BVDecide bv_decide unsat ✅ 9.95880 9.79622
bv_decide-nokernel unsat ✅ 8.45337 8.29250
cvc5 cvc5 unsat ✅ 2.56983 2.44575
SMTInterpol SMTInterpol unsat ✅ 6.74308 19.85330
Yices2 Yices2 unsat ✅ 0.52388 0.40744
Z3alpha Z3-alpha unsat ✅ 48.17823 191.30125
Z3 Z3-alpha-base unsat ✅ 143.30230 143.16830
Z3-Owl-base unsat ✅ 640.36603 640.19547
z3siri-base unsat ✅ 145.08762 144.92467
Z3-Owl Z3-Owl unknown ❌ 1201.75647 1201.00819