Benchmark

non-incremental/QF_BV/Sage2/bench_5475.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22525
Compressed Size1874
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 22517
Compressed Size1867
Max. Term Depth57
Asserts 110
Declared Functions0
Declared Constants18
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not88 =91 let442
bvadd89 bvmul89 bvult18 zero_extend176

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 42.59060 42.01840
Boolector SMT17 final boolector sat ✅ 44.12740 44.11950
CVC4 CVC4-smtcomp2017-main default sat ✅ 169.99100 341.74300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 33.77920 33.77550
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.54739 0.53530
Q3B Q3B default unknown ❌ 600.01900 1799.06000
STP stp_st default sat ✅ 4.39857 4.39775
stp_mt default sat ✅ 2.71094 10.20630
Yices2 Yices2-Main default sat ✅ 176.26900 176.27400
Z3 z3-4.5.0 default sat ✅ 131.69100 131.65900
SMT-COMP 2018 Boolector Boolector_default sat ✅ 38.64950 38.64700
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 46.56230 46.55800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.58287 0.58378
MinkeyRink Minkeyrink MT_mt sat ✅ 2.56688 9.89079
Minkeyrink ST_st sat ✅ 7.80158 7.80000
STP STP-CMS-st-2018_default-no-stderr sat ✅ 5.50644 5.50659
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 5.81843 22.63530
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.26465 1.26469
Yices2 Yices 2.6.0_default sat ✅ 11.84370 11.84100
Z3 z3-4.7.1_default sat ✅ 483.55900 483.55000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 14.70030 14.70030
Poolector-wrapped-sq_default sat ✅ 6.64721 25.98760
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 19.70090 19.70000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 69.56730 69.55960
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.82675 3.01556
MinkeyRink ST-wrapped-sq_default sat ✅ 0.79742 0.79728
Par4 Par4-wrapped-sq_default sat ✅ 7.81329 23.34000
STP STP-2019-wrapped-sq_default sat ✅ 9.26029 9.25924
stp-mergesat-fixed-wrapped-sq_default sat ✅ 17.76030 17.75550
stp-minisat-wrapped-sq_default sat ✅ 9.03378 9.03370
stp-mt-wrapped-sq_default sat ✅ 3.67789 13.95870
stp-portfolio-fixed-wrapped-sq_default sat ✅ 19.26830 39.25790
stp-riss-wrapped-sq_default unknown ❌ 0.16525 0.16542
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 7.97024 7.96868
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 10.64340 10.64210
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 27.41560 27.40780
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.83000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 32.24090 32.23470
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 105.32200 105.30100
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 5.95119 5.94947
Bitwuzla-wrapped_default sat ✅ 18.26040 18.25920
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 5.16809 5.16833
MathSAT MathSAT-5.6.8_default sat ✅ 25.06370 25.05960
STP STP 2022.4_default sat ✅ 2.10834 2.10825
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 17.46830 17.46750
Z3++BV z3++bv_0702_default sat ✅ 136.54000 136.52500
Z3 z3-4.8.17_default sat ✅ 101.76000 101.75600
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.50071 3.50045
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 127.39800 127.38200
STP STP 2022.4_default sat ✅ 2.66444 2.66428
STP 2022.4_default sat ✅ 2.67797 2.67500
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1229.72000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 39.93630 39.93560
Z3-Owl z3-Owl-Final_default sat ✅ 34.92960 34.92620
z3-Owl-Final_default sat ✅ 29.02650 29.00810
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 26.72437 26.60731
cvc5 cvc5 sat ✅ 91.94495 91.78964
SMTInterpol SMTInterpol sat ✅ 1072.48939 1109.16069
STP STP sat ✅ 8.56421 8.46080
Yices2 Yices2 sat ✅ 3.99864 3.89717
Z3alpha Z3-alpha sat ✅ 214.71517 214.53038