Benchmark

non-incremental/QF_BV/Sage2/bench_1351.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size20897
Compressed Size1891
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20889
Compressed Size1884
Max. Term Depth60
Asserts 111
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not86 =91 let413
bvadd82 bvmul82 bvult19 zero_extend163

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 26.29800 26.29500
Boolector SMT17 final boolector sat ✅ 139.48900 139.47500
CVC4 CVC4-smtcomp2017-main default sat ✅ 385.84700 774.68100
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.97100 4.97190
MinkeyRink MinkeyRink 2017.3a default sat ✅ 8.95128 12.91000
Q3B Q3B default unknown ❌ 600.03300 1787.63000
STP stp_st default sat ✅ 5.53046 4.77252
stp_mt default sat ✅ 1.44716 5.25598
Yices2 Yices2-Main default sat ✅ 11.14790 11.14730
Z3 z3-4.5.0 default sat ✅ 404.46700 404.41300
SMT-COMP 2018 Boolector Boolector_default sat ✅ 7.97852 7.97809
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 67.47780 67.46800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 13.45120 13.45170
MinkeyRink Minkeyrink MT_mt sat ✅ 4.17744 16.30790
Minkeyrink ST_st sat ✅ 4.47951 4.47910
STP STP-CMS-st-2018_default-no-stderr sat ✅ 11.01510 11.01540
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.43417 13.12150
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.72136 2.72118
Yices2 Yices 2.6.0_default sat ✅ 9.88251 9.88065
Z3 z3-4.7.1_default sat ✅ 318.72800 318.72100
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 3.84610 3.84600
Poolector-wrapped-sq_default sat ✅ 1.28994 4.63000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 41.87800 41.87250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 33.76560 33.76380
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.47817 1.62073
MinkeyRink ST-wrapped-sq_default sat ✅ 9.24840 9.24843
Par4 Par4-wrapped-sq_default sat ✅ 7.53375 22.43000
STP STP-2019-wrapped-sq_default sat ✅ 3.72334 3.72357
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.85252 5.85269
stp-minisat-wrapped-sq_default sat ✅ 6.29099 6.28997
stp-mt-wrapped-sq_default sat ✅ 6.09211 23.65990
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.45614 15.91430
stp-riss-wrapped-sq_default unknown ❌ 0.15247 0.15267
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 7.61134 7.61083
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.16606 1.16601
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 14.46890 14.46850
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2400.14000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.19918 0.19918
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 178.48900 178.44900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 14.12760 14.12700
Boolector Boolector-wrapped-sq_default sat ✅ 19.26210 19.25950
Poolector-wrapped-sq_default sat ✅ 21.22370 83.41000
CVC4 CVC4-sq-final_default sat ✅ 59.46710 59.46010
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1199.94000
MathSAT MathSAT5_default.sh sat ✅ 24.35310 24.35240
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08489 0.08515
MinkeyRink Solver 2020.3_default sat ✅ 0.76918 2.77817
STP STP_default sat ✅ 0.41502 1.41268
STP ++ Mergsat v1_default sat ✅ 10.80320 10.80500
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.12478 1.12453
Z3 z3-4.8.8_default sat ✅ 296.71800 296.63900
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 10.88080 10.87930
Bitwuzla-wrapped_default sat ✅ 2.41218 2.41190
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 49.58290 49.58090
MathSAT MathSAT-5.6.8_default sat ✅ 10.31160 10.31030
STP STP 2022.4_default sat ✅ 1.60393 1.60390
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 13.80160 13.79890
Z3++BV z3++bv_0702_default sat ✅ 35.97890 35.96790
Z3 z3-4.8.17_default sat ✅ 386.28700 386.24100
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 16.63080 16.62850
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 56.99910 56.99130
STP STP 2022.4_default sat ✅ 3.52457 3.52435
STP 2022.4_default sat ✅ 3.53454 3.53221
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 816.80600 851.63500
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 13.34630 13.34490
Z3-Owl z3-Owl-Final_default sat ✅ 52.46880 52.45740
z3-Owl-Final_default sat ✅ 71.86370 71.87010
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 9.75656 9.65047
cvc5 cvc5 sat ✅ 1.51711 1.41720
SMTInterpol SMTInterpol unknown ❌ 1201.71410 1222.32469
STP STP sat ✅ 46.12850 46.00840
Yices2 Yices2 sat ✅ 31.70439 31.59842
Z3alpha Z3-alpha sat ✅ 36.88908 36.77453