Benchmark

non-incremental/QF_BV/Sage2/bench_5235.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size19720
Compressed Size2017
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 19712
Compressed Size2011
Max. Term Depth60
Asserts 118
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not93 =98 let369
bvadd62 bvmul62 bvult19 zero_extend152

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 15.84010 15.83700
Boolector SMT17 final boolector sat ✅ 143.99000 143.97800
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.74104 7.47596
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 10.84200 10.84210
MinkeyRink MinkeyRink 2017.3a default sat ✅ 5.34097 5.34000
Q3B Q3B default unknown ❌ 600.08400 1799.83000
STP stp_st default sat ✅ 5.99645 4.95800
stp_mt default sat ✅ 2.19092 8.26951
Yices2 Yices2-Main default sat ✅ 409.55000 409.52100
Z3 z3-4.5.0 default sat ✅ 168.97800 168.97100
SMT-COMP 2018 Boolector Boolector_default sat ✅ 18.15520 18.15570
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.07636 8.07636
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 22.45630 22.45610
MinkeyRink Minkeyrink MT_mt sat ✅ 1.55628 5.89086
Minkeyrink ST_st sat ✅ 9.43839 9.43694
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.39650 0.39646
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.41643 1.27614
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.82188 4.81848
Yices2 Yices 2.6.0_default sat ✅ 16.46560 16.46590
Z3 z3-4.7.1_default sat ✅ 211.99000 211.98000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 19.84600 19.84360
Boolector Boolector-wrapped-sq_default sat ✅ 12.72900 12.72770
Poolector-wrapped-sq_default sat ✅ 14.31410 56.26000
CVC4 CVC4-sq-final_default sat ✅ 223.46200 223.43400
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1199.98000
MathSAT MathSAT5_default.sh sat ✅ 169.26300 169.25000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08479 0.08502
MinkeyRink Solver 2020.3_default sat ✅ 5.99826 23.47350
STP STP_default sat ✅ 3.40048 13.25010
STP ++ Mergsat v1_default sat ✅ 14.63720 14.63720
Yices2 Yices 2.6.2 bug fix_default sat ✅ 19.97720 19.97450
Z3 z3-4.8.8_default sat ✅ 33.71690 33.71090
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 12.26490 12.26480
Bitwuzla-wrapped_default sat ✅ 16.55180 16.54990
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 478.63200 478.62100
MathSAT MathSAT-5.6.8_default sat ✅ 26.24940 26.25090
STP STP 2022.4_default sat ✅ 2.09760 2.09730
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 200.79300 200.79600
Z3++BV z3++bv_0702_default sat ✅ 35.65310 35.64120
Z3 z3-4.8.17_default sat ✅ 38.91080 38.90350
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 17.96820 17.96070
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 126.03000 126.02800
STP STP 2022.4_default sat ✅ 6.80391 6.80272
STP 2022.4_default sat ✅ 6.82676 6.82620
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1236.21000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 12.51120 12.50990
Z3-Owl z3-Owl-Final_default sat ✅ 42.64610 42.64040
z3-Owl-Final_default sat ✅ 41.96530 41.95370
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 76.49157 76.36200
cvc5 cvc5 sat ✅ 86.92471 86.82396
SMTInterpol SMTInterpol unknown ❌ 1201.72369 1238.69589
STP STP sat ✅ 16.67031 16.56272
Yices2 Yices2 sat ✅ 1.55042 1.45078
Z3alpha Z3-alpha sat ✅ 13.02057 12.91704
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 2.41842 2.29129
Bitwuzla-MachBV-base sat ✅ 9.69035 9.56881
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 21.81972 21.69837
BVDecide bv_decide sat ✅ 73.39236 73.29692
bv_decide-nokernel sat ✅ 73.14447 73.00608
cvc5 cvc5 sat ✅ 60.16863 60.04352
SMTInterpol SMTInterpol unknown ❌ 1201.81697 1234.55645
Yices2 Yices2 sat ✅ 25.67370 25.55768
Z3alpha Z3-alpha sat ✅ 11.85619 45.98768
Z3 Z3-alpha-base sat ✅ 25.98585 25.85547
Z3-Owl-base sat ✅ 108.25168 108.11169
z3siri-base sat ✅ 26.26141 26.13772
Z3-Owl Z3-Owl sat ✅ 8.64211 8.51250