Benchmark

non-incremental/QF_BV/Sage2/bench_3610.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size25603
Compressed Size2161
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 25595
Compressed Size2173
Max. Term Depth75
Asserts 136
Declared Functions0
Declared Constants24
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not113 =115 let508
bvadd96 bvmul96 bvult20 zero_extend203

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 112.99800 112.99200
Boolector SMT17 final boolector sat ✅ 82.06320 82.06560
CVC4 CVC4-smtcomp2017-main default sat ✅ 46.40740 93.00530
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 11.76270 11.76270
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.57196 0.53807
Q3B Q3B default unknown ❌ 600.04100 1786.68000
STP stp_st default sat ✅ 4.33066 4.33030
stp_mt default sat ✅ 0.99909 3.30383
Yices2 Yices2-Main default sat ✅ 560.03500 560.00600
Z3 z3-4.5.0 default sat ✅ 257.98700 257.93900
SMT-COMP 2018 Boolector Boolector_default sat ✅ 93.91840 93.91030
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 93.59270 93.58590
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.41961 1.42038
MinkeyRink Minkeyrink MT_mt sat ✅ 0.44159 1.40946
Minkeyrink ST_st sat ✅ 0.79015 0.78999
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.51933 2.51923
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.00511 11.28780
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.32449 5.32433
Yices2 Yices 2.6.0_default sat ✅ 58.06680 58.05800
Z3 z3-4.7.1_default sat ✅ 625.35500 625.30100
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 13.82580 13.82580
MathSAT mathsat-5.6.6_default sat ✅ 1.12636 1.12625
STP STP 2021.0_default sat ✅ 1.15668 4.27149
Z3 z3-4.8.11_default sat ✅ 823.49000 823.31400
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 7.74821 7.74761
Bitwuzla-wrapped_default sat ✅ 5.47854 5.47598
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 13.77270 13.77290
MathSAT MathSAT-5.6.8_default sat ✅ 2.88795 2.88789
STP STP 2022.4_default sat ✅ 3.99485 7.94096
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 7.49508 7.49503
Z3++BV z3++bv_0702_default sat ✅ 39.77050 39.76850
Z3 z3-4.8.17_default sat ✅ 88.09540 88.06250
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 4.79047 4.79032
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 458.72700 458.65500
STP STP 2022.4_default sat ✅ 2.08949 2.08943
STP 2022.4_default sat ✅ 2.07564 2.07563
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 1089.97000 1123.49000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 139.55800 139.54600
Z3-Owl z3-Owl-Final_default sat ✅ 14.18810 14.18730
z3-Owl-Final_default sat ✅ 20.77790 20.74790
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 123.58758 123.48226
cvc5 cvc5 sat ✅ 56.04038 55.93960
SMTInterpol SMTInterpol unknown ❌ 1201.74149 1219.15548
STP STP sat ✅ 5.67443 5.57146
Yices2 Yices2 sat ✅ 15.84527 15.73856
Z3alpha Z3-alpha sat ✅ 3.42844 3.32862