Benchmark

non-incremental/QF_BV/Sage2/bench_3513.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size26077
Compressed Size2133
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 26069
Compressed Size2147
Max. Term Depth75
Asserts 139
Declared Functions0
Declared Constants24
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not115 =118 let517
bvadd98 bvmul98 bvult20 zero_extend206

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 45.34420 45.32690
Boolector SMT17 final boolector sat ✅ 36.06960 36.06470
CVC4 CVC4-smtcomp2017-main default sat ✅ 78.41370 157.23900
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 9.00022 8.99928
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.42009 0.39514
Q3B Q3B default unknown ❌ 600.06200 1432.28000
STP stp_st default sat ✅ 2.70678 2.70621
stp_mt default sat ✅ 2.27019 6.46971
Yices2 Yices2-Main default sat ✅ 92.48020 92.47840
Z3 z3-4.5.0 default sat ✅ 173.54400 173.51300
SMT-COMP 2018 Boolector Boolector_default sat ✅ 16.65350 16.65270
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 102.45700 102.44600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 30.81530 30.80900
MinkeyRink Minkeyrink MT_mt sat ✅ 0.64142 2.18308
Minkeyrink ST_st sat ✅ 1.82280 1.82258
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.98364 2.98383
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.70801 14.04680
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.08533 3.08526
Yices2 Yices 2.6.0_default sat ✅ 228.89800 228.88700
Z3 z3-4.7.1_default sat ✅ 569.71200 569.69900
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.35406 5.35340
Boolector Boolector-wrapped-sq_default sat ✅ 15.56570 15.56250
Poolector-wrapped-sq_default sat ✅ 17.44080 68.69000
CVC4 CVC4-sq-final_default sat ✅ 11.18580 11.18490
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1199.95000
MathSAT MathSAT5_default.sh sat ✅ 11.37020 11.37060
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.11502 0.11527
MinkeyRink Solver 2020.3_default sat ✅ 0.34064 1.00525
STP STP_default sat ✅ 2.38125 9.14882
STP ++ Mergsat v1_default sat ✅ 19.65010 19.65130
Yices2 Yices 2.6.2 bug fix_default sat ✅ 37.73620 37.73390
Z3 z3-4.8.8_default sat ✅ 327.56800 327.53000
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 5.10090 5.10052
MathSAT mathsat-5.6.6_default sat ✅ 11.51550 11.51460
STP STP 2021.0_default sat ✅ 2.23546 8.57137
Z3 z3-4.8.11_default sat ✅ 386.52900 386.50500
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 14.32920 14.32870
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 86.42180 86.39460
STP STP 2022.4_default sat ✅ 0.88321 0.88319
STP 2022.4_default sat ✅ 0.87862 0.87864
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 1187.00000 1222.12000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 195.60200 195.56900
Z3-Owl z3-Owl-Final_default sat ✅ 21.32530 21.32370
z3-Owl-Final_default sat ✅ 29.79190 29.78990
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 29.08699 28.98265
cvc5 cvc5 sat ✅ 3.72061 3.61900
SMTInterpol SMTInterpol unknown ❌ 1201.72294 1221.02163
STP STP sat ✅ 13.77033 13.66966
Yices2 Yices2 sat ✅ 5.63556 5.53303
Z3alpha Z3-alpha sat ✅ 250.60427 250.44978