Benchmark

non-incremental/QF_BV/Sage2/bench_2686.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21868
Compressed Size2031
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21860
Compressed Size2022
Max. Term Depth60
Asserts 126
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not102 =106 let430
bvadd75 bvmul75 bvult19 zero_extend178

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 18.52340 18.52080
Boolector SMT17 final boolector sat ✅ 66.01390 66.00840
CVC4 CVC4-smtcomp2017-main default sat ✅ 115.79700 232.24700
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.84932 3.85022
MinkeyRink MinkeyRink 2017.3a default sat ✅ 2.70904 2.73812
Q3B Q3B default unknown ❌ 600.05600 1799.57000
STP stp_st default sat ✅ 9.41950 9.41937
stp_mt default sat ✅ 12.05800 37.51810
Yices2 Yices2-Main default sat ✅ 51.08290 51.06880
Z3 z3-4.5.0 default sat ✅ 589.01000 588.97500
SMT-COMP 2018 Boolector Boolector_default sat ✅ 43.39080 43.38960
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 9.78607 9.78513
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 11.31190 11.31330
MinkeyRink Minkeyrink MT_mt sat ✅ 0.44154 1.46376
Minkeyrink ST_st sat ✅ 4.93549 4.93534
STP STP-CMS-st-2018_default-no-stderr sat ✅ 9.27953 9.20560
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 4.13592 15.93390
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.39809 3.39793
Yices2 Yices 2.6.0_default sat ✅ 172.61200 172.61400
Z3 z3-4.7.1_default sat ✅ 99.55800 99.54980
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 18.04490 18.04370
Poolector-wrapped-sq_default sat ✅ 19.28130 76.01000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 20.79050 20.78910
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 34.97350 34.97190
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 4.22017 16.46300
MinkeyRink ST-wrapped-sq_default sat ✅ 2.28017 2.28004
Par4 Par4-wrapped-sq_default sat ✅ 12.15300 36.37000
STP STP-2019-wrapped-sq_default sat ✅ 18.35250 18.35230
stp-mergesat-fixed-wrapped-sq_default sat ✅ 16.58270 16.58130
stp-minisat-wrapped-sq_default sat ✅ 5.16484 5.16404
stp-mt-wrapped-sq_default sat ✅ 2.97065 11.25020
stp-portfolio-fixed-wrapped-sq_default sat ✅ 18.95360 40.84790
stp-riss-wrapped-sq_default unknown ❌ 0.15561 0.15581
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 12.13460 12.13440
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 4.47424 4.47402
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 27.84190 27.84000
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.88000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 7.77000 7.76986
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 136.21600 136.18600
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 19.95040 19.94030
Boolector Boolector-wrapped-sq_default sat ✅ 16.76920 16.76770
Poolector-wrapped-sq_default sat ✅ 4.29436 16.50000
CVC4 CVC4-sq-final_default sat ✅ 142.29900 142.26200
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.10000 1200.12000
MathSAT MathSAT5_default.sh sat ✅ 29.05780 29.05820
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08793 0.08817
MinkeyRink Solver 2020.3_default sat ✅ 2.17670 8.31469
STP STP_default sat ✅ 0.17872 0.48498
STP ++ Mergsat v1_default sat ✅ 13.00990 13.01110
Yices2 Yices 2.6.2 bug fix_default sat ✅ 27.52680 27.52850
Z3 z3-4.8.8_default sat ✅ 118.16400 118.12600
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 4.26069 4.26011
Bitwuzla-wrapped_default sat ✅ 5.07560 5.07506
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 66.79620 66.79550
MathSAT MathSAT-5.6.8_default sat ✅ 27.69620 27.69340
STP STP 2022.4_default sat ✅ 2.47701 2.47696
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 10.42320 10.42220
Z3++BV z3++bv_0702_default sat ✅ 47.78360 47.77420
Z3 z3-4.8.17_default sat ✅ 181.73900 181.74100
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.54720 11.54600
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 59.19300 59.19530
STP STP 2022.4_default sat ✅ 5.41730 5.41644
STP 2022.4_default sat ✅ 5.42965 5.42868
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1233.44000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 118.87300 118.86700
Z3-Owl z3-Owl-Final_default sat ✅ 69.94570 69.93680
z3-Owl-Final_default sat ✅ 46.25790 46.23630
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 75.32122 75.18377
cvc5 cvc5 sat ✅ 4.80818 4.70753
SMTInterpol SMTInterpol unknown ❌ 1201.73829 1216.64151
STP STP sat ✅ 16.85139 16.74435
Yices2 Yices2 sat ✅ 12.65498 12.54572
Z3alpha Z3-alpha sat ✅ 27.71365 27.61246
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.64670 1.52810
Bitwuzla-MachBV-base sat ✅ 12.00383 11.88495
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 11.46289 11.33464
BVDecide bv_decide sat ✅ 10.78023 10.64519
bv_decide-nokernel sat ✅ 10.72237 10.56053
cvc5 cvc5 sat ✅ 22.17178 22.03786
SMTInterpol SMTInterpol unknown ❌ 1201.38818 1236.89140
Yices2 Yices2 sat ✅ 7.58827 7.46993
Z3alpha Z3-alpha sat ✅ 74.20457 295.31596
Z3 Z3-alpha-base sat ✅ 132.06294 131.93100
Z3-Owl-base sat ✅ 541.35722 541.16014
z3siri-base sat ✅ 134.72866 134.57820
Z3-Owl Z3-Owl sat ✅ 48.38519 48.25932