Benchmark

non-incremental/QF_BV/Sage2/bench_6691.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size19128
Compressed Size1775
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 19120
Compressed Size1767
Max. Term Depth51
Asserts 112
Declared Functions0
Declared Constants16
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not94 =95 let373
bvadd62 bvmul62 bvult16 zero_extend155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 97.02550 97.00750
Boolector SMT17 final boolector sat ✅ 54.34280 54.33150
CVC4 CVC4-smtcomp2017-main default sat ✅ 43.87110 87.94100
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 11.04160 11.04210
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.85872 0.85986
Q3B Q3B default unknown ❌ 600.03600 1790.21000
STP stp_st default sat ✅ 5.26356 5.26250
stp_mt default sat ✅ 2.54101 9.61200
Yices2 Yices2-Main default sat ✅ 38.15610 38.15020
Z3 z3-4.5.0 default sat ✅ 202.81100 202.78600
SMT-COMP 2018 Boolector Boolector_default sat ✅ 5.77086 5.77058
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 70.31010 70.30610
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 34.03840 34.03810
MinkeyRink Minkeyrink MT_mt sat ✅ 1.07937 4.00141
Minkeyrink ST_st sat ✅ 3.83486 3.83468
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.06390 4.06402
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.74090 6.43827
STP-Riss-st-2018_riss-no-stderr sat ✅ 10.16370 10.16400
Yices2 Yices 2.6.0_default sat ✅ 102.07600 102.07800
Z3 z3-4.7.1_default sat ✅ 35.63080 35.62250
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 3.85000 3.84978
Poolector-wrapped-sq_default sat ✅ 4.21987 16.28000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 69.03190 69.02820
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 13.30840 13.30770
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 2.31533 8.87821
MinkeyRink ST-wrapped-sq_default sat ✅ 9.53568 9.53585
Par4 Par4-wrapped-sq_default sat ✅ 69.54260 208.36000
STP STP-2019-wrapped-sq_default sat ✅ 0.35633 0.35669
stp-mergesat-fixed-wrapped-sq_default sat ✅ 7.99594 7.99620
stp-minisat-wrapped-sq_default sat ✅ 13.07740 13.07670
stp-mt-wrapped-sq_default sat ✅ 0.38839 1.05668
stp-portfolio-fixed-wrapped-sq_default sat ✅ 13.10440 21.23920
stp-riss-wrapped-sq_default unknown ❌ 0.15104 0.15124
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 126.70100 126.69200
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 39.98710 39.98550
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 35.59440 35.59010
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.80000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 239.31400 239.30400
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 55.19770 55.19570
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 12.45420 12.45230
Boolector Boolector-wrapped-sq_default sat ✅ 10.44420 10.44470
Poolector-wrapped-sq_default sat ✅ 11.33240 44.35210
CVC4 CVC4-sq-final_default sat ✅ 92.45590 92.45630
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.97000
MathSAT MathSAT5_default.sh sat ✅ 120.71300 120.70900
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08250 0.08266
MinkeyRink Solver 2020.3_default sat ✅ 0.42854 1.45619
STP STP_default sat ✅ 2.09418 8.10276
STP ++ Mergsat v1_default sat ✅ 16.27130 16.27310
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.83637 0.83632
Z3 z3-4.8.8_default sat ✅ 127.10000 127.09500
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 18.09680 18.09680
MathSAT mathsat-5.6.6_default sat ✅ 52.07230 52.05860
STP STP 2021.0_default sat ✅ 0.26697 0.85354
Z3 z3-4.8.11_default sat ✅ 101.64600 101.63200
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 27.36110 27.36150
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 26.22070 26.21440
STP STP 2022.4_default sat ✅ 2.62945 2.62932
STP 2022.4_default sat ✅ 2.61188 2.61054
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.13000 1230.22000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 40.50600 40.50410
Z3-Owl z3-Owl-Final_default sat ✅ 22.12320 22.12360
z3-Owl-Final_default sat ✅ 18.53620 18.53470
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 18.45204 18.35157
cvc5 cvc5 sat ✅ 5.79454 5.69202
SMTInterpol SMTInterpol unknown ❌ 1201.71776 1226.03390
STP STP sat ✅ 11.70789 11.60708
Yices2 Yices2 sat ✅ 5.69772 5.59085
Z3alpha Z3-alpha sat ✅ 154.54186 154.43829