Benchmark

non-incremental/QF_BV/Sage2/bench_6398.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1825129
Compressed Size24096
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1825121
Compressed Size24106
Max. Term Depth397
Asserts 605
Declared Functions0
Declared Constants312
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not108 =118 let41044
extract19 bvand13 bvor20 bvadd15060
bvmul536 bvult91 bvule112 bvugt16
bvuge249 bvsle1 bvsgt8 bvsge9
bvshl10762 bvlshr161 bvashr28 zero_extend14337

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 27.43750 27.43520
Boolector SMT17 final boolector unknown ❌ 600.03200 599.94000
CVC4 CVC4-smtcomp2017-main default sat ✅ 235.56900 472.30600
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 21.00590 21.00630
MinkeyRink MinkeyRink 2017.3a default sat ✅ 7.90750 10.07000
Q3B Q3B default unknown ❌ 600.11600 1799.77000
STP stp_st default unknown ❌ 600.09800 600.05200
stp_mt default unknown ❌ 600.03900 1905.30000
Yices2 Yices2-Main default sat ✅ 0.26241 0.26110
Z3 z3-4.5.0 default unknown ❌ 600.11700 600.09800
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 3.67655 3.67666
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 20.16840 20.16930
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 348.19500 348.20500
MinkeyRink Minkeyrink MT_mt sat ✅ 11.28380 42.61170
Minkeyrink ST_st sat ✅ 9.21915 9.21815
STP STP-CMS-st-2018_default-no-stderr sat ✅ 631.54100 631.49600
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 218.67400 863.43600
STP-Riss-st-2018_riss-no-stderr sat ✅ 13.26910 13.26980
Yices2 Yices 2.6.0_default sat ✅ 0.23328 0.23300
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.05000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 4.32630 4.32622
Poolector-wrapped-sq_default sat ✅ 5.26995 20.47530
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 631.52700 631.37400
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 14.71580 14.71310
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 3.98419 13.72700
MinkeyRink ST-wrapped-sq_default sat ✅ 9.16283 9.16265
Par4 Par4-wrapped-sq_default sat ✅ 0.27270 0.00605
STP STP-2019-wrapped-sq_default sat ✅ 91.45950 91.42370
stp-mergesat-fixed-wrapped-sq_default sat ✅ 89.51880 89.48730
stp-minisat-wrapped-sq_default sat ✅ 94.29400 94.28910
stp-mt-wrapped-sq_default sat ✅ 163.55500 642.89600
stp-portfolio-fixed-wrapped-sq_default sat ✅ 108.72000 320.56300
stp-riss-wrapped-sq_default unknown ❌ 1.85163 1.85179
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.26530 0.26532
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.57484 1.57476
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 3.42412 3.42412
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.95000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.38855 0.38854
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.72000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.71856 5.71822
Boolector Boolector-wrapped-sq_default sat ✅ 5.40242 5.40084
Poolector-wrapped-sq_default sat ✅ 6.49455 25.09640
CVC4 CVC4-sq-final_default sat ✅ 13.01230 13.01020
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.94000
MathSAT MathSAT5_default.sh sat ✅ 189.47900 189.40200
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.73405 0.72006
MinkeyRink Solver 2020.3_default sat ✅ 14.53930 54.33100
STP STP_default sat ✅ 8.69475 32.79980
STP ++ Mergsat v1_default sat ✅ 8.41943 8.42098
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.02016 1.02008
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.61000
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.06370 11.06150
Bitwuzla-wrapped_default sat ✅ 9.81100 9.80860
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 23.97360 23.97140
MathSAT MathSAT-5.6.8_default sat ✅ 689.26900 689.03300
STP STP 2022.4_default sat ✅ 2.13432 2.13418
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.31476 1.31468
Z3++BV z3++bv_0702_default sat ✅ 25.67100 25.65200
Z3 z3-4.8.17_default unknown ❌ 1200.11000 1199.81000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 3.50187 3.39958
cvc5 cvc5 sat ✅ 10.45977 10.36000
SMTInterpol SMTInterpol sat ✅ 84.10401 115.73672
STP STP sat ✅ 2.63440 2.53449
Yices2 Yices2 sat ✅ 0.98552 0.88571
Z3alpha Z3-alpha unknown ❌ 1201.73948 1201.19420
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 0.92213 0.80647
Bitwuzla-MachBV-base sat ✅ 2.22787 2.10956
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.32727 2.19968
BVDecide bv_decide sat ✅ 26.90964 26.75500
bv_decide-nokernel sat ✅ 26.42678 26.27443
cvc5 cvc5 sat ✅ 14.65160 14.52728
SMTInterpol SMTInterpol sat ✅ 53.08650 74.48715
Yices2 Yices2 sat ✅ 1.22628 1.10637
Z3alpha Z3-alpha sat ✅ 489.50780 1954.52567
Z3 Z3-alpha-base unknown ❌ 1201.35553 1201.05248
Z3-Owl-base unknown ❌ 1201.32403 1201.04238
z3siri-base unknown ❌ 1201.32074 1200.99655
Z3-Owl Z3-Owl unknown ❌ 1201.79641 1201.11342