Benchmark

non-incremental/QF_BV/Sage2/bench_11970.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size212325
Compressed Size26731
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 212317
Compressed Size26501
Max. Term Depth265
Asserts 861
Declared Functions0
Declared Constants722
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite53 not312 =817
let3621 bvor204 bvadd497 bvmul494
bvule4 bvuge8 bvslt6 bvsle6
bvsgt72 bvshl257 zero_extend1704 sign_extend47

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.03275 0.03213
Boolector SMT17 final boolector sat ✅ 0.03120 0.03048
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.85198 9.60272
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.03685 2.03696
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.51147 3.53141
Q3B Q3B default unknown ❌ 600.01800 1799.56000
STP stp_st default sat ✅ 20.64060 20.63890
stp_mt default sat ✅ 15.17600 43.75410
Yices2 Yices2-Main default sat ✅ 0.22019 0.11553
Z3 z3-4.5.0 default sat ✅ 136.34200 136.32600
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.03350 0.03344
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.87223 3.87216
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.87604 1.87680
MinkeyRink Minkeyrink MT_mt sat ✅ 2.52288 7.85411
Minkeyrink ST_st sat ✅ 2.55569 2.55565
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1.00472 1.00444
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.08420 1.56252
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.23024 3.23039
Yices2 Yices 2.6.0_default sat ✅ 0.08658 0.08648
Z3 z3-4.7.1_default sat ✅ 131.53600 131.54400
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.06042 0.06043
Poolector-wrapped-sq_default sat ✅ 0.17795 0.16103
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 145.87300 145.85800
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.67507 2.67527
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.68336 0.93586
MinkeyRink ST-wrapped-sq_default sat ✅ 10.49500 10.49450
Par4 Par4-wrapped-sq_default sat ✅ 0.03738 0.00593
STP STP-2019-wrapped-sq_default sat ✅ 1.00743 1.00761
stp-mergesat-fixed-wrapped-sq_default sat ✅ 13.12500 13.12520
stp-minisat-wrapped-sq_default sat ✅ 41.21110 41.21120
stp-mt-wrapped-sq_default sat ✅ 1.11501 1.46007
stp-portfolio-fixed-wrapped-sq_default sat ✅ 41.95110 54.82370
stp-riss-wrapped-sq_default unknown ❌ 0.95724 0.95713
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.10137 0.10138
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.61156 1.61140
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 14.90160 14.90060
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 9.56057 9.56092
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.29557 0.29556
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 309.45500 309.36400
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.30169 0.30150
Boolector Boolector-wrapped-sq_default sat ✅ 0.05172 0.05175
Poolector-wrapped-sq_default sat ✅ 0.18506 0.15895
CVC4 CVC4-sq-final_default sat ✅ 2.66161 2.66136
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1200.03000
MathSAT MathSAT5_default.sh sat ✅ 0.61616 0.61605
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.58208 0.58232
MinkeyRink Solver 2020.3_default sat ✅ 9.54938 36.09500
STP STP_default sat ✅ 2.95990 9.86157
STP ++ Mergsat v1_default sat ✅ 9.67971 9.68216
Yices2 Yices 2.6.2 bug fix_default sat ✅ 2.72085 2.71886
Z3 z3-4.8.8_default sat ✅ 7.52420 7.52362
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.28975 0.28970
MathSAT mathsat-5.6.6_default sat ✅ 0.60232 0.60220
STP STP 2021.0_default sat ✅ 0.71475 0.94630
Z3 z3-4.8.11_default sat ✅ 30.29020 30.28660
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.35568 0.34941
Bitwuzla-wrapped_default sat ✅ 0.29307 0.29301
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.87369 2.87233
MathSAT MathSAT-5.6.8_default sat ✅ 0.82150 0.81560
STP STP 2022.4_default sat ✅ 0.70932 0.70931
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.25284 3.25259
Z3++BV z3++bv_0702_default sat ✅ 2.28533 2.28500
Z3 z3-4.8.17_default sat ✅ 4.89948 4.90150
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 1.16441 1.06449
cvc5 cvc5 sat ✅ 2.17097 2.06998
SMTInterpol SMTInterpol unknown ❌ 1201.74599 1232.43308
STP STP sat ✅ 0.80580 0.70582
Yices2 Yices2 sat ✅ 3.23689 3.13562
Z3alpha Z3-alpha sat ✅ 4.73771 4.63486
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.50373 0.37386
Bitwuzla-MachBV-base sat ✅ 0.79418 0.67559
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.85630 0.72912
BVDecide bv_decide sat ✅ 9.34430 9.19365
bv_decide-nokernel sat ✅ 7.59287 7.44345
cvc5 cvc5 sat ✅ 1.63205 1.50847
SMTInterpol SMTInterpol unknown ❌ 1201.47773 1229.59785
Yices2 Yices2 sat ✅ 1.79543 1.67512
Z3alpha Z3-alpha sat ✅ 9.88342 37.99749
Z3 Z3-alpha-base sat ✅ 134.09059 133.95082
Z3-Owl-base sat ✅ 571.20778 571.01651
z3siri-base sat ✅ 135.06227 134.91959
Z3-Owl Z3-Owl sat ✅ 17.88557 17.74771