Benchmark

non-incremental/QF_BV/Sage2/bench_10.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size5480184
Compressed Size43850
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 5480176
Compressed Size43837
Max. Term Depth1422
Asserts 772
Declared Functions0
Declared Constants360
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite40 not160 =340
let115761 extract40 bvor120 bvadd86892
bvmul11015 bvult121 bvule107 bvuge223
bvsgt20 bvshl120 bvlshr20 zero_extend17314

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 122.97100 122.96300
Boolector SMT17 final boolector sat ✅ 269.72600 269.71500
CVC4 CVC4-smtcomp2017-main default sat ✅ 42.79570 83.66350
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02000 599.80000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 26.80300 47.94000
Q3B Q3B default unknown ❌ 600.08300 1799.62000
STP stp_st default sat ✅ 82.69040 82.68710
stp_mt default sat ✅ 40.49030 146.64000
Yices2 Yices2-Main default sat ✅ 1.72790 1.71908
Z3 z3-4.5.0 default sat ✅ 26.24230 26.24450
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 134.30000 134.28900
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 33.58970 33.58900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.66000
MinkeyRink Minkeyrink MT_mt sat ✅ 1.15078 1.47192
Minkeyrink ST_st sat ✅ 29.57070 29.56920
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.54464 3.54441
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.75884 7.01334
STP-Riss-st-2018_riss-no-stderr sat ✅ 14.27200 14.27110
Yices2 Yices 2.6.0_default sat ✅ 0.82815 0.82801
Z3 z3-4.7.1_default sat ✅ 36.45660 36.45380
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1161.67000 1161.60000
Poolector-wrapped-sq_default sat ✅ 4.22269 16.24000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 210.59000 210.58100
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 25.14960 25.14300
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 8.88597 32.51720
MinkeyRink ST-wrapped-sq_default sat ✅ 11.97190 11.97120
Par4 Par4-wrapped-sq_default sat ✅ 0.91056 2.49000
STP STP-2019-wrapped-sq_default sat ✅ 3.60776 3.60795
stp-mergesat-fixed-wrapped-sq_default sat ✅ 54.21240 54.20940
stp-minisat-wrapped-sq_default sat ✅ 48.35190 48.34610
stp-mt-wrapped-sq_default sat ✅ 3.80531 4.74719
stp-portfolio-fixed-wrapped-sq_default sat ✅ 58.74900 108.71500
stp-riss-wrapped-sq_default unknown ❌ 3.42957 3.42918
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.87368 0.87371
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.83569 0.83569
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.00549 1.00553
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 28.53010 28.52820
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.70579 0.70571
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 46.89540 46.89510
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 305.95400 305.92400
Boolector Boolector-wrapped-sq_default sat ✅ 157.48300 157.47000
Poolector-wrapped-sq_default sat ✅ 117.64500 466.14000
CVC4 CVC4-sq-final_default sat ✅ 13.81190 13.81100
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1199.96000
MathSAT MathSAT5_default.sh unknown ❌ 1200.10000 1199.82000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.97935 0.97961
MinkeyRink Solver 2020.3_default sat ✅ 1.07093 1.30936
STP STP_default sat ✅ 95.09400 370.11500
STP ++ Mergsat v1_default sat ✅ 134.25900 134.21300
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.75213 0.75202
Z3 z3-4.8.8_default sat ✅ 7.71124 7.71174
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 217.78100 217.71000
Bitwuzla-wrapped_default sat ✅ 182.11600 182.10700
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 22.75330 22.74700
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.85000
STP STP 2022.4_default sat ✅ 1.73062 1.73051
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.96420 0.96400
Z3++BV z3++bv_0702_default sat ✅ 19.97880 19.97700
Z3 z3-4.8.17_default sat ✅ 16.77400 16.77400
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 1.50125 1.40097
cvc5 cvc5 sat ✅ 12.53236 12.43030
SMTInterpol SMTInterpol unknown ❌ 1201.74284 1246.49737
STP STP sat ✅ 5.13262 5.02880
Yices2 Yices2 sat ✅ 0.86439 0.76431
Z3alpha Z3-alpha sat ✅ 84.03760 83.90893
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.96927 0.84257
Bitwuzla-MachBV-base sat ✅ 0.95166 0.81771
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.04605 0.91823
BVDecide bv_decide sat ✅ 186.18301 186.03743
bv_decide-nokernel sat ✅ 187.77855 187.00639
cvc5 cvc5 sat ✅ 18.41442 18.29132
SMTInterpol SMTInterpol unknown ❌ 1201.49459 1235.76437
Yices2 Yices2 sat ✅ 0.89366 0.77350
Z3alpha Z3-alpha sat ✅ 90.71152 336.42593
Z3 Z3-alpha-base sat ✅ 266.54557 266.34799
Z3-Owl-base sat ✅ 987.14027 986.91156
z3siri-base sat ✅ 264.40923 264.27729
Z3-Owl Z3-Owl sat ✅ 40.93636 40.80042