Benchmark

non-incremental/QF_ABV/stp/cksumcookie_20-ite.stp.smt2 

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html
Benchmark
Size633747
Compressed Size58623
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 633739
Compressed Size58631
Max. Term Depth6
Asserts 1
Declared Functions0
Declared Constants5865
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false1 ite4922 not1 and1
=10705 let1 concat138 extract72
bvnot20 bvand25 bvor81 bvxor1
bvadd142 bvsub32 bvult1 bvshl81
select120

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Yices Yices 1.0.10 sat ✅ 264.90000 —
Z3 Z3 0.1 sat ✅ 0.20000 —
Z3 0.1 (fixed BV) sat ✅ 0.20000 —
SMT-COMP 2008 Boolector Boolector sat ✅ 0.20000 —
CVC3 CVC3-1.5 sat ✅ 136.90000 —
Z3 Z3 0.1 sat ✅ 0.20000 —
Z3.2 sat ✅ 0.20000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.17956 —
Boolector-SMT-COMP-2011 default sat ✅ 0.36479 —
Boolector-SMT-COMP-2012 default sat ✅ 0.19097 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 35.05090 —
CVC3-SMT-COMP-2011 default sat ✅ 30.48380 —
CVC3-SMT-COMP-2012 default sat ✅ 31.82210 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.97424 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.91069 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.21615 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.31548 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.22864 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.19228 —
SONOLAR-SMT-COMP-2011 default sat ✅ 44.05770 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.23385 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 0.19470 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.15157 —
Z3-SMT-COMP-2011 default sat ✅ 0.15217 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 0.34241 0.33195
Boolector boolectorj sat ✅ 0.33186 0.32195
CVC4 CVC4 f7118b2 default sat ✅ 1.23928 1.22881
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.54507 0.53592
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.17086 0.17497
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.22009 0.21097
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.21183 0.19997
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.04567 0.03699
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.22257 0.21497
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.16054 0.15898
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.23279 1.23081
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.23880 1.23581
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.18209 0.18097
Yices2 Yices default sat ✅ 0.04038 0.03899
Z3 z3 4.4.0 default sat ✅ 0.24253 0.24296
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.21309 0.21318
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.27541 1.27592
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.16911 0.16697
Yices2 Yices-2.4.2 default sat ✅ 0.03988 0.03984
Z3 z3-4.4.1 default sat ✅ 0.21937 0.22081
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.19980 0.19916
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.45634 1.45626
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.17386 0.17027
Yices2 Yices2-Main default sat ✅ 0.04040 0.03971
Z3 z3-4.5.0 default sat ✅ 0.22833 0.22723
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.29196 0.29187
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.39212 1.39225
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.15530 0.15619
Yices2 Yices 2.6.0_default sat ✅ 0.04090 0.04084
Z3 z3-4.7.1_default sat ✅ 0.20961 0.20949
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.15485 0.15477
Boolector Boolector-wrapped-sq_default sat ✅ 0.16031 0.16029
CVC4 CVC4-sq-final_default sat ✅ 1.55685 1.55713
MathSAT MathSAT5_default.sh sat ✅ 0.18372 0.18362
Par4 Par4-wrapped-sq_default sat ✅ 0.05010 0.00598
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.04576 0.04573
Z3 z3-4.8.8_default sat ✅ 0.21114 0.21112
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla sat ✅ 0.49186 0.39246
cvc5 cvc5 sat ✅ 1.76412 1.66497
SMTInterpol SMTInterpol unknown ❌ 1201.73960 1243.52023
Yices2 Yices2 sat ✅ 0.27911 0.17954
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.42080 0.30346
cvc5 cvc5 sat ✅ 1.14210 1.00868
SMTInterpol SMTInterpol unknown ❌ 1201.59575 1234.97850
Yices2 Yices2 sat ✅ 0.30159 0.18056
Z3 Z3-Owl-base sat ✅ 0.97337 0.84420
Z3-Owl Z3-Owl sat ✅ 1.24453 1.11814