Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-092.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments
Benchmark
Size508058
Compressed Size4096
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 508049
Compressed Size4081
Max. Term Depth44
Asserts 1593
Declared Functions0
Declared Constants8
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false8 ite715 and20
=1613 let1 concat4389 extract735
bvand4 bvxor1431 bvadd659 bvmul720
bvsub714 bvult718 bvslt4 zero_extend6
sign_extend719 select7443 store861

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 9.41058 9.40257
Boolector boolectorj sat ✅ 5.29825 5.28919
CVC4 CVC4 f7118b2 default sat ✅ 36.06680 36.07150
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.10418 0.09498
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.16873 0.33295
MathSAT MathSAT-5.2.12-Main default sat ✅ 1.48916 1.47777
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.07151 1.06084
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.05892 0.04999
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.23245 0.21597
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.13403 0.13298
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.93183 1.93071
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.56343 2.56161
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.03627 1.03584
Yices2 Yices default sat ✅ 0.05190 0.05099
Z3 z3 4.4.0 default sat ✅ 0.24047 0.23996
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.11901 0.11906
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.91123 1.91349
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.79970 0.80104
Yices2 Yices-2.4.2 default sat ✅ 0.05147 0.05146
Z3 z3-4.4.1 default sat ✅ 0.26124 0.26271
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.11941 0.11830
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.75843 1.75779
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.99944 0.99935
Yices2 Yices2-Main default sat ✅ 0.04957 0.04841
Z3 z3-4.5.0 default sat ✅ 0.35013 0.34929
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.11455 0.11447
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.96624 1.96634
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.40309 0.40403
Yices2 Yices 2.6.0_default sat ✅ 0.04719 0.04709
Z3 z3-4.7.1_default sat ✅ 0.37313 0.37302
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.12687 0.12686
Poolector-wrapped-sq_default sat ✅ 0.27714 0.49928
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.46975 2.46994
Par4 Par4-wrapped-sq_default sat ✅ 0.05639 0.00556
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.04493 0.04492
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.39058 0.39053
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.13840 0.13834
Boolector Boolector-wrapped-sq_default sat ✅ 0.13705 0.13706
CVC4 CVC4-sq-final_default sat ✅ 2.38778 2.38797
MathSAT MathSAT5_default.sh sat ✅ 0.43345 0.43340
Par4 Par4-wrapped-sq_default sat ✅ 0.05380 0.00601
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.05095 0.05085
Z3 z3-4.8.8_default sat ✅ 0.43667 0.43666
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.15843 0.15838
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 3.46991 3.46859
MathSAT MathSAT-5.6.8_default sat ✅ 0.45290 0.45264
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.04797 0.04795
Z3 z3-4.8.17_default sat ✅ 0.39563 0.39744
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 1.59280 1.49284
cvc5 cvc5 sat ✅ 6.05280 5.94991
SMTInterpol SMTInterpol sat ✅ 122.76862 159.27464
Yices2 Yices2 sat ✅ 0.24100 0.14123
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 1.08857 0.96864
cvc5 cvc5 sat ✅ 10.70592 10.57593
SMTInterpol SMTInterpol unknown ❌ 11.78450 22.70810
Yices2 Yices2 sat ✅ 0.29410 0.17398
Z3 Z3-Owl-base sat ✅ 2.86082 2.74151
Z3-Owl Z3-Owl sat ✅ 1.82681 1.69277