Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-011.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments
Benchmark
Size763173
Compressed Size4182
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 763164
Compressed Size4167
Max. Term Depth50
Asserts 1593
Declared Functions0
Declared Constants8
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 ite1163 and19 =1613
let1 concat7126 extract1206 bvand4
bvxor2327 bvadd1074 bvmul1176 bvsub1162
bvult1166 bvslt4 zero_extend14 sign_extend1174
select11122 store1316

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 6.34402 6.33504
Boolector boolectorj sat ✅ 3.86579 3.85541
CVC4 CVC4 f7118b2 default sat ✅ 43.07040 43.07940
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.13233 0.12298
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.20086 0.36894
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.90357 0.89486
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.37412 1.36379
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.08916 0.07999
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.27062 0.26296
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.16366 0.16297
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.67875 2.67759
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.10775 4.08868
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.81420 0.81388
Yices2 Yices default sat ✅ 0.08096 0.07999
Z3 z3 4.4.0 default sat ✅ 0.28177 0.28196
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.16223 0.16229
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.60929 2.61111
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.01261 1.01458
Yices2 Yices-2.4.2 default sat ✅ 0.08103 0.08164
Z3 z3-4.4.1 default sat ✅ 0.29982 0.30123
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.16061 0.15976
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.59998 2.59364
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.96502 0.96250
Yices2 Yices2-Main default sat ✅ 0.07914 0.07823
Z3 z3-4.5.0 default sat ✅ 0.43013 0.42958
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.13827 0.13822
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 2.16299 2.16296
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.35307 0.35416
Yices2 Yices 2.6.0_default sat ✅ 0.06647 0.06641
Z3 z3-4.7.1_default sat ✅ 0.38177 0.38159
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.18404 0.18402
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.31544 4.31492
MathSAT MathSAT-5.6.8_default sat ✅ 0.45535 0.45516
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.07223 0.07220
Z3 z3-4.8.17_default sat ✅ 0.43996 0.44172
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.31899 0.31887
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 13.27860 13.27410
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 217.18400 260.57800
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.07245 0.07242
Z3-Owl z3-Owl-Final_default sat ✅ 2.17690 2.17679
z3-Owl-Final_default sat ✅ 1.44048 1.44074
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 1.31399 1.21341
cvc5 cvc5 sat ✅ 3.79877 3.69751
SMTInterpol SMTInterpol sat ✅ 119.10912 159.12234
Yices2 Yices2 sat ✅ 0.28339 0.18287