Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-007.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments
Benchmark
Size763173
Compressed Size4182
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 763164
Compressed Size4167
Max. Term Depth50
Asserts 1593
Declared Functions0
Declared Constants8
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 ite1163 and19 =1613
let1 concat7126 extract1206 bvand4
bvxor2327 bvadd1074 bvmul1176 bvsub1162
bvult1166 bvslt4 zero_extend14 sign_extend1174
select11122 store1316

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 6.20206 6.19206
Boolector boolectorj sat ✅ 3.95492 3.94740
CVC4 CVC4 f7118b2 default sat ✅ 43.17320 43.18140
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.13378 0.12498
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.20473 0.37194
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.98192 0.97285
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.17050 1.15882
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.08830 0.07999
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.25822 0.25796
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.16234 0.16097
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.99367 1.99270
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.14787 2.14567
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.92500 0.92386
Yices2 Yices default sat ✅ 0.08260 0.08199
Z3 z3 4.4.0 default sat ✅ 0.27486 0.27496
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.15753 0.15758
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.91739 1.90937
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.85732 0.85887
Yices2 Yices-2.4.2 default sat ✅ 0.08172 0.08174
Z3 z3-4.4.1 default sat ✅ 0.30324 0.30462
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.16099 0.16019
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.18948 3.18841
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.93947 0.93912
Yices2 Yices2-Main default sat ✅ 0.07734 0.07641
Z3 z3-4.5.0 default sat ✅ 0.38277 0.38152
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.14174 0.14164
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 2.13950 2.13945
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.41582 0.41664
Yices2 Yices 2.6.0_default sat ✅ 0.06676 0.06665
Z3 z3-4.7.1_default sat ✅ 0.36592 0.36578
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.17222 0.17221
Poolector-wrapped-sq_default sat ✅ 0.28461 0.60028
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.66174 2.66196
Par4 Par4-wrapped-sq_default sat ✅ 0.07336 0.00579
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.06563 0.06563
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.39607 0.39609
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.18160 0.18152
Boolector Boolector-wrapped-sq_default sat ✅ 0.17125 0.17128
CVC4 CVC4-sq-final_default sat ✅ 5.49169 5.49184
MathSAT MathSAT5_default.sh sat ✅ 0.43470 0.43460
Par4 Par4-wrapped-sq_default sat ✅ 0.07383 0.00575
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07395 0.07389
Z3 z3-4.8.8_default sat ✅ 0.50139 0.50130
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.43288 0.43283
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07569 0.07559
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.07400 0.07393
Z3 z3-4.8.11_default sat ✅ 0.43936 0.43923