Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-058.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments
Benchmark
Size726945
Compressed Size4212
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 726936
Compressed Size4198
Max. Term Depth50
Asserts 1593
Declared Functions0
Declared Constants8
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false6 ite1099 and20
=1611 let1 concat6734 extract1141
bvand3 bvxor2199 bvadd1016 bvmul1111
bvsub1098 bvult1102 bvslt4 zero_extend13
sign_extend1110 select10600 store1252

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 5.78625 5.78612
Boolector boolectorj sat ✅ 3.56683 3.55846
CVC4 CVC4 f7118b2 default sat ✅ 11.97390 11.96920
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.13236 0.12098
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.19785 0.36894
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.58810 0.58691
SONOLAR sonolar_smtcomp-2014 default sat ✅ 1.11360 1.10183
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.07155 0.06299
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.24479 0.24496
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.15245 0.15098
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.02446 2.02269
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.97214 1.96970
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.59373 0.59291
Yices2 Yices default sat ✅ 0.06389 0.06299
Z3 z3 4.4.0 default sat ✅ 0.26641 0.26596
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.14863 0.14868
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.04659 2.04809
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.51635 0.51750
Yices2 Yices-2.4.2 default sat ✅ 0.06222 0.06220
Z3 z3-4.4.1 default sat ✅ 0.26969 0.27126
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.12470 0.12259
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.16795 2.16503
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.55000 0.54946
Yices2 Yices2-Main default sat ✅ 0.06074 0.06069
Z3 z3-4.5.0 default sat ✅ 0.34471 0.34337
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.13872 0.13867
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 2.42876 2.42857
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.32678 0.32777
Yices2 Yices 2.6.0_default sat ✅ 0.05656 0.05651
Z3 z3-4.7.1_default sat ✅ 0.32811 0.32797
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.39541 0.39536
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.06525 0.06519
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.06431 0.06428
Z3 z3-4.8.11_default sat ✅ 0.36794 0.36791
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.14973 0.14953
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 3.63024 3.63031
MathSAT MathSAT-5.6.8_default sat ✅ 0.42507 0.42500
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.06014 0.06007
Z3 z3-4.8.17_default sat ✅ 0.41250 0.41330
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.79847 0.69876
cvc5 cvc5 sat ✅ 3.03005 2.93025
SMTInterpol SMTInterpol sat ✅ 75.94052 111.82338
Yices2 Yices2 sat ✅ 0.24939 0.14954