Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-107.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments
Benchmark
Size799427
Compressed Size4234
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 799418
Compressed Size4221
Max. Term Depth50
Asserts 1593
Declared Functions0
Declared Constants8
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false9 ite1227 and21
=1614 let1 concat7517 extract1271
bvand4 bvxor2455 bvadd1132 bvmul1240
bvsub1226 bvult1231 bvslt4 zero_extend14
sign_extend1239 select11643 store1381

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 12.81490 12.80710
Boolector boolectorj sat ✅ 6.75175 6.73897
CVC4 CVC4 f7118b2 default sat ✅ 33.07380 33.08000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.13678 0.12798
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.20671 0.37494
MathSAT MathSAT-5.2.12-Main default sat ✅ 1.34697 1.33880
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.58790 0.58491
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.09569 0.08299
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.29608 0.28796
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.17362 0.17297
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.59531 2.59460
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.86161 1.85972
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.24312 1.24281
Yices2 Yices default sat ✅ 0.08406 0.08299
Z3 z3 4.4.0 default sat ✅ 0.29056 0.29095
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.16922 0.16933
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.11286 2.11063
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.15666 1.15837
Yices2 Yices-2.4.2 default sat ✅ 0.08507 0.08510
Z3 z3-4.4.1 default sat ✅ 0.30371 0.30522
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.17009 0.16908
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.33849 2.33689
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.45311 1.45276
Yices2 Yices2-Main default sat ✅ 0.08021 0.07926
Z3 z3-4.5.0 default sat ✅ 0.44098 0.44002
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.14304 0.14295
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.05348 3.05324
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.43746 0.43865
Yices2 Yices 2.6.0_default sat ✅ 0.06832 0.06824
Z3 z3-4.7.1_default sat ✅ 0.39295 0.39269
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.20228 0.20218
Poolector-wrapped-sq_default sat ✅ 0.28452 0.29854
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.49115 2.49127
Par4 Par4-wrapped-sq_default sat ✅ 0.07991 0.00587
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.06715 0.06714
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.43640 0.43639
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.16391 0.16384
Boolector Boolector-wrapped-sq_default sat ✅ 0.17353 0.17354
CVC4 CVC4-sq-final_default sat ✅ 3.34368 3.34375
MathSAT MathSAT5_default.sh sat ✅ 0.49033 0.49020
Par4 Par4-wrapped-sq_default sat ✅ 0.07799 0.00679
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07777 0.07770
Z3 z3-4.8.8_default sat ✅ 0.69198 0.69183
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.47970 0.47967
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.07777 0.07769
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.07849 0.07842
Z3 z3-4.8.11_default sat ✅ 0.58899 0.58896
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.17084 0.17067
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 5.91523 5.91172
MathSAT MathSAT-5.6.8_default sat ✅ 0.49971 0.49966
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.07252 0.07249
Z3 z3-4.8.17_default sat ✅ 0.68796 0.68972
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 1.69308 1.59329
cvc5 cvc5 sat ✅ 9.21094 9.10661
SMTInterpol SMTInterpol sat ✅ 128.56130 161.10019
Yices2 Yices2 sat ✅ 0.26572 0.16573