Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_true_functions_fse-bfs_tac.peek_token_bracket.il.fse-bfs.smt2 

Ivan Jager <aij+nospam@andrew.cmu.edu>
Benchmark
Size11640
Compressed Size1686
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 11632
Compressed Size1698
Max. Term Depth104
Asserts 1
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite18 =17 let61 concat59
extract33 bvnot15 bvand134 bvor72
bvxor3 bvadd62 bvsub17 bvult2
bvshl31 bvlshr14 select42 store17

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.08766 —
Boolector-SMT-COMP-2011 default sat ✅ 0.36739 —
Boolector-SMT-COMP-2012 default sat ✅ 0.05895 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 9.73949 —
CVC4-SMT-EVAL-2013 default sat ✅ 6.71331 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.03864 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.43952 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.47691 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.07397 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.07265 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.02632 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 1.31989 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.20233 —
Z3-SMT-COMP-2011 default sat ✅ 10.77360 —
SMT-COMP 2014 Boolector Boolector boolectord sat ✅ 0.53047 0.52092
Boolector boolectorj sat ✅ 0.68835 0.67790
CVC4 CVC4 f7118b2 default sat ✅ 26.58080 26.58400
Kleaver Kleaver-indie-more-typed kleaver_indie_1 sat ✅ 0.35043 0.34095
Kleaver-indie-more-typed kleaver_portfolio sat ✅ 0.18104 0.48392
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.07588 0.06699
SONOLAR sonolar_smtcomp-2014 default sat ✅ 0.08622 0.07499
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.01648 0.00800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.46198 0.45393
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.10948 0.10898
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 24.93510 24.93920
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.16009 0.15698
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.07048 0.06999
Yices2 Yices default sat ✅ 0.00895 0.00800
Z3 z3 4.4.0 default sat ✅ 0.81491 0.81488
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.14586 0.14592
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.15251 0.15286
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.03580 0.03740
Yices2 Yices-2.4.2 default sat ✅ 0.01331 0.01008
Z3 z3-4.4.1 default sat ✅ 0.53803 0.53958
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.14074 0.14023
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.15578 0.15588
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.10507 0.10544
Yices2 Yices2-Main default sat ✅ 0.01172 0.01015
Z3 z3-4.5.0 default sat ✅ 1.12938 1.12857
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.16893 0.16885
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.17354 0.17373
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.08859 0.08960
Yices2 Yices 2.6.0_default sat ✅ 0.01165 0.01159
Z3 z3-4.7.1_default sat ✅ 0.51380 0.51347
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.03063 0.03056
Boolector Boolector-wrapped-sq_default sat ✅ 0.03267 0.03271
CVC4 CVC4-sq-final_default sat ✅ 0.15344 0.15374
MathSAT MathSAT5_default.sh sat ✅ 0.14149 0.14141
Par4 Par4-wrapped-sq_default sat ✅ 0.02621 0.00658
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01283 0.00451
Z3 z3-4.8.8_default sat ✅ 1.75260 1.75249
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.25206 0.25205
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01176 0.00464
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.01115 0.00447
Z3 z3-4.8.11_default sat ✅ 1.45774 1.45768
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 0.03176 0.03173
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.05952 0.06011
MathSAT MathSAT-5.6.8_default sat ✅ 0.13978 0.13973
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01405 0.00479
Z3 z3-4.8.17_default sat ✅ 0.89887 0.90063
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla sat ✅ 0.23398 0.13450
cvc5 cvc5 sat ✅ 0.30700 0.20747
SMTInterpol SMTInterpol unknown ❌ 1201.74666 1250.58148
Yices2 Yices2 sat ✅ 0.21100 0.11124