Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_difret_functions_fse-bfs_tac.re_node_set_contains.il.fse-bfs.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>
Benchmark
Size4665
Compressed Size877
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4657
Compressed Size864
Max. Term Depth25
Asserts 1
Declared Functions0
Declared Constants7
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite8 not1 =8 let14
concat23 extract15 bvnot5 bvand17
bvor18 bvxor6 bvadd38 bvsub9
bvult1 bvshl15 bvlshr12 select20
store12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04063
Boolector-SMT-COMP-2011 default unsat ✅ 0.21937
Boolector-SMT-COMP-2012 default unsat ✅ 0.06011
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.16996
CVC3-SMT-COMP-2011 default unsat ✅ 0.14647
CVC3-SMT-COMP-2012 default unsat ✅ 0.15277
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.01719
CVC4-SMT-EVAL-2013 default unsat ✅ 0.01343
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.01822
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.11037
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.11556
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.00979
SONOLAR-SMT-COMP-2011 default unsat ✅
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.01835
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unsat ✅ 0.00980
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.00988
Z3-SMT-COMP-2011 default unsat ✅ 0.01674
SMT-COMP 2014 Boolector Boolector boolectord unsat ✅ 0.01423 0.00300
Boolector boolectorj unsat ✅ 0.00756 0.00300
CVC4 CVC4 f7118b2 default unsat ✅ 0.02155 0.01000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unsat ✅ 0.01341 0.01200
Kleaver-indie-more-typed kleaver_portfolio unsat ✅ 0.02519 0.02200
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.02245 0.01400
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.01377 0.00300
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.01067 0.00200
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.01630 0.00800
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 0.00823 0.00300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01412 0.01200
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01481 0.01200
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.02325 0.02200
Yices2 Yices default unsat ✅ 0.00852 0.00200
Z3 z3 4.4.0 default unsat ✅ 0.03168 0.03199
SMT-COMP 2016 Boolector Boolector boolector unsat ✅ 0.01291 0.00491
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01591 0.01608
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.01903 0.02063
Yices2 Yices-2.4.2 default unsat ✅ 0.01135 0.00267
Z3 z3-4.4.1 default unsat ✅ 0.03004 0.03182
SMT-COMP 2017 Boolector Boolector SMT17 final boolector unsat ✅ 0.00814 0.00332
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01680 0.01658
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.01803 0.01779
Yices2 Yices2-Main default unsat ✅ 0.00802 0.00361
Z3 z3-4.5.0 default unsat ✅ 0.03291 0.03190
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default unsat ✅ 0.00699 0.00340
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01629 0.01648
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.01727 0.01812
Yices2 Yices 2.6.0_default unsat ✅ 0.00871 0.00607
Z3 z3-4.7.1_default unsat ✅ 0.03737 0.03727
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.00912 0.00769
Poolector-wrapped-sq_default unsat ✅ 0.17710 0.11932
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.02295 0.02329
Par4 Par4-wrapped-sq_default unsat ✅ 0.01987 0.00608
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01453 0.00613
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03819 0.03817
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.28980 0.16283
cvc5 cvc5 unsat ✅ 6.26099 6.13002
SMTInterpol SMTInterpol unknown ❌ 1201.44525 1240.65669
Yices2 Yices2 unsat ✅ 0.25406 0.13330
Z3 Z3-Owl-base unsat ✅ 0.31757 0.18866
Z3-Owl Z3-Owl unsat ✅ 0.80866 0.67610