Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_difret_functions_flanagansaxe_nl.re_node_set_contains.il.flanagansaxe.smt2 

Ivan Jager <aij+nospam@andrew.cmu.edu>
Benchmark
Size32425
Compressed Size4001
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 32417
Compressed Size4023
Max. Term Depth179
Asserts 1
Declared Functions0
Declared Constants244
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite256 not1 =253 let2
concat38 extract19 bvnot24 bvand396
bvor47 bvxor11 bvadd54 bvsub9
bvult4 bvshl26 bvlshr17 select32
store12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.14 (6/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.22657 —
Boolector-SMT-COMP-2011 default sat ✅ 0.41482 —
Boolector-SMT-COMP-2012 default sat ✅ 0.15104 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.08256 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.10172 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.11070 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.25090 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.31859 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.08497 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.07286 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.04951 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 0.05912 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.06153 —
Z3-SMT-COMP-2011 default sat ✅ 0.06081 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 0.17456 0.17397
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.11521 0.11298
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.11928 0.11698
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.11550 0.11498
Yices2 Yices default sat ✅ 0.01537 0.01400
Z3 z3 4.4.0 default sat ✅ 0.08003 0.07999
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 0.31418 0.31428
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.11879 0.11900
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.11592 0.11699
Yices2 Yices-2.4.2 default sat ✅ 0.01897 0.01902
Z3 z3-4.4.1 default sat ✅ 0.07520 0.07644
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 0.31845 0.31472
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.12348 0.12269
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.08171 0.08189
Yices2 Yices2-Main default sat ✅ 0.01474 0.01388
Z3 z3-4.5.0 default sat ✅ 0.10811 0.10752
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 0.37484 0.37474
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.12383 0.12408
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 0.10201 0.10297
Yices2 Yices 2.6.0_default sat ✅ 0.02098 0.02088
Z3 z3-4.7.1_default sat ✅ 0.11928 0.11915
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.04070 0.04067
Boolector Boolector-wrapped-sq_default sat ✅ 0.04364 0.04363
CVC4 CVC4-sq-final_default sat ✅ 0.16418 0.16446
MathSAT MathSAT5_default.sh sat ✅ 0.35344 0.35333
Par4 Par4-wrapped-sq_default sat ✅ 0.04187 0.00596
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.03249 0.03246
Z3 z3-4.8.8_default sat ✅ 0.08904 0.08897
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla sat ✅ 0.25750 0.15758
cvc5 cvc5 sat ✅ 0.34554 0.24599
SMTInterpol SMTInterpol unknown ❌ 1201.71737 1250.71850
Yices2 Yices2 sat ✅ 0.25783 0.15780
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.30974 0.18013
cvc5 cvc5 sat ✅ 175.54877 175.38359
SMTInterpol SMTInterpol unknown ❌ 1201.48706 1234.66981
Yices2 Yices2 sat ✅ 0.24959 0.13360
Z3 Z3-Owl-base sat ✅ 0.39900 0.27160
Z3-Owl Z3-Owl sat ✅ 0.82256 0.69824