Benchmark

non-incremental/UFLIA/simplify/javafe.filespace.StringUtil.503.smt2

Simplify Theorem Prover Benchmark Suite
Benchmark
Size20172
Compressed Size3952
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 20164
Compressed Size3965
Max. Term Depth47
Asserts 86
Declared Functions49
Declared Constants74
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 not36 or20 and49
=>41 =290 forall80 let18
Int140 +25 -3 <15
<=35 >1 >=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.04961
CVC3-SMT-COMP-2011 default unsat ✅ 0.04718
CVC3-SMT-COMP-2012 default unsat ✅ 0.04629
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.47795
CVC4-SMT-EVAL-2013 default unsat ✅ 0.46770
veriT veriT-SMT-EVAL-2013 default unsat ✅ 0.03839
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.02688
Z3-SMT-COMP-2011 default unsat ✅ 0.03511
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00868 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.07846 0.07599
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.07779 0.07499
veriT veriT default unsat ✅ 0.03576 0.03499
Z3 z3 4.4.0 default unsat ✅ 0.05209 0.05199
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.09256 0.09283
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.46292 2.47421
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.27229 0.13286
veriT veriT-dev default unsat ✅ 0.02957 0.02983
Z3 z3-4.4.1 default unsat ✅ 0.05348 0.05471
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.09298 0.09275
Vampire vampire4.2-smt vampire unsat ✅ 0.06710 0.06691
veriT veriT-2017-06-17 default unsat ✅ 0.04386 0.04301
Z3 z3-4.5.0 default unsat ✅ 0.05993 0.05855
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.10306 0.10325
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 8.15754 32.13000
veriT veriT_default unsat ✅ 0.03864 0.03885
Z3 z3-4.7.1_default unsat ✅ 0.06709 0.06704
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.37626 0.37660
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.10533 0.10572
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.10433 0.10462
Par4 Par4-wrapped-sq_default unsat ✅ 0.05290 0.00608
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2409.00000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.45316 3.34983
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.20781 3.40104
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.13234 3.16042
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.03719 3.94000
veriT veriT-wrapped-sq_default unsat ✅ 0.04286 0.04326
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06945 0.06944
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.11673 0.11707
cvc5 cvc5-fixed_default unsat ✅ 0.10910 0.10967
Par4 Par4-wrapped-sq_default unsat ✅ 0.05483 0.00812
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 673.30700 738.95600
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.95224 4.72522
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.22044 0.21025
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.50127 0.38360
veriT veriT_default unsat ✅ 0.05517 0.05495
Z3 z3-4.8.11_default unsat ✅ 0.08021 0.08015
z3-4.8.8_default unsat ✅ 0.09470 0.09466
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.11434 0.11466
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.23963 0.23952
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83277 4.66590
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.12500 0.12367
veriT veriT_default unsat ✅ 0.03186 0.03222
Z3 z3-4.8.17_default unsat ✅ 0.06109 0.06287