Benchmark

non-incremental/UFLIA/simplify2/front_end_suite/javafe.parser.Lex.006.smt2

Simplify front end test suite.
  This benchmark was translated by Michal Moskal.
Benchmark
Size77278
Compressed Size13903
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 77270
Compressed Size13909
Max. Term Depth47
Asserts 293
Declared Functions59
Declared Constants465
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not165 or47 and127 =>99
=709 distinct3 forall129 let38
Int199 +7 -8 <44
<=55 >2 >=3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.25 (3/4) CVC3 CVC3 1.2 unsat ✅ 5.00000
Fx7 Fx7 unsat ✅ 2.00000
Yices Yices 1.0 unknown ❌ 1801.00000
Yices 1.0.10 unknown ❌ 1800.50000
Z3 Z3 0.1 unsat ✅ 0.10000
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 7.72186
CVC3-SMT-COMP-2011 default unsat ✅ 7.12832
CVC3-SMT-COMP-2012 default unsat ✅ 7.25259
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.31134
CVC4-SMT-EVAL-2013 default unsat ✅ 0.59057
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.39802
Z3-SMT-COMP-2011 default unsat ✅ 0.30047
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01633 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.42929 0.41794
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.10054 0.09198
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00864 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.39370 0.38994
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.39008 0.38694
veriT veriT default unsat ✅ 1.15501 1.15482
Z3 z3 4.4.0 default unsat ✅ 0.11470 0.11498
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.44031 0.44079
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 155.88000 156.59800
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 28.96560 114.84000
veriT veriT-dev default unsat ✅ 0.54975 0.55026
Z3 z3-4.4.1 default unsat ✅ 0.11021 0.11144
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.63958 0.63838
Vampire vampire4.2-smt vampire unsat ✅ 25.80920 102.38000
veriT veriT-2017-06-17 default unsat ✅ 0.36662 0.36168
Z3 z3-4.5.0 default unsat ✅ 0.10728 0.10603
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.50205 0.50222
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 486.87300 1934.80000
veriT veriT_default unsat ✅ 6.28452 6.28473
Z3 z3-4.7.1_default unsat ✅ 0.10744 0.10736
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9534.18000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.50055 0.50089
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.50041 0.50072
Par4 Par4-wrapped-sq_default unsat ✅ 0.12460 0.00587
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2421.12000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.48390 3.89327
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.05275 3.49169
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52578 3.84615
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 187.20400 743.21000
veriT veriT-wrapped-sq_default unsat ✅ 1.10822 1.10648
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12332 0.12315
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4762.58000
CVC4 CVC4-sq-final_default unsat ✅ 0.52320 0.52346
Par4 Par4-wrapped-sq_default unsat ✅ 0.12116 0.00605
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.12000 1253.34000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.44714 3.98783
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 97.03300 385.44000
veriT veriT_default unsat ✅ 75.23050 75.20950
veriT+vite_default unsat ✅ 0.12829 0.12862
Z3 z3-4.8.8_default unsat ✅ 1.21873 1.21856
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.43458 1.43515
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.37521 1.37567
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4560.22000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1273.84000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 47.32810 5.21927
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 53.65880 210.06000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.80933 0.70941
iProver iProver v3.9 unknown ❌ 1201.72210 4748.12061
SMTInterpol SMTInterpol unknown ❌ 1201.72535 1263.55582
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.73318 0.61566
iProver iProver v3.9.3 unknown ❌ 1201.78998 4763.24272
SMTInterpol SMTInterpol unknown ❌ 1201.59152 1557.08767
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01202 4.36073