Benchmark

non-incremental/UFLIA/simplify2/front_end_suite/javafe.parser.ParseExpr.003.smt2

Simplify front end test suite.
  This benchmark was translated by Michal Moskal.
Benchmark
Size191269
Compressed Size32213
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 191261
Compressed Size32044
Max. Term Depth74
Asserts 685
Declared Functions59
Declared Constants1190
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not319 or122 and369 =>276
=2038 distinct3 forall187 let80
Int257 +17 -8 <78
<=48 >2 >=19

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 CVC3 CVC3 v2.4.2 unsat ✅ 189.90000
CVC3 v2.4.2 unknown ❌
CVC4 1.0rc.3931 unknown ❌ 451.50000
CVC4 1.0rc.3931 unsat ✅ 348.80000
Z3 Z3 unsat ✅ 0.60000
Z3 unsat ✅ 0.60000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 255.12700
CVC3-SMT-COMP-2011 default unsat ✅ 235.87100
CVC3-SMT-COMP-2012 default unsat ✅ 240.06900
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 4.04085
CVC4-SMT-EVAL-2013 default unsat ✅ 1.03546
veriT veriT-SMT-EVAL-2013 default unsat ✅ 11.50890
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.49448
Z3-SMT-COMP-2011 default unsat ✅ 0.48045
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00889 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 1.79169 1.78073
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.13653 0.12898
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00888 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.01079 1.00785
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.01518 1.01284
veriT veriT default unknown ❌ 2400.01000 2400.97000
Z3 z3 4.4.0 default unsat ✅ 0.15024 0.14998
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.90998 0.91072
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 36.70750 36.89380
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 28.01210 110.72000
veriT veriT-dev default unsat ✅ 2.00230 2.00363
Z3 z3-4.4.1 default unsat ✅ 0.16051 0.16151
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.95396 0.95321
Vampire vampire4.2-smt vampire unsat ✅ 43.11060 170.93000
veriT veriT-2017-06-17 default unsat ✅ 2.52436 2.52417
Z3 z3-4.5.0 default unsat ✅ 0.16474 0.16470
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.10318 1.10324
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 497.36400 1975.09000
veriT veriT_default unsat ✅ 1.39417 1.39444
Z3 z3-4.7.1_default unsat ✅ 0.14724 0.14716
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4766.06000
CVC4 CVC4-sq-final_default unsat ✅ 1.19327 1.19340
Par4 Par4-wrapped-sq_default unsat ✅ 0.16699 0.00937
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1261.25000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.43941 4.08495
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 14.03750 55.47000
veriT veriT_default unsat ✅ 0.74760 0.74790
veriT+vite_default unsat ✅ 0.78330 0.78352
Z3 z3-4.8.8_default unsat ✅ 0.80202 0.79897
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 1.26537 1.26553
cvc5 cvc5-fixed_default unsat ✅ 1.16149 1.16185
Par4 Par4-wrapped-sq_default unsat ✅ 0.16492 0.00685
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1257.04000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.32200 6.17086
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 25.12810 85.71000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 7.43217 29.24000
veriT veriT_default unsat ✅ 1.37853 1.37878
Z3 z3-4.8.11_default unsat ✅ 0.73806 0.73799
z3-4.8.8_default unsat ✅ 0.72685 0.72672
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.57663 1.57697
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.22191 3.21575
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1201.24000 4646.93000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 1264.33000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.00863 5.35933
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 405.05600 1608.73000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 1.19805 1.09843
iProver iProver v3.9 unsat ✅ 36.48474 134.65850
SMTInterpol SMTInterpol unknown ❌ 1202.23905 1670.31417
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.96519 0.84617
iProver iProver v3.9.3 unknown ❌ 1201.76361 4766.16346
SMTInterpol SMTInterpol unknown ❌ 1201.78825 1772.81592
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.11531 4.77771