Benchmark

non-incremental/UFLIA/simplify2/front_end_suite/javafe.tc.CheckInvariants.001.smt2

Simplify front end test suite.
  This benchmark was translated by Michal Moskal.
Benchmark
Size229004
Compressed Size36171
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 228996
Compressed Size36190
Max. Term Depth121
Asserts 608
Declared Functions59
Declared Constants976
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not527 or105 and691 =>646
=2454 distinct3 forall322 let101
Int392 +7 -5 <146
<=68 >2 >=9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 CVC3 CVC3 v2.4.2 unknown ❌
CVC4 1.0rc.3931 unsat ✅ 4.70000
Z3 Z3 unsat ✅ 1.10000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 599.22800
CVC3-SMT-COMP-2011 default unsat ✅ 554.06200
CVC3-SMT-COMP-2012 default unsat ✅ 557.95200
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.29898
CVC4-SMT-EVAL-2013 default unsat ✅ 1.34761
veriT veriT-SMT-EVAL-2013 default unsat ✅ 92.96620
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.02630
Z3-SMT-COMP-2011 default unsat ✅ 0.62708
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01659 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 1.32098 1.30980
veriT veriT-smtcomp2014 default unsat ✅ 34.25310 34.25280
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.23032 0.22996
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00884 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.47521 1.47278
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.50057 1.49877
veriT veriT default unsat ✅ 13.60590 13.60990
Z3 z3 4.4.0 default unsat ✅ 0.23786 0.23796
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.66114 1.66229
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 82.39580 82.81770
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 8.82098 34.59000
veriT veriT-dev default unsat ✅ 52.71900 52.73240
Z3 z3-4.4.1 default unsat ✅ 0.22815 0.22996
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.62464 3.62424
Vampire vampire4.2-smt vampire unsat ✅ 34.42900 136.47000
veriT veriT-2017-06-17 default unsat ✅ 68.02480 68.02010
Z3 z3-4.5.0 default unsat ✅ 0.23667 0.23581
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.04774 4.04678
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 518.70900 2060.17000
veriT veriT_default unsat ✅ 448.42700 448.41000
Z3 z3-4.7.1_default unsat ✅ 0.21079 0.21074
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 16.05300 16.04710
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 23.33490 23.33270
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4740.34000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.15000 1271.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.97895 5.51209
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 22.01750 87.08000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 5.48276 5.38278
iProver iProver v3.9 unknown ❌ 1201.74230 4752.79078
SMTInterpol SMTInterpol unknown ❌ 1202.77856 1590.51763
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 3.33782 3.20999
iProver iProver v3.9.3 unknown ❌ 1201.75946 4764.41323
SMTInterpol SMTInterpol unknown ❌ 1201.74351 1823.32960
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.13362 4.67996