Benchmark

non-incremental/UFLIA/simplify2/front_end_suite/javafe.util.StackVector.013.smt2 

Simplify front end test suite.
  This benchmark was translated by Michal Moskal.
Benchmark
Size33163
Compressed Size6238
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 33155
Compressed Size6249
Max. Term Depth30
Asserts 146
Declared Functions59
Declared Constants180
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not50 or19 and67 =>61
=232 distinct3 forall105 let29
Int175 +3 -9 <24
<=50 >5 >=4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.21521 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.19929 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.19525 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.00573 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
veriT veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.09294 —
Z3-SMT-COMP-2011 default unsat ✅ 0.05228 —
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01635 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 92.71840 92.68790
veriT veriT-smtcomp2014 default unknown ❌ 2398.91000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.14578 0.13798
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01146 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.26827 0.26396
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.26609 0.26096
veriT veriT default unknown ❌ 2400.01000 2400.93000
Z3 z3 4.4.0 default unsat ✅ 0.16312 0.16297
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.27316 0.27345
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 43.44730 43.69690
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 6.76853 26.52000
veriT veriT-dev default unsat ✅ 0.04348 0.04406
Z3 z3-4.4.1 default unsat ✅ 0.10997 0.11123
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.32893 0.32912
Vampire vampire4.2-smt vampire unsat ✅ 26.53730 105.12000
veriT veriT-2017-06-17 default unsat ✅ 0.04556 0.04561
Z3 z3-4.5.0 default unsat ✅ 0.16127 0.16053
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30886 0.30906
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4766.81000
veriT veriT_default unsat ✅ 0.04674 0.04696
Z3 z3-4.7.1_default unsat ✅ 0.25355 0.25284
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 2.54577 9.71000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.33476 0.33513
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.33371 0.33392
Par4 Par4-wrapped-sq_default unsat ✅ 0.05370 0.00562
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2412.63000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.48771 3.61867
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15960 3.32140
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.44543 3.58019
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 6.83645 24.93000
veriT veriT-wrapped-sq_default unsat ✅ 0.04943 0.04977
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15942 0.15941
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.20358 8.33000
CVC4 CVC4-sq-final_default unsat ✅ 0.29150 0.29180
Par4 Par4-wrapped-sq_default unsat ✅ 0.06160 0.00573
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1249.91000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.44651 3.77811
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.66048 14.26000
veriT veriT_default unsat ✅ 0.05921 0.05954
veriT+vite_default unsat ✅ 0.08108 0.08140
Z3 z3-4.8.8_default unsat ✅ 0.30128 0.30121
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 4.12300 4.12332
cvc5 cvc5-fixed_default unsat ✅ 0.71735 0.71791
Par4 Par4-wrapped-sq_default unsat ✅ 0.13058 0.00640
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.12000 1332.22000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.94708 4.93733
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 3.90447 15.31000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 107.65200 427.43000
veriT veriT_default unsat ✅ 0.04984 0.05019
Z3 z3-4.8.11_default unsat ✅ 0.60551 0.60534
z3-4.8.8_default unsat ✅ 0.30469 0.30450
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.43949 0.43981
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.54238 0.54290
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.17781 5.45300
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 2.02538 7.75000
veriT veriT_default unsat ✅ 0.09561 0.09452
Z3 z3-4.8.17_default unsat ✅ 0.11815 0.11991
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.43107 0.43054
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.59936 0.59448
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4681.84000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1322.28000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.23337 5.20940
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 82.99270 329.33000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.68530 0.58580
iProver iProver v3.9 unknown ❌ 1201.74073 4749.15408
SMTInterpol SMTInterpol unknown ❌ 1202.24273 1367.27733
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.52665 0.40887
iProver iProver v3.9.3 unknown ❌ 1201.76019 4765.65435
SMTInterpol SMTInterpol unknown ❌ 1201.78792 1270.21219
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92627 3.91431