Benchmark

non-incremental/UFLIA/simplify2/front_end_suite/javafe.util.Set.001.smt2

Simplify front end test suite.
  This benchmark was translated by Michal Moskal.

Benchmark
Size	25059
Compressed Size	4887
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	25051
Compressed Size	4900
Max. Term Depth	25
Asserts	124
Declared Functions	59
Declared Constants	84
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	45	or	12	and	46
=>	51	=	198	distinct	2	forall	93
let	18	Int	163	+	3	-	3
<	22	<=	39	>	1	>=	2

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.50 (2/4)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.17647	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.12280	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	265.97500	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.03363	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.03480	—
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.01630	0.00800
		CVC4	CVC4 f7118b2 default	unsat ✅	0.10075	0.09798
		veriT	veriT-smtcomp2014 default	unknown ❌	19.18120	19.18110
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.05260	0.04499
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.00874	0.00800
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.09439	0.09198
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.09524	0.09298
		veriT	veriT default	unknown ❌	279.81700	279.76000
		Z3	z3 4.4.0 default	unsat ✅	0.07045	0.06999
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.10438	0.10465
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	20.14640	20.24230
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.33678	0.25240
		veriT	veriT-dev default	unsat ✅	0.02997	0.03027
		Z3	z3-4.4.1 default	unsat ✅	0.06371	0.06546
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.11311	0.11178
		Vampire	vampire4.2-smt vampire	unsat ✅	5.48660	21.49000
		veriT	veriT-2017-06-17 default	unsat ✅	0.03248	0.03127
		Z3	z3-4.5.0 default	unsat ✅	0.07384	0.07375
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.11356	0.11380
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	1.68450	6.54000
		veriT	veriT_default	unsat ✅	0.03252	0.03275
		Z3	z3-4.7.1_default	unsat ✅	0.07534	0.07527
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.40961	0.40907
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.12558	0.12593
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.12168	0.12197
		Par4	Par4-wrapped-sq_default	unsat ✅	0.04610	0.00632
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.06000	2408.42000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.33872	3.40598
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.29361	3.40505
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.38210	3.42629
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	2.19879	8.55000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.03201	0.03240
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.08235	0.08219
SMT-COMP 2022	0.17 (5/6)	CVC4	CVC4-sq-final_default	unsat ✅	0.12679	0.12701
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.21291	0.21349
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.83996	4.86505
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	1.31868	4.98000
		veriT	veriT_default	unsat ✅	0.03050	0.03085
		Z3	z3-4.8.17_default	unsat ✅	0.07634	0.07836