Benchmark

non-incremental/UFLIA/simplify/javafe.util.Set.811.smt2

Simplify Theorem Prover Benchmark Suite

Benchmark
Size	24955
Compressed Size	4764
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2006-08-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	24947
Compressed Size	4781
Max. Term Depth	36
Asserts	86
Declared Functions	49
Declared Constants	100
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	2	not	44	or	19	and	55
=>	54	=	342	distinct	1	forall	82
let	19	Int	142	+	25	-	3
<	16	<=	34	>	1	>=	1

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008	0.33 (2/3)	Alt-Ergo	Alt-Ergo	unknown ❌	1201.00000	—
			Alt-Ergo (revised)	unknown ❌	1201.00000	—
		CVC3	CVC3-1.5	unsat ✅	0.10000	—
		Z3	Z3 0.1	unsat ✅	—	—
			Z3.2	unsat ✅	—	—
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.06761	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.06536	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.06066	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.04830	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.05078	—
		veriT	veriT-SMT-EVAL-2013 default	unsat ✅	0.02368	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.03349	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.03973	—
SMT-COMP 2015	0.25 (3/4)	CVC3	CVC3 default	unknown ❌	0.00893	0.00800
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.04790	0.04499
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.04902	0.04599
		veriT	veriT default	unsat ✅	0.01942	0.01800
		Z3	z3 4.4.0 default	unsat ✅	0.05768	0.05799
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.05433	0.05455
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	2.52467	2.53661
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.28350	0.19928
		veriT	veriT-dev default	unsat ✅	0.02087	0.02107
		Z3	z3-4.4.1 default	unsat ✅	0.05686	0.05812
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.05616	0.05500
		Vampire	vampire4.2-smt vampire	unsat ✅	0.08347	0.08221
		veriT	veriT-2017-06-17 default	unsat ✅	0.02379	0.02297
		Z3	z3-4.5.0 default	unsat ✅	0.06357	0.06274
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.06127	0.06151
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	50.47340	200.40000
		veriT	veriT_default	unsat ✅	0.02396	0.02418
		Z3	z3-4.7.1_default	unsat ✅	0.06896	0.06889
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.27795	0.27763
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.06724	0.06760
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.06181	0.06213
		Par4	Par4-wrapped-sq_default	unsat ✅	0.04011	0.00606
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.10000	2409.44000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.36135	3.39474
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.18294	3.34445
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.22348	3.36019
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	0.71368	2.49000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.02464	0.02499
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.07270	0.07271
SMT-COMP 2021	0.12 (7/8)	CVC4	CVC4-sq-final_default	unsat ✅	0.07042	0.07075
		cvc5	cvc5-fixed_default	unsat ✅	0.06313	0.06364
		Par4	Par4-wrapped-sq_default	unsat ✅	0.03626	0.00750
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unsat ✅	1.61972	4.58161
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.70253	4.64602
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	0.33991	0.28049
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.10708	0.10690
		veriT	veriT_default	unsat ✅	0.02279	0.02315
		Z3	z3-4.8.11_default	unsat ✅	0.82698	0.82694
			z3-4.8.8_default	unsat ✅	0.53928	0.53874
SMT-COMP 2023	0.20 (4/5)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.06124	0.06183
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.13078	0.13108
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	3.66115	12.67000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unsat ✅	1.77908	5.19854
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.87360	4.78665
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	0.26062	0.25802