Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/distro/gram_lang/x2015_09_10_16_54_05_648_1456120.smt_in.smt2

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.

Benchmark
Size	103663
Compressed Size	14006
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2017-07-23
Generated By	Andrew Reynolds
Generated On	2017-04-28 00:00:00
Generator	Sledgehammer, converted to v2.6 by CVC4
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	103654
Compressed Size	14018
Max. Term Depth	14
Asserts	450
Declared Functions	292
Declared Constants	47
Declared Sorts	138
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	7	false	38	ite	1	not	45
or	19	and	303	=>	251	=	412
forall	468	exists	85

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.33 (4/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.33365	0.33317
		Vampire	vampire4.2-smt vampire	unsat ✅	17.66580	69.91000
		veriT	veriT-2017-06-17 default	unsat ✅	1.22075	1.22007
		Z3	z3-4.5.0 default	unsat ✅	0.23038	0.22878
SMT-COMP 2018	0.33 (4/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.35623	0.35643
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	60.02460	238.64000
		veriT	veriT_default	unsat ✅	1.74629	1.74634
		Z3	z3-4.7.1_default	unsat ✅	0.22621	0.22615
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	3.62803	14.05000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.38360	0.38394
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.34321	0.34348
		Par4	Par4-wrapped-sq_default	unsat ✅	0.24466	0.00582
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2410.43000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.40757	3.79787
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.20192	3.49910
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.42063	3.85536
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	16.30190	64.15020
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	85.48520	339.39000
		veriT	veriT-wrapped-sq_default	unsat ✅	1.85241	1.85254
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.23381	0.23383
SMT-COMP 2020	0.29 (5/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	2.16613	10.47680
		CVC4	CVC4-sq-final_default	unsat ✅	0.38196	0.38227
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.35377	0.35406
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.04000	1213.11000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.49870	3.98529
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	6.15444	24.20000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	89.65090	355.83000
		veriT	veriT_default	unsat ✅	0.11545	0.11576
			veriT+vite_default	unsat ✅	0.12571	0.12603
		Z3	z3-4.8.8_default	unsat ✅	0.22883	0.22865
SMT-COMP 2021	0.29 (5/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.33218	0.33250
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unsat ✅	3.29747	11.72000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.04000	1246.63000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.97059	5.18559
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	8.36414	32.89000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	6.78148	26.57000
		veriT	veriT_default	unsat ✅	0.17012	0.17052
		Z3	z3-4.8.11_default	unsat ✅	0.26029	0.25844
SMT-COMP 2023	0.50 (3/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.33611	0.33663
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.33394	0.33447
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	62.23000	240.28000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.02000	1246.74000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	3.16769	5.20113
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	7.39001	28.94000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.11000	1199.84000
SMT-COMP 2024	0.25 (3/4)	cvc5	cvc5	unsat ✅	0.43193	0.33230
		iProver	iProver v3.9	unsat ✅	5.36172	17.87190
		SMTInterpol	SMTInterpol	unsat ✅	75.30450	93.92750
		Yices2	Yices2	unknown ❌	1201.37046	1201.21829