Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/distro/gram_lang/x2015_09_10_16_53_03_911_1403335.smt_in.smt2

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.

Benchmark
Size	65796
Compressed Size	9047
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2017-07-23
Generated By	Andrew Reynolds
Generated On	2017-04-28 00:00:00
Generator	Sledgehammer, converted to v2.6 by CVC4
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	65787
Compressed Size	9053
Max. Term Depth	14
Asserts	362
Declared Functions	61
Declared Constants	17
Declared Sorts	23
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	64	ite	5	not	47	or	14
and	314	=>	285	=	343	forall	426
exists	34

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.61529	0.61453
		Vampire	vampire4.2-smt vampire	unsat ✅	11.69870	46.38000
		veriT	veriT-2017-06-17 default	unsat ✅	0.10168	0.09592
		Z3	z3-4.5.0 default	unknown ❌	600.09400	599.93000
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.34249	0.34262
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	5.48491	21.63000
		veriT	veriT_default	unsat ✅	0.19421	0.19439
		Z3	z3-4.7.1_default	unknown ❌	921.02800	921.04200
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.77412	2.75000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.40483	0.40490
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.40508	0.40535
		Par4	Par4-wrapped-sq_default	unsat ✅	0.22867	0.00725
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.04000	2415.27000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.42672	3.40010
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.11992	3.33035
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.43527	3.41991
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	186.86600	742.53000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	6.16814	24.11000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.20693	0.20733
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	480.99400	480.92600
SMT-COMP 2020	0.43 (4/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	0.69368	2.42000
		CVC4	CVC4-sq-final_default	unsat ✅	0.38241	0.38270
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.35596	0.35628
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.11000	4036.50000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.45390	3.66864
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	9.62793	37.78000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	6.86060	26.88000
		veriT	veriT_default	unsat ✅	21.96390	21.96110
			veriT+vite_default	unsat ✅	0.92455	0.92491
		Z3	z3-4.8.8_default	unknown ❌	614.60300	614.12200
SMT-COMP 2022	0.43 (4/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.37261	0.37299
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.30502	0.30544
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.07807	4.93532
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	6.35856	24.91000
		veriT	veriT_default	unsat ✅	1.30792	1.30855
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.11000	1200.00000
		Z3	z3-4.8.17_default	unknown ❌	340.04100	339.99200
SMT-COMP 2023	0.50 (3/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.32452	0.32405
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.29757	0.29815
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	4.16746	14.53000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.04000	2943.27000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.88424	4.75069
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	74.20860	294.27000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.02000	1199.96000
SMT-COMP 2024	0.50 (2/4)	cvc5	cvc5	unsat ✅	0.39690	0.29743
		iProver	iProver v3.9	unsat ✅	5.89817	20.10626
		SMTInterpol	SMTInterpol	unknown ❌	1202.74949	4128.30075
		Yices2	Yices2	unknown ❌	1201.26110	1200.75019
SMT-COMP 2025	0.40 (3/5)	cvc5	cvc5	unsat ✅	0.45546	0.33294
		iProver	iProver v3.9.3	unsat ✅	4.41430	14.06848
		SMTInterpol	SMTInterpol	unsat ✅	168.89238	220.84575
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.88616	4.02936
		Yices2	Yices2	unknown ❌	1201.44394	1201.13457