Benchmark

non-incremental/UF/20170428-Barrett/cdt-cade2015/nada/afp/sorted_list_operations/x2015_09_10_16_47_50_813_1076460.smt_in.smt2

Publications: "A Decision Procedure for (Co)Datatypes" by Andrew Reynolds and Jasmin Blanchette, CADE 2015.

Benchmark
Size	65670
Compressed Size	8104
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2017-07-23
Generated By	Andrew Reynolds
Generated On	2017-04-28 00:00:00
Generator	Sledgehammer, converted to v2.6 by CVC4
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	65661
Compressed Size	8118
Max. Term Depth	14
Asserts	359
Declared Functions	54
Declared Constants	9
Declared Sorts	20
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	12	false	91	Bool	2	ite	6
not	92	or	25	and	333	=>	391
=	306	forall	482	exists	29

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.12054	0.12066
		Vampire	vampire4.2-smt vampire	unsat ✅	0.05931	0.05834
		veriT	veriT-2017-06-17 default	unsat ✅	0.02756	0.02690
		Z3	z3-4.5.0 default	unknown ❌	600.09100	599.89000
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.12598	0.12607
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.10722	0.06440
		veriT	veriT_default	unsat ✅	0.03614	0.03638
		Z3	z3-4.7.1_default	unknown ❌	1200.03000	1199.66000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.08077	0.08278
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.13391	0.13426
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.13072	0.13101
		Par4	Par4-wrapped-sq_default	unsat ✅	0.05416	0.00608
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2405.07000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.24168	3.40280
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.11854	3.34592
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.34991	3.38103
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	0.25721	0.25014
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.07036	0.06031
		veriT	veriT-wrapped-sq_default	unsat ✅	0.04022	0.04042
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.02000	2399.56000
SMT-COMP 2020	0.29 (5/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	0.09389	0.09356
		CVC4	CVC4-sq-final_default	unsat ✅	0.15789	0.15822
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.13411	0.13451
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unsat ✅	0.86655	2.19764
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.34314	3.48328
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.07333	0.07049
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.09927	0.06399
		veriT	veriT_default	unsat ✅	0.04030	0.04061
			veriT+vite_default	unsat ✅	0.03905	0.03939
		Z3	z3-4.8.8_default	unknown ❌	1200.02000	1199.54000
SMT-COMP 2021	0.29 (5/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.15898	0.15931
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unsat ✅	1.78388	5.58000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unsat ✅	0.91063	2.39829
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.95480	4.70663
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	0.08438	0.08160
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.06688	0.06362
		veriT	veriT_default	unsat ✅	0.03895	0.03927
		Z3	z3-4.8.11_default	unknown ❌	1200.06000	1199.78000
SMT-COMP 2022	0.29 (5/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.16024	0.16061
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.14468	0.14527
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.73776	4.65845
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	0.09353	0.09344
		veriT	veriT_default	unsat ✅	0.03720	0.03757
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.02000	0.01997
		Z3	z3-4.8.17_default	unknown ❌	1200.11000	1199.78000
SMT-COMP 2024		cvc5	cvc5	unsat ✅	0.28793	0.18846
		iProver	iProver v3.9	unsat ✅	0.83909	1.99746
		SMTInterpol	SMTInterpol	unsat ✅	1.44246	3.96940
		Yices2	Yices2	unsat ✅	0.22575	0.12612
SMT-COMP 2025	0.20 (4/5)	cvc5	cvc5	unsat ✅	0.32802	0.20583
		iProver	iProver v3.9.3	unsat ✅	0.88861	2.06900
		SMTInterpol	SMTInterpol	unsat ✅	1.22100	3.19556
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.95957	4.12584
		Yices2	Yices2	unsat ✅	0.28999	0.16611