Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.767278.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	113537
Compressed Size	17229
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	113529
Compressed Size	17258
Max. Term Depth	15
Asserts	484
Declared Functions	446
Declared Constants	268
Declared Sorts	504
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	14	false	139	ite	6	not	106
or	46	and	90	=>	562	=	1459
forall	650	exists	57	let	32

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	0.23483	0.22697
		CVC4	CVC4 f7118b2 default	unsat ✅	0.62212	0.61191
		veriT	veriT-smtcomp2014 default	unknown ❌	76.05320	76.06040
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.91000	2400.01000
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	0.22389	0.22296
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.25735	0.25396
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.25751	0.25496
		veriT	veriT default	unknown ❌	1369.42000	1369.89000
		Z3	z3 4.4.0 default	unknown ❌	935.77600	935.86800
SMT-COMP 2016	0.50 (3/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.31227	0.31302
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	82.03000	82.41260
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	14.57750	57.66000
		veriT	veriT-dev default	unsat ✅	20.11710	20.13040
		Z3	z3-4.4.1 default	unknown ❌	2400.02000	2400.68000
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.64922	0.64862
		Vampire	vampire4.2-smt vampire	unsat ✅	0.58367	2.12000
		veriT	veriT-2017-06-17 default	unsat ✅	0.31738	0.31629
		Z3	z3-4.5.0 default	unknown ❌	600.02000	599.74000
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.91639	0.91635
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	836.07200	3321.73000
		veriT	veriT_default	unsat ✅	0.29470	0.29494
		Z3	z3-4.7.1_default	unknown ❌	1200.02000	1199.97000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.53867	0.53623
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	13.53530	13.53650
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	35.58550	35.58170
		Par4	Par4-wrapped-sq_default	unsat ✅	0.33688	0.00580
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2690.79000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.55838	4.13675
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.15467	3.54095
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.68780	4.21160
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	48.44610	192.04000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	835.72600	3318.88000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.30803	0.30842
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	1013.73000	1012.96000
SMT-COMP 2020	0.43 (4/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	0.66884	2.39000
		CVC4	CVC4-sq-final_default	unsat ✅	1.05463	1.05480
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.93874	0.93910
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.10000	3939.40000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.48434	4.24187
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	9.17425	36.22000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	832.99500	3307.76000
		veriT	veriT_default	unsat ✅	183.38400	183.35300
			veriT+vite_default	unsat ✅	5.33064	10.31130
		Z3	z3-4.8.8_default	unknown ❌	666.94100	666.83800
SMT-COMP 2022	0.29 (5/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.96809	0.96840
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.92523	0.92562
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.03616	5.51756
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	10.93960	43.21000
		veriT	veriT_default	unsat ✅	1.08834	2.08884
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	152.32900	152.30400
		Z3	z3-4.8.17_default	unknown ❌	644.93000	644.80400
SMT-COMP 2024	0.25 (3/4)	cvc5	cvc5	unsat ✅	1.31480	1.21529
		iProver	iProver v3.9	unsat ✅	51.41114	197.20039
		SMTInterpol	SMTInterpol	unknown ❌	1201.71911	1252.08482
		Yices2	Yices2	unsat ✅	112.91734	112.81376
SMT-COMP 2025	0.40 (3/5)	cvc5	cvc5	unsat ✅	0.65566	0.53006
		iProver	iProver v3.9.3	unsat ✅	89.03463	345.37585
		SMTInterpol	SMTInterpol	unknown ❌	1201.88918	1516.91726
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	2.03437	4.34273
		Yices2	Yices2	unsat ✅	176.61254	176.45910