Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.688574.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	84091
Compressed Size	12269
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	84083
Compressed Size	12315
Max. Term Depth	15
Asserts	364
Declared Functions	302
Declared Constants	174
Declared Sorts	335
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	12	false	114	ite	8	not	51
or	2	and	9	=>	545	=	938
forall	459	exists	6	let	27

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	2.14541	2.13767
		CVC4	CVC4 f7118b2 default	unsat ✅	4.33951	4.32934
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.05000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.41000	2400.02000
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	2.71683	2.71759
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	1.70843	1.70674
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	1.68164	1.67974
		veriT	veriT default	unknown ❌	2073.94000	2074.60000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.74000
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.32757	0.32791
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	82.88030	83.28990
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	14.58350	57.85620
		veriT	veriT-dev default	unknown ❌	2400.05000	2401.35000
		Z3	z3-4.4.1 default	unknown ❌	2400.11000	2400.81000
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.28208	0.28057
		Vampire	vampire4.2-smt vampire	unsat ✅	453.18600	873.05000
		veriT	veriT-2017-06-17 default	unsat ✅	0.94713	0.94611
		Z3	z3-4.5.0 default	unknown ❌	600.02400	599.87000
SMT-COMP 2018	0.67 (2/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.64789	0.64790
		Vampire	vampire-4.3-smt_vampire_smtcomp	unknown ❌	1200.08000	4769.64000
		veriT	veriT_default	unsat ✅	0.47764	0.47789
		Z3	z3-4.7.1_default	unknown ❌	1200.01000	1199.66000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	5.76336	22.76360
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.31103	0.31140
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.30612	0.30631
		Par4	Par4-wrapped-sq_default	unsat ✅	0.33290	0.00570
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.06000	2537.80000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.50287	4.06331
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.14390	3.63278
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.38653	4.04949
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	1860.70000	7393.34000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	634.76300	2524.88000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.73903	0.73929
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	990.82300	990.66300
SMT-COMP 2020	0.43 (4/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	9.01480	35.70000
		CVC4	CVC4-sq-final_default	unsat ✅	462.84200	452.50200
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	274.60300	273.91400
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.04000	1232.25000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.53532	3.99046
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	308.55400	1115.61000
			vampire-4.3-smt_vampire_smtcomp	unknown ❌	1200.07000	4757.88000
		veriT	veriT_default	unsat ✅	183.64100	183.62200
			veriT+vite_default	unsat ✅	5.57702	5.57762
		Z3	z3-4.8.8_default	unknown ❌	1200.12000	1199.91000
SMT-COMP 2021	0.57 (3/7)	CVC4	CVC4-sq-final_default	unsat ✅	4.67745	4.67776
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unknown ❌	1200.05000	4751.17000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.04000	1239.22000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	3.03044	5.43610
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	940.44000	3617.01000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	305.82800	1116.39000
		veriT	veriT_default	unsat ✅	1.37094	1.37024
		Z3	z3-4.8.11_default	unknown ❌	1200.02000	1199.76000
SMT-COMP 2023	0.67 (2/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.54834	0.54888
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.62346	0.62404
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.04000	4667.61000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.14000	1229.30000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.92279	5.33498
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unknown ❌	1200.02000	4772.55000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	515.29800	515.19900
SMT-COMP 2025	0.80 (1/5)	cvc5	cvc5	unsat ✅	0.41851	0.29934
		iProver	iProver v3.9.3	unknown ❌	1201.79339	4782.02883
		SMTInterpol	SMTInterpol	unknown ❌	1201.46824	1257.75782
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	2.05848	4.58025
		Yices2	Yices2	unknown ❌	1201.51846	1201.23006