Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.714038.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	92984
Compressed Size	14672
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	92976
Compressed Size	14678
Max. Term Depth	15
Asserts	382
Declared Functions	445
Declared Constants	251
Declared Sorts	509
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	12	false	214	ite	9	not	118
or	9	and	16	=>	553	=	912
distinct	5	forall	405	exists	18	let	36

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	0.33027	0.30795
		CVC4	CVC4 f7118b2 default	unsat ✅	2.77601	2.76658
		veriT	veriT-smtcomp2014 default	unknown ❌	855.23300	855.53700
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.41000	2400.09000
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unsat ✅	0.27381	0.27296
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	1.11759	1.11483
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	1.08158	1.07883
		veriT	veriT default	unknown ❌	2147.12000	2147.82000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.11000
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.74598	0.74676
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	52.07280	52.30870
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	9.13577	36.06000
		veriT	veriT-dev default	unknown ❌	2400.08000	2401.36000
		Z3	z3-4.4.1 default	unknown ❌	2400.11000	2401.01000
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	6.55100	6.55051
		Vampire	vampire4.2-smt vampire	unsat ✅	4.95564	19.45000
		veriT	veriT-2017-06-17 default	unsat ✅	0.38834	0.38735
		Z3	z3-4.5.0 default	unknown ❌	600.01800	599.84000
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.27872	0.27872
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	364.20600	1448.31000
		veriT	veriT_default	unsat ✅	0.38573	0.38600
		Z3	z3-4.7.1_default	unknown ❌	1200.02000	1199.67000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	5.34186	20.89000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	99.47120	99.31800
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	459.25800	452.09200
		Par4	Par4-wrapped-sq_default	unsat ✅	0.38208	0.00599
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.07000	2650.78000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.51436	4.09443
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.13620	3.56198
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.59704	4.16147
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	15.23430	60.00000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	366.38400	1454.88000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.34892	0.34928
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.07000	2399.20000
SMT-COMP 2021	0.57 (3/7)	CVC4	CVC4-sq-final_default	unsat ✅	44.88030	44.87900
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unknown ❌	1200.07000	4749.60000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1017.10000	3084.28000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	3.10264	5.74645
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	12.37860	48.69000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	11.69040	46.05000
		veriT	veriT_default	unsat ✅	1.26266	1.26316
		Z3	z3-4.8.11_default	unknown ❌	1200.05000	1200.05000
SMT-COMP 2022	0.43 (4/7)	CVC4	CVC4-sq-final_default	unsat ✅	33.21200	33.20780
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	32.57930	32.56110
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.07776	5.44893
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	11.56910	45.58000
		veriT	veriT_default	unsat ✅	1.28725	1.28781
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.10000	1199.92000
		Z3	z3-4.8.17_default	unknown ❌	1200.11000	1199.57000
SMT-COMP 2023	0.33 (4/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.25898	0.25956
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.33780	0.33835
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	21.17720	81.19000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.03000	1254.55000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	3.11140	5.32096
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	9.73969	38.14000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	129.79100	129.76100
SMT-COMP 2024	0.50 (2/4)	cvc5	cvc5	unsat ✅	32.11593	31.99667
		iProver	iProver v3.9	unsat ✅	489.19587	1935.18966
		SMTInterpol	SMTInterpol	unknown ❌	1201.71266	1253.35191
		Yices2	Yices2	unknown ❌	1201.71082	1201.40047