Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.608797.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	23367
Compressed Size	3945
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	23359
Compressed Size	3969
Max. Term Depth	12
Asserts	162
Declared Functions	58
Declared Constants	26
Declared Sorts	39
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	2	false	30	ite	4	not	24
or	16	and	20	=>	120	=	388
forall	175	exists	14	let	21

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2406.81000	2407.08000
		CVC4	CVC4 f7118b2 default	sat ✅	503.09700	502.89000
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.71000	2400.09000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.61000	2400.08000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	721.01500	696.72700
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	162.26200	161.36200
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	161.49200	161.46600
		veriT	veriT default	unknown ❌	1048.74000	1048.87000
		Z3	z3 4.4.0 default	unknown ❌	1183.99000	1148.04000
SMT-COMP 2016	0.83 (1/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unknown ❌	2400.02000	2360.39000
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	15.69970	15.77750
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	8.66535	33.89000
		veriT	veriT-dev default	unknown ❌	2400.05000	2401.25000
		Z3	z3-4.4.1 default	unknown ❌	860.13300	860.34000
SMT-COMP 2017	0.83 (1/6)	CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.03600	590.11000
		Vampire	vampire4.2-smt vampire	sat ✅	2.73586	10.78000
		veriT	veriT-2017-06-17 default	unknown ❌	600.01800	599.88000
		Z3	z3-4.5.0 default	unknown ❌	600.06700	600.07000
SMT-COMP 2018	0.67 (2/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	762.80500	751.57000
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	3.08411	12.01000
		veriT	veriT_default	unknown ❌	1200.05000	1200.07000
		Z3	z3-4.7.1_default	unknown ❌	907.01200	906.77100
SMT-COMP 2019	0.62 (3/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	1323.72000	5259.24000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	1396.82000	1387.28000
			master-2018-06-10-b19c840-competition-default_default	sat ✅	743.11800	736.60400
		Par4	Par4-wrapped-sq_default	sat ✅	747.69400	2233.64000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.05000	2451.55000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.29014	3.36794
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.03962	3.24993
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.21438	3.35106
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	58.48810	232.01300
			vampire-4.3-smt_vampire_smtcomp	sat ✅	4.95352	19.41000
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.04000	2399.87000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	579.72200	579.48500
SMT-COMP 2020	0.71 (2/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	1200.09000	4760.01000
		CVC4	CVC4-sq-final_default	sat ✅	800.56000	795.82300
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	unknown ❌	1200.11000	1183.15000
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.08000	1236.34000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.32300	3.53476
		Vampire	vampire_smt_4.5_vampire_smtcomp	sat ✅	3.74647	14.69000
			vampire-4.3-smt_vampire_smtcomp	sat ✅	4.13965	16.04000
		veriT	veriT_default	unknown ❌	1200.03000	1199.80000
			veriT+vite_default	unknown ❌	1200.06000	1199.96000
		Z3	z3-4.8.8_default	unknown ❌	662.77500	662.64500
SMT-COMP 2021	0.86 (1/7)	CVC4	CVC4-sq-final_default	unknown ❌	1200.02000	1195.60000
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unknown ❌	1200.05000	4746.58000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.05000	3155.90000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.95434	4.70199
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	sat ✅	36.92540	146.39000
			vampire_smt_4.5_vampire_smtcomp	sat ✅	3.76489	14.10000
		veriT	veriT_default	unknown ❌	1200.08000	1199.95000
		Z3	z3-4.8.11_default	unknown ❌	452.12200	452.00700
SMT-COMP 2023	0.67 (2/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	671.67200	650.79200
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	784.78300	768.05100
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.67000	4298.13000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.05000	3735.93000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.79218	4.76015
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	31.50960	124.68000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.02000	1199.89000
SMT-COMP 2024	0.75 (1/4)	cvc5	cvc5	sat ✅	862.23785	861.80067
		iProver	iProver v3.9	unknown ❌	1201.75749	4776.87092
		SMTInterpol	SMTInterpol	unknown ❌	1202.71765	4311.73341
		Yices2	Yices2	unknown ❌	1201.37002	1201.14055