Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.928616.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	2728
Compressed Size	814
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2720
Compressed Size	821
Max. Term Depth	10
Asserts	13
Declared Functions	10
Declared Constants	8
Declared Sorts	11
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	2	and	3	=>	12	=	32
forall	11	let	3

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.22020	0.21197
		CVC4	CVC4 f7118b2 default	sat ✅	40.29170	40.28690
		veriT	veriT-smtcomp2014 default	unknown ❌	28.05440	28.05970
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.12000	2400.05000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.10353	0.10298
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	20.16810	20.17290
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	20.16840	20.17290
		veriT	veriT default	unknown ❌	483.71700	457.11000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2401.03000
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	306.94700	301.40400
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	9.77233	9.81695
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	0.11376	0.11406
		veriT	veriT-dev default	unknown ❌	2400.03000	2401.52000
		Z3	z3-4.4.1 default	unknown ❌	2400.10000	2401.61000
SMT-COMP 2017	0.67 (2/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	450.50800	450.51400
		Vampire	vampire4.2-smt vampire	sat ✅	0.10731	0.10640
		veriT	veriT-2017-06-17 default	unknown ❌	600.01700	599.94000
		Z3	z3-4.5.0 default	unknown ❌	600.02800	599.97000
SMT-COMP 2018	0.67 (2/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	480.51700	480.41700
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	0.16827	0.16868
		veriT	veriT_default	unknown ❌	1200.03000	1199.95000
		Z3	z3-4.7.1_default	unknown ❌	1200.03000	1199.79000
SMT-COMP 2019	0.62 (3/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	0.16848	0.40807
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.66800	960.63200
			master-2018-06-10-b19c840-competition-default_default	sat ✅	480.62400	480.53700
		Par4	Par4-wrapped-sq_default	sat ✅	480.60600	1441.25000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.04000	2556.47000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.25363	3.39325
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.19355	3.30797
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.38558	3.43264
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	0.61606	2.12000
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.16281	0.16321
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.03000	2459.73000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.03000	2399.80000
SMT-COMP 2020	0.71 (2/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	0.14184	0.34169
		CVC4	CVC4-sq-final_default	sat ✅	480.50200	510.48700
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.62600	960.47500
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.02000	1238.16000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.29348	3.49723
		Vampire	vampire_smt_4.5_vampire_smtcomp	sat ✅	0.18712	0.10694
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.28532	0.17095
		veriT	veriT_default	unknown ❌	1200.02000	1199.63000
			veriT+vite_default	unknown ❌	1200.01000	1199.59000
		Z3	z3-4.8.8_default	unknown ❌	1200.03000	1199.99000
SMT-COMP 2022	0.57 (3/7)	CVC4	CVC4-sq-final_default	sat ✅	481.46500	480.52500
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	510.53600	510.49200
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.97087	4.68275
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	sat ✅	0.28849	0.16021
		veriT	veriT_default	unknown ❌	1157.91000	1157.79000
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.03000	1199.82000
		Z3	z3-4.8.17_default	unknown ❌	1200.02000	1199.94000
SMT-COMP 2023	0.67 (2/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	513.43100	510.95600
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	510.76000	510.51100
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.12000	4747.73000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.04000	1223.86000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.98996	4.82048
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	0.30177	0.17231
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.01000	1199.83000
SMT-COMP 2025	0.80 (1/5)	cvc5	cvc5	sat ✅	540.39555	540.20084
		iProver	iProver v3.9.3	unknown ❌	1201.79620	4782.67680
		SMTInterpol	SMTInterpol	unknown ❌	1201.78843	1245.65481
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.86856	3.95991
		Yices2	Yices2	unknown ❌	1201.27750	1201.07245