Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.1122709.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	27656
Compressed Size	4015
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	27648
Compressed Size	4028
Max. Term Depth	11
Asserts	158
Declared Functions	36
Declared Constants	34
Declared Sorts	40
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	15	not	3	and	11	=>	258
=	484	forall	202	exists	7	let	37

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2401.52000	2402.04000
		CVC4	CVC4 f7118b2 default	sat ✅	551.62400	551.55700
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.09000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.02000	2400.01000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2402.15000	2402.94000
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	25.12550	25.12820
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	25.15190	25.14020
		veriT	veriT default	unknown ❌	2400.01000	2386.08000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.61000
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	320.35400	308.75700
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	10.43030	10.47920
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	0.80785	2.98000
		veriT	veriT-dev default	unknown ❌	2400.02000	2401.28000
		Z3	z3-4.4.1 default	unknown ❌	2400.04000	2401.32000
SMT-COMP 2017	0.67 (2/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	495.04500	492.63100
		Vampire	vampire4.2-smt vampire	sat ✅	0.48654	0.48157
		veriT	veriT-2017-06-17 default	unknown ❌	600.07500	605.98000
		Z3	z3-4.5.0 default	unknown ❌	600.08600	599.94000
SMT-COMP 2018	0.67 (2/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	522.34800	520.29300
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	2.05684	7.88000
		veriT	veriT_default	unknown ❌	1200.10000	1320.88000
		Z3	z3-4.7.1_default	unknown ❌	1200.08000	1199.91000
SMT-COMP 2019	0.62 (3/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.04000	9534.64000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	977.36300	972.99600
			master-2018-06-10-b19c840-competition-default_default	sat ✅	498.75000	495.80300
		Par4	Par4-wrapped-sq_default	sat ✅	498.53600	1493.80000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.08000	2402.18000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.38565	3.37449
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.11694	3.34177
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.43068	3.32703
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	37.26930	147.52000
			vampire-4.3-smt_vampire_smtcomp	sat ✅	1.70981	6.58000
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.03000	2399.70000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.03000	2399.98000
SMT-COMP 2021	0.57 (3/7)	CVC4	CVC4-sq-final_default	sat ✅	494.07100	492.56900
		iProver	iProver-v3.5-final-fix2_iProver_SMT	sat ✅	5.28127	19.21770
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.04000	1238.15000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	3.03819	5.38592
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	sat ✅	0.93278	3.52000
			vampire_smt_4.5_vampire_smtcomp	sat ✅	0.58178	0.46826
		veriT	veriT_default	unknown ❌	1200.10000	1200.05000
		Z3	z3-4.8.11_default	unknown ❌	1200.03000	1199.94000
SMT-COMP 2022	0.57 (3/7)	CVC4	CVC4-sq-final_default	sat ✅	505.43000	501.58500
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	518.60200	515.94900
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.19926	6.21644
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	sat ✅	0.95544	3.50000
		veriT	veriT_default	unknown ❌	1200.11000	1199.82000
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.04000	1199.84000
		Z3	z3-4.8.17_default	unknown ❌	1200.06000	1199.91000
SMT-COMP 2023	0.50 (3/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	536.98300	518.96700
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	522.05000	517.48200
		iProver	iProver-3.8-fix_iprover_SMT	sat ✅	345.42500	1355.67000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.04000	1238.97000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.91964	4.78138
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	0.84372	3.03000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.02000	1199.88000
SMT-COMP 2024	0.50 (2/4)	cvc5	cvc5	sat ✅	544.87595	544.76604
		iProver	iProver v3.9	sat ✅	14.87248	53.76654
		SMTInterpol	SMTInterpol	unknown ❌	1202.21411	1250.50006
		Yices2	Yices2	unknown ❌	1201.34430	1200.73687
SMT-COMP 2025	0.60 (2/5)	cvc5	cvc5	sat ✅	546.62101	546.39235
		iProver	iProver v3.9.3	sat ✅	13.44694	46.40571
		SMTInterpol	SMTInterpol	unknown ❌	1201.78701	1507.33206
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	2.00489	4.22241
		Yices2	Yices2	unknown ❌	1201.44247	1201.20003