Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.714796.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	32640
Compressed Size	5271
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	32632
Compressed Size	5281
Max. Term Depth	11
Asserts	150
Declared Functions	121
Declared Constants	63
Declared Sorts	140
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	46	not	2	and	9	=>	209
=	374	forall	198	exists	9	let	30

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2402.93000	2403.80000
		CVC4	CVC4 f7118b2 default	sat ✅	41.09060	41.08280
		veriT	veriT-smtcomp2014 default	unknown ❌	136.90700	136.93200
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.21000	2400.08000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2403.72000	2402.50000
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	20.55780	20.55790
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	20.58380	20.58690
		veriT	veriT default	unknown ❌	1665.76000	1666.27000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2401.19000
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	337.37500	305.86500
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	9.98681	10.03670
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	0.57534	0.32568
		veriT	veriT-dev default	unknown ❌	2400.10000	2401.38000
		Z3	z3-4.4.1 default	unknown ❌	2400.03000	2401.26000
SMT-COMP 2017	0.67 (2/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	455.27100	451.93000
		Vampire	vampire4.2-smt vampire	sat ✅	0.30274	0.34256
		veriT	veriT-2017-06-17 default	unknown ❌	600.05800	599.92000
		Z3	z3-4.5.0 default	unknown ❌	600.05100	600.02000
SMT-COMP 2018	0.67 (2/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	483.81600	481.95700
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	0.55149	0.34284
		veriT	veriT_default	unknown ❌	1200.02000	1199.83000
		Z3	z3-4.7.1_default	unknown ❌	1200.01000	1199.95000
SMT-COMP 2019	0.62 (3/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.02000	6714.61000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	971.45300	962.50400
			master-2018-06-10-b19c840-competition-default_default	sat ✅	484.70300	481.92500
		Par4	Par4-wrapped-sq_default	sat ✅	486.23000	1453.77000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.06000	2408.83000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.40170	3.76555
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.11546	3.48064
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.34406	3.69473
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	3.00630	11.57000
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.35245	0.34226
		veriT	veriT-wrapped-sq_default	unknown ❌	2158.15000	2158.16000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.10000	2399.89000
SMT-COMP 2020	0.71 (2/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	1200.02000	3260.26000
		CVC4	CVC4-sq-final_default	sat ✅	484.08800	481.91500
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	965.11300	962.12200
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.03000	1209.91000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.40255	3.95659
		Vampire	vampire_smt_4.5_vampire_smtcomp	sat ✅	0.33968	0.33047
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.34921	0.35192
		veriT	veriT_default	unknown ❌	1200.04000	1199.63000
			veriT+vite_default	unknown ❌	596.13100	596.10000
		Z3	z3-4.8.8_default	unknown ❌	1200.03000	1199.97000
SMT-COMP 2022	0.57 (3/7)	CVC4	CVC4-sq-final_default	sat ✅	483.68300	481.85700
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	514.28800	512.11300
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.83876	4.89594
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	sat ✅	0.79307	2.99000
		veriT	veriT_default	unknown ❌	1200.03000	1199.96000
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.11000	1199.99000
		Z3	z3-4.8.17_default	unknown ❌	1200.03000	1199.91000
SMT-COMP 2023	0.67 (2/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	521.45800	512.67700
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	515.27600	511.98400
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.05000	4684.64000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.05000	4180.05000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.85902	4.86827
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	1.00962	3.49000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.11000	1200.11000
SMT-COMP 2025	0.80 (1/5)	cvc5	cvc5	sat ✅	540.98953	540.83386
		iProver	iProver v3.9.3	unknown ❌	1201.79465	4783.57442
		SMTInterpol	SMTInterpol	unknown ❌	448.29603	1694.18816
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	2.00640	4.35583
		Yices2	Yices2	unknown ❌	1201.52512	1201.28833