Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1339511.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	123147
Compressed Size	16969
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	123139
Compressed Size	16976
Max. Term Depth	19
Asserts	466
Declared Functions	233
Declared Constants	129
Declared Sorts	262
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	91	ite	8	not	95	or	7
and	37	=>	607	=	1214	forall	550
exists	33	let	199

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2401.95000	2402.70000
		CVC4	CVC4 f7118b2 default	unsat ✅	0.69759	0.68290
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.41000	2400.09000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.12000	2400.06000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	2402.89000	2403.73000
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.58852	0.58591
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.57933	0.57691
		veriT	veriT default	unknown ❌	2400.01000	2400.99000
		Z3	z3 4.4.0 default	unknown ❌	554.78000	554.97600
SMT-COMP 2016	0.50 (3/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.67527	0.67584
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	138.81600	139.54300
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	13.85070	54.80000
		veriT	veriT-dev default	unsat ✅	60.18860	60.22390
		Z3	z3-4.4.1 default	unknown ❌	2400.05000	2401.21000
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.44572	0.44498
		Vampire	vampire4.2-smt vampire	unsat ✅	18.17140	72.06000
		veriT	veriT-2017-06-17 default	unsat ✅	43.30740	43.30710
		Z3	z3-4.5.0 default	unknown ❌	600.10000	600.04000
SMT-COMP 2018	0.33 (4/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.48251	0.48273
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	14.67690	58.09980
		veriT	veriT_default	unsat ✅	43.37730	43.36780
		Z3	z3-4.7.1_default	unsat ✅	0.64224	0.64208
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	8.28798	32.75000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.46291	0.46326
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.49192	0.49227
		Par4	Par4-wrapped-sq_default	unsat ✅	0.51627	0.00630
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.11000	2406.66000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.60318	3.88919
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.22748	3.58333
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.62562	3.82774
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	279.72700	1111.24000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	22.40270	88.85000
		veriT	veriT-wrapped-sq_default	unsat ✅	43.25690	43.25730
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.94646	0.94609
SMT-COMP 2022	0.29 (5/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.52893	0.52912
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.77030	0.77076
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.05435	5.98647
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	63.94140	253.00000
		veriT	veriT_default	unsat ✅	413.70200	413.65400
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unknown ❌	1200.11000	1200.03000
		Z3	z3-4.8.17_default	unsat ✅	0.17414	0.17594
SMT-COMP 2023	0.50 (3/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.69210	0.68714
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.63074	0.63129
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	158.29100	616.89100
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.10000	1246.47000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.86612	5.22597
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	47.96140	190.07000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.11000	1200.06000