Benchmark

non-incremental/UF/sledgehammer/QEpres/smtlib.986439.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	2921
Compressed Size	811
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2913
Compressed Size	819
Max. Term Depth	7
Asserts	16
Declared Functions	14
Declared Constants	11
Declared Sorts	15
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	2	=>	6	=	24	forall	14
let	3

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.63344	0.62490
		CVC4	CVC4 f7118b2 default	sat ✅	40.08420	40.07990
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.08000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.03204	0.01900
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.60363	0.60291
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	20.04440	20.04900
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	20.04310	20.04700
		veriT	veriT default	unknown ❌	2400.01000	2400.98000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.97000
SMT-COMP 2016	0.50 (3/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	300.39100	300.46200
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	9.70354	9.74819
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	0.04174	0.04225
		veriT	veriT-dev default	unknown ❌	2400.02000	2401.41000
		Z3	z3-4.4.1 default	sat ✅	0.04208	0.04338
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	450.49800	450.43900
		Vampire	vampire4.2-smt vampire	sat ✅	0.04357	0.04281
		veriT	veriT-2017-06-17 default	unknown ❌	600.02900	599.97500
		Z3	z3-4.5.0 default	sat ✅	0.10722	0.10632
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	480.48700	480.39000
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	0.07634	0.06936
		veriT	veriT_default	unknown ❌	1200.02000	1199.85000
		Z3	z3-4.7.1_default	sat ✅	0.05961	0.05954
SMT-COMP 2019	0.50 (4/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.07000	9533.34000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.70800	960.59200
			master-2018-06-10-b19c840-competition-default_default	sat ✅	480.61800	480.47800
		Par4	Par4-wrapped-sq_default	sat ✅	0.06591	0.00577
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2404.38000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.31223	3.37307
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.05922	3.30825
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.39535	3.34516
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	0.09196	0.09205
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.11617	0.07005
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.03000	2399.72000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.13142	0.13143
SMT-COMP 2020	0.57 (3/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	1200.10000	4767.38000
		CVC4	CVC4-sq-final_default	sat ✅	480.61300	480.49000
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.80200	960.64400
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.09000	4008.51000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.35984	3.38938
		Vampire	vampire_smt_4.5_vampire_smtcomp	sat ✅	0.07743	0.05225
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.12314	0.07201
		veriT	veriT_default	unknown ❌	1200.11000	1199.70000
			veriT+vite_default	unknown ❌	326.01300	325.64000
		Z3	z3-4.8.8_default	sat ✅	0.05385	0.05377
SMT-COMP 2022	0.29 (5/7)	CVC4	CVC4-sq-final_default	sat ✅	480.60100	480.52400
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	510.64700	510.55000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.84999	4.65023
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	sat ✅	0.08284	0.05663
		veriT	veriT_default	unknown ❌	1200.05000	1200.05000
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.01284	0.00780
		Z3	z3-4.8.17_default	sat ✅	0.04053	0.04237
SMT-COMP 2025	0.60 (2/5)	cvc5	cvc5	sat ✅	540.31672	540.13233
		iProver	iProver v3.9.3	sat ✅	0.86402	1.08061
		SMTInterpol	SMTInterpol	unknown ❌	111.79897	287.60382
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.92037	4.06401
		Yices2	Yices2	unknown ❌	1201.36886	1201.05441