Benchmark

non-incremental/UFLIA/sledgehammer/QEpres/smtlib.645464.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	24071
Compressed Size	4200
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	—
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	24063
Compressed Size	4222
Max. Term Depth	13
Asserts	160
Declared Functions	53
Declared Constants	41
Declared Sorts	45
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	10	ite	5	not	33
or	6	and	19	=>	72	=	258
forall	150	exists	6	let	48	Int	191
+	39	-	27	*	6	<	27
<=	24

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.01675	0.00800
		CVC4	CVC4 f7118b2 default	unknown ❌	2399.81000	2400.04000
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.01000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.05260	0.04399
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.00913	0.00900
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.11358	0.11098
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.11251	0.10998
		veriT	veriT default	unknown ❌	2400.01000	2400.69000
		Z3	z3 4.4.0 default	unsat ✅	0.06564	0.06599
SMT-COMP 2016	0.25 (3/4)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	247.90400	214.45900
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	2.49539	2.50686
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.19994	0.16334
		veriT	veriT-dev default	unknown ❌	2400.03000	2401.43000
		Z3	z3-4.4.1 default	unsat ✅	0.06696	0.06819
SMT-COMP 2017	0.25 (3/4)	CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.01900	505.78600
		Vampire	vampire4.2-smt vampire	unsat ✅	0.33694	0.33379
		veriT	veriT-2017-06-17 default	unsat ✅	12.10340	12.10210
		Z3	z3-4.5.0 default	unsat ✅	0.07172	0.07131
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	977.28700	970.52500
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	294.54100	1171.62000
		veriT	veriT_default	unsat ✅	12.32310	12.32320
		Z3	z3-4.7.1_default	unsat ✅	0.07672	0.07666
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.09000	9520.87000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	181.75300	181.02700
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	122.02100	121.47300
		Par4	Par4-wrapped-sq_default	unsat ✅	0.08688	0.00628
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.10000	2416.72000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.35235	3.32932
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.25466	3.28562
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.28846	3.36667
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	0.56918	0.49137
		veriT	veriT-wrapped-sq_default	unsat ✅	12.22800	12.22830
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.08023	0.08021
SMT-COMP 2020	0.50 (4/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	1200.03000	4768.53000
		CVC4	CVC4-sq-final_default	unsat ✅	969.69600	958.87500
		Par4	Par4-wrapped-sq_default	unsat ✅	0.08569	0.00594
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.11000	1218.11000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.42708	3.51295
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	75.78770	299.65000
		veriT	veriT_default	unsat ✅	107.14700	107.14300
			veriT+vite_default	unknown ❌	1200.06000	1199.94000
		Z3	z3-4.8.8_default	unknown ❌	1200.02000	1199.79000
SMT-COMP 2021	0.38 (5/8)	CVC4	CVC4-sq-final_default	unsat ✅	91.02180	90.85060
		cvc5	cvc5-fixed_default	unsat ✅	214.10400	210.75900
		Par4	Par4-wrapped-sq_default	unsat ✅	0.08824	0.00664
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.11000	4252.26000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.90094	4.65631
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	0.27224	0.27157
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.40041	0.21743
		veriT	veriT_default	unsat ✅	13.62970	13.63000
		Z3	z3-4.8.11_default	unknown ❌	1200.06000	1200.05000
			z3-4.8.8_default	unknown ❌	1200.05000	1199.89000
SMT-COMP 2023	0.40 (3/5)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	213.31500	211.29900
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	212.42100	211.57800
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	5.16057	18.77000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.03000	4253.04000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.93401	4.67327
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	0.58854	2.20000
SMT-COMP 2025	0.75 (1/4)	cvc5	cvc5	unknown ❌	1201.79101	1201.06305
		iProver	iProver v3.9.3	unsat ✅	15.96016	53.25098
		SMTInterpol	SMTInterpol	unknown ❌	1201.88701	4238.13373
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.89875	4.07440