Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.769409.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	107618
Compressed Size	15777
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	107610
Compressed Size	15828
Max. Term Depth	15
Asserts	507
Declared Functions	271
Declared Constants	246
Declared Sorts	291
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	13	false	116	ite	6	not	115
or	7	and	91	=>	667	=	1493
forall	723	exists	60	let	34	Int	2
+	11	<	23	<=	19

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.01121	0.01000
		CVC4	CVC4 f7118b2 default	unsat ✅	0.66866	0.65490
		veriT	veriT-smtcomp2014 default	unknown ❌	59.94130	59.93790
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	1570.71000	1570.65000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.01306	0.01200
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.27219	0.26996
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.26802	0.26496
		veriT	veriT default	unknown ❌	2400.01000	2400.94000
		Z3	z3 4.4.0 default	unknown ❌	1030.12000	1030.24000
SMT-COMP 2016	0.25 (3/4)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.33728	0.33763
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	42.00710	42.19340
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	5.12455	19.88850
		veriT	veriT-dev default	unsat ✅	20.11540	20.12560
		Z3	z3-4.4.1 default	unknown ❌	1005.94000	1006.36000
SMT-COMP 2017	0.25 (3/4)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	45.25010	45.23200
		Vampire	vampire4.2-smt vampire	unsat ✅	9.09004	35.90000
		veriT	veriT-2017-06-17 default	unsat ✅	0.31706	0.31619
		Z3	z3-4.5.0 default	unknown ❌	600.01300	599.63000
SMT-COMP 2018	0.25 (3/4)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.15569	1.15586
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	1056.53000	4198.89000
		veriT	veriT_default	unsat ✅	0.31055	0.31081
		Z3	z3-4.7.1_default	unknown ❌	1065.97000	1065.86000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.54341	0.54081
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	1.03324	1.03346
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.04068	1.04086
		Par4	Par4-wrapped-sq_default	unsat ✅	0.30378	0.00562
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.08000	2460.87000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.62327	4.00221
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.26670	3.55315
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.49845	3.95567
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	56.97800	225.83000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.27994	0.28028
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	880.74500	875.17000
SMT-COMP 2020	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	0.72450	2.39000
		CVC4	CVC4-sq-final_default	unsat ✅	0.49507	0.49532
		Par4	Par4-wrapped-sq_default	unsat ✅	0.32378	0.00816
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.07000	1217.71000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.52894	4.10030
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	17.47590	68.96000
		veriT	veriT_default	unsat ✅	0.29153	0.29172
			veriT+vite_default	unsat ✅	7.30300	7.30360
		Z3	z3-4.8.8_default	unknown ❌	878.48600	878.36300
SMT-COMP 2021	0.38 (5/8)	CVC4	CVC4-sq-final_default	unsat ✅	0.96162	0.96174
		cvc5	cvc5-fixed_default	unsat ✅	1.20795	1.20848
		Par4	Par4-wrapped-sq_default	unsat ✅	0.28347	0.00659
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.04000	1256.05000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.97222	5.40838
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	7.74877	30.34000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	19.35590	76.69000
		veriT	veriT_default	unsat ✅	0.08709	0.08748
		Z3	z3-4.8.11_default	unknown ❌	447.69200	447.61500
			z3-4.8.8_default	unknown ❌	799.35600	799.23200
SMT-COMP 2023	0.40 (3/5)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.81719	0.81479
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.99555	0.99054
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	105.78400	409.57000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.13000	1247.18000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	21.67320	5.32184
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	4.05814	15.65000