Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.631241.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	94856
Compressed Size	13454
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	94848
Compressed Size	13433
Max. Term Depth	15
Asserts	468
Declared Functions	214
Declared Constants	36
Declared Sorts	89
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	8	false	164	ite	6	not	124
or	27	and	68	=>	893	=	1523
forall	733	exists	50	let	113	Int	2
+	10	<	21	<=	20

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.01884	0.01100
		CVC4	CVC4 f7118b2 default	unsat ✅	0.29924	0.28896
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.04000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.51000	2400.05000
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	0.01070	0.01000
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.30014	0.29795
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.29937	0.29695
		veriT	veriT default	unknown ❌	2400.01000	2400.37000
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.86000
SMT-COMP 2016	0.25 (3/4)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.37146	0.37191
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	131.60100	132.18200
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	15.69190	61.73000
		veriT	veriT-dev default	unsat ✅	20.14400	20.15590
		Z3	z3-4.4.1 default	unknown ❌	1416.48000	1416.70000
SMT-COMP 2017	0.25 (3/4)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.34845	0.34786
		Vampire	vampire4.2-smt vampire	unsat ✅	5.01322	19.65000
		veriT	veriT-2017-06-17 default	unsat ✅	0.28526	0.28492
		Z3	z3-4.5.0 default	unknown ❌	600.02700	599.80000
SMT-COMP 2018	0.25 (3/4)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.37778	0.37796
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	59.99560	238.15000
		veriT	veriT_default	unsat ✅	0.45365	0.45387
		Z3	z3-4.7.1_default	unknown ❌	1200.01000	1199.96000
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.69234	2.49000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.38011	0.38045
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.38659	0.38694
		Par4	Par4-wrapped-sq_default	unsat ✅	0.41324	0.00564
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.06000	2408.15000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.35997	3.81851
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.13438	3.56705
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.41760	3.82459
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	36.40080	143.78000
		veriT	veriT-wrapped-sq_default	unsat ✅	0.44023	0.44063
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	1228.25000	1228.10000
SMT-COMP 2020	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	1.93029	7.30000
		CVC4	CVC4-sq-final_default	unsat ✅	0.42701	0.42735
		Par4	Par4-wrapped-sq_default	unsat ✅	0.41990	0.00871
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.03000	1210.06000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.39396	3.85872
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	2.98944	11.10000
		veriT	veriT_default	unsat ✅	0.36449	0.36483
			veriT+vite_default	unsat ✅	0.16219	0.16252
		Z3	z3-4.8.8_default	unknown ❌	822.23300	821.97800
SMT-COMP 2021	0.38 (5/8)	CVC4	CVC4-sq-final_default	unsat ✅	0.42780	0.42790
		cvc5	cvc5-fixed_default	unsat ✅	0.37229	0.37192
		Par4	Par4-wrapped-sq_default	unsat ✅	0.41612	0.00609
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.05000	1235.93000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.95675	5.42771
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	33.32540	131.60000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	15.20830	60.15000
		veriT	veriT_default	unsat ✅	0.25818	0.25854
		Z3	z3-4.8.11_default	unknown ❌	634.03300	634.06100
			z3-4.8.8_default	unknown ❌	763.57300	763.37300
SMT-COMP 2022	0.33 (4/6)	CVC4	CVC4-sq-final_default	unsat ✅	0.43037	0.43057
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.40266	0.40320
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.67787	5.08309
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	17.30450	68.46050
		veriT	veriT_default	unsat ✅	0.13947	0.13986
		Z3	z3-4.8.17_default	unknown ❌	1200.04000	1199.75000
SMT-COMP 2024	0.67 (1/3)	cvc5	cvc5	unsat ✅	0.45286	0.35365
		iProver	iProver v3.9	unknown ❌	1201.72975	4746.31937
		SMTInterpol	SMTInterpol	unknown ❌	1201.77542	1247.63204
SMT-COMP 2025	0.75 (1/4)	cvc5	cvc5	unsat ✅	0.58615	0.47202
		iProver	iProver v3.9.3	unknown ❌	1201.75638	4761.52570
		SMTInterpol	SMTInterpol	unknown ❌	1201.37760	1266.05206
		UltimateEliminator	UltimateEliminator+MathSAT	unknown ❌	1.94493	4.28223