Benchmark

non-incremental/UF/sledgehammer/NS_Shared/smtlib.641890.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	15052
Compressed Size	2812
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	15044
Compressed Size	2811
Max. Term Depth	11
Asserts	100
Declared Functions	28
Declared Constants	42
Declared Sorts	33
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	8	false	12	not	20	or	13
and	2	=>	65	=	227	forall	91
exists	2	let	39

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	931.42500	931.50900
		CVC4	CVC4 f7118b2 default	sat ✅	40.67840	40.67080
		veriT	veriT-smtcomp2014 default	unknown ❌	2053.16000	2053.91000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	682.84000	683.05800
SMT-COMP 2015	0.75 (1/4)	CVC3	CVC3 default	unknown ❌	637.58700	637.51100
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	151.46900	151.49400
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	151.58200	151.56100
		veriT	veriT default	unknown ❌	1031.00000	1031.32000
		Z3	z3 4.4.0 default	unknown ❌	174.21500	174.28200
SMT-COMP 2016	0.67 (2/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	313.41100	305.74000
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	111.55900	112.04100
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	24.76270	98.20000
		veriT	veriT-dev default	unknown ❌	2400.04000	2401.47000
		Z3	z3-4.4.1 default	unknown ❌	194.86200	194.95900
SMT-COMP 2017	0.67 (2/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	456.42900	452.87600
		Vampire	vampire4.2-smt vampire	sat ✅	59.75990	237.40000
		veriT	veriT-2017-06-17 default	unknown ❌	600.02700	599.97200
		Z3	z3-4.5.0 default	unknown ❌	219.88400	219.79300
SMT-COMP 2018	0.83 (1/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	484.86600	482.72200
		Vampire	vampire-4.3-smt_vampire_smtcomp	unknown ❌	1200.07000	4774.54000
		veriT	veriT_default	unknown ❌	1200.02000	1199.89000
		Z3	z3-4.7.1_default	unknown ❌	302.55600	302.56200
SMT-COMP 2019	0.75 (2/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.05000	9532.33000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	970.83000	964.38500
			master-2018-06-10-b19c840-competition-default_default	sat ✅	486.20400	483.29300
		Par4	Par4-wrapped-sq_default	sat ✅	485.62500	1453.86000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.02000	2402.38000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.20189	3.35720
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.01223	3.34058
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.10578	3.05080
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unknown ❌	2400.12000	9559.87000
			vampire-4.3-smt_vampire_smtcomp	unknown ❌	2400.10000	9538.11000
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.03000	2399.75000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	316.51100	316.48400
SMT-COMP 2021	0.71 (2/7)	CVC4	CVC4-sq-final_default	sat ✅	485.06700	483.41500
		iProver	iProver-v3.5-final-fix2_iProver_SMT	unknown ❌	1192.42000	4715.59000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.08000	1255.19000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	2.79984	4.71205
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	sat ✅	78.86680	312.42000
			vampire_smt_4.5_vampire_smtcomp	sat ✅	76.96050	305.77000
		veriT	veriT_default	unknown ❌	1200.04000	1199.86000
		Z3	z3-4.8.11_default	unknown ❌	134.17400	134.13300
SMT-COMP 2023	0.67 (2/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	528.40700	514.21500
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	515.71200	512.74700
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.12000	4748.86000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.05000	1378.16000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.90118	9.60779
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	69.57090	275.99000
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.02000	1199.96000