Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.993850.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.

Benchmark
Size	1280
Compressed Size	521
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1272
Compressed Size	512
Max. Term Depth	6
Asserts	8
Declared Functions	9
Declared Constants	6
Declared Sorts	9
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not

2

=>

2

=

10

forall

2

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.01244	0.00400
		CVC4	CVC4 f7118b2 default	sat ✅	40.04220	40.03690
		veriT	veriT-smtcomp2014 default	unknown ❌	0.01098	0.00300
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.02245	0.01400
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	0.00792	0.00400
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	20.08500	20.02500
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	20.02140	20.02600
		veriT	veriT default	unknown ❌	0.00841	0.00200
		Z3	z3 4.4.0 default	sat ✅	0.03792	0.03799
SMT-COMP 2016	0.50 (3/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	300.19700	300.34200
		Vampire	vampire_smt_4.1 vampire_smtcomp	sat ✅	1.29862	1.30619
			vampire_smt_4.1_parallel vampire_smtcomp	sat ✅	0.04536	0.03985
		veriT	veriT-dev default	unknown ❌	0.05087	0.05626
		Z3	z3-4.4.1 default	sat ✅	0.03764	0.03892
SMT-COMP 2017	0.50 (3/6)	CVC4	CVC4-smtcomp2017-main default	sat ✅	450.25300	450.19800
		Vampire	vampire4.2-smt vampire	sat ✅	0.04375	0.04055
		veriT	veriT-2017-06-17 default	unknown ❌	0.07263	0.08320
		Z3	z3-4.5.0 default	sat ✅	0.04334	0.04273
SMT-COMP 2018	0.50 (3/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	480.31300	480.15000
		Vampire	vampire-4.3-smt_vampire_smtcomp	sat ✅	0.07523	0.06519
		veriT	veriT_default	unknown ❌	0.07626	0.08427
		Z3	z3-4.7.1_default	sat ✅	0.05099	0.05091
SMT-COMP 2019	0.50 (4/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	0.05000	0.13625
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.43100	960.27300
			master-2018-06-10-b19c840-competition-default_default	sat ✅	480.28100	480.19500
		Par4	Par4-wrapped-sq_default	sat ✅	0.06188	0.00590
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.05000	2407.36000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.16842	3.25403
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.12483	3.27778
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.32897	3.28270
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	sat ✅	0.07171	0.07157
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.13099	0.06580
		veriT	veriT-wrapped-sq_default	unknown ❌	0.09587	0.10740
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.05582	0.05583
SMT-COMP 2020	0.57 (3/7)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	0.04920	0.13199
		CVC4	CVC4-sq-final_default	sat ✅	480.32100	480.28400
			CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	960.37300	960.28900
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.10000	1209.48000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.23435	3.41011
		Vampire	vampire_smt_4.5_vampire_smtcomp	sat ✅	0.07441	0.04899
			vampire-4.3-smt_vampire_smtcomp	sat ✅	0.07439	0.07532
		veriT	veriT_default	unknown ❌	1200.03000	1199.86000
			veriT+vite_default	unknown ❌	1200.04000	1199.62000
		Z3	z3-4.8.8_default	sat ✅	0.04772	0.04764
SMT-COMP 2023	0.33 (4/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	510.43500	510.31500
			cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	510.36500	510.30000
		iProver	iProver-3.8-fix_iprover_SMT	sat ✅	0.65293	1.81000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.03000	1210.19000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.71471	4.67773
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	sat ✅	0.08182	0.05701
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.01034	0.00385