Benchmark

non-incremental/AUFLIRA/nasa/fol_simplify/cl5_nebula_init_0035.fof.smt2

NASA benchmarks from "Using Automated Theorem Provers to Certify Auto-generated
Aerospace Software", IJCAR 2004.  Translated from TPTP format by Yeting Ge and
Clark Barrett

Benchmark
Size	7585
Compressed Size	1750
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2006-08-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	7577
Compressed Size	1760
Max. Term Depth	18
Asserts	14
Declared Functions	21
Declared Constants	14
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	2	and	64	=>	24	=	31
forall	21	let	8	Int	81	Real	19
-	1	<=	36	>	1	>=	32
Array	32	select	86

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007		CVC3	CVC3 1.2	unsat ✅	—	—
			CVC3 (2006)	unsat ✅	—	—
		Yices	Yices 1.0	unsat ✅	—	—
			Yices 1.0.10	unsat ✅	—	—
		Z3	Z3 0.1	unsat ✅	—	—
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.01576	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.01860	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.02291	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.02758	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.01958	—
		veriT	veriT-SMT-EVAL-2013 default	unsat ✅	0.00969	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.02000	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.02605	—
SMT-COMP 2014		CVC3	CVC3 default	unsat ✅	0.02468	0.01600
		CVC4	CVC4 f7118b2 default	unsat ✅	0.02003	0.01700
		veriT	veriT-smtcomp2014 default	unsat ✅	0.01684	0.00800
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.02343	0.01500
SMT-COMP 2015		CVC3	CVC3 default	unsat ✅	0.01141	0.01100
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.01997	0.01800
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.02054	0.01800
		veriT	veriT default	unsat ✅	0.00814	0.00700
		Z3	z3 4.4.0 default	unsat ✅	0.03820	0.03699
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.02500	0.02561
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	0.07227	0.07271
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.06254	0.05405
		veriT	veriT-dev default	unsat ✅	0.01365	0.00992
		Z3	z3-4.4.1 default	unsat ✅	0.03686	0.03810
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.02803	0.02740
		Vampire	vampire4.2-smt vampire	unsat ✅	0.04327	0.04193
		veriT	veriT-2017-06-17 default	unsat ✅	2.50201	2.50149
		Z3	z3-4.5.0 default	unsat ✅	0.04901	0.03930
SMT-COMP 2018		Alt-Ergo	Alt-Ergo-SMTComp-2018_default	unsat ✅	0.05107	0.07166
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.02928	0.02950
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.05772	0.08393
		veriT	veriT_default	unsat ✅	2.31049	2.31065
		Z3	z3-4.7.1_default	unsat ✅	0.04178	0.04173
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.03667	0.03801
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.03398	0.03426
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	unsat ✅	0.03553	0.03586
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02140	0.00562
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2446.18000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.32748	3.45932
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.05396	3.37628
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.59019	3.37897
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	0.12433	0.17236
		veriT	veriT-wrapped-sq_default	unsat ✅	2.28733	2.28751
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.04395	0.04395
			z3-4.7.1_default	unsat ✅	0.04259	0.04255
SMT-COMP 2020	0.12 (7/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	0.03319	0.03161
		CVC4	CVC4-sq-final_default	unsat ✅	0.03699	0.03725
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02207	0.00632
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unsat ✅	0.46057	0.77221
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.31382	3.49576
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.09864	0.13416
		veriT	veriT_default	unsat ✅	0.01977	0.01589
			veriT+vite_default	unsat ✅	0.01960	0.01460
		Z3	z3-4.8.8_default	unsat ✅	0.04028	0.04020
SMT-COMP 2022	0.14 (6/7)	CVC4	CVC4-sq-final_default	unsat ✅	0.06291	0.06259
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.05381	0.05328
		SMTInterpol	smtinterpol-fixed-2.5-1148-gf2d8e6b0_default	unsat ✅	0.55334	1.02139
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	2.93596	4.74900
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	0.10195	0.13974
		veriT	veriT_default	unsat ✅	0.01476	0.01512
		Z3	z3-4.8.17_default	unsat ✅	0.02556	0.02729
SMT-COMP 2023	0.20 (4/5)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.03327	0.03363
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.05196	0.05251
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	0.65019	0.55567
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unsat ✅	9.29415	1.24007
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	2.88497	4.86013
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	0.10930	0.10893