Benchmark

non-incremental/QF_IDL/planning/plan-10.cvc.smt2

Planning problem.
Rick Butler (R.W.Butler@larc.nasa.gov)

Translated into CVC format by Leonardo de Moura.

This benchmark was automatically translated into SMT-LIB format from
CVC format using CVC Lite

Benchmark
Size	49629
Compressed Size	9443
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2006-08-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	49621
Compressed Size	9467
Max. Term Depth	210
Asserts	1
Declared Functions	0
Declared Constants	277
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	9	not	313	or	164	and	1941
=	390	let	83	-	221	<	95
<=	73

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007		Barcelogic	Barcelogic 1.2	unsat ✅	0.10000	—
		MathSAT	MathSAT 4.0	unsat ✅	0.10000	—
		Sateen	Sateen	unsat ✅	—	—
		Yices	Yices 1.0	unsat ✅	—	—
			Yices 1.0.10	unsat ✅	—	—
		Z3	Z3 0.1	unsat ✅	—	—
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.41806	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.37588	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.37580	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.11810	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.09854	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unsat ✅	0.13529	—
			OpenSMT-SMT-COMP-2011 default	unsat ✅	0.10850	—
		veriT	veriT-SMT-COMP-2010 default	unsat ✅	0.08510	—
			veriT-SMT-COMP-2011 default	unsat ✅	0.09064	—
			veriT-SMT-EVAL-2013 default	unsat ✅	0.03908	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.03839	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.04104	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	unsat ✅	0.11161	0.10098
		veriT	veriT-smtcomp2014 default	unsat ✅	0.05329	0.04399
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.01867	0.01100
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.04767	0.03999
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.11023	0.10798
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.11139	0.10798
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	1.39726	2.87156
		veriT	veriT default	unsat ✅	0.03535	0.03399
		Yices2	Yices default	unsat ✅	0.01105	0.01000
		Z3	z3 4.4.0 default	unsat ✅	0.06034	0.05999
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.11341	0.11362
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	0.76922	2.06644
		veriT	veriT-dev default	unsat ✅	0.02380	0.02454
		Yices2	Yices-2.4.2 default	unsat ✅	0.01255	0.01174
		Z3	z3-4.4.1 default	unsat ✅	0.06302	0.06422
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.11676	0.11603
		SMTInterpol	SMTInterpol default	unsat ✅	0.89789	2.42856
		veriT	veriT-2017-06-17 default	unsat ✅	0.02455	0.02445
		Yices2	Yices2-Main default	unsat ✅	0.01322	0.01261
		Z3	z3-4.5.0 default	unsat ✅	0.06482	0.06421
SMT-COMP 2018		CVC4	CVC4-experimental-idl-2_default	unsat ✅	0.11766	0.11778
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.12300	0.12317
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.05921	0.06017
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unsat ✅	0.92798	2.61172
		SMT-RAT	SMTRAT-Rat-final_default	unsat ✅	0.64342	0.64330
		veriT	veriT_default	unsat ✅	0.02565	0.02582
		Yices2	Yices 2.6.0_default	unsat ✅	0.01536	0.01530
		Z3	z3-4.7.1_default	unsat ✅	0.06374	0.06368
SMT-COMP 2020		CVC4	CVC4-sq-final_default	unsat ✅	0.15374	0.15406
		MathSAT	MathSAT5_default.sh	unsat ✅	0.05010	0.05003
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02217	0.00618
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unsat ✅	0.74346	1.99675
		veriT	veriT_default	unsat ✅	0.03129	0.03152
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.01173	0.01160
		Z3	z3-4.8.8_default	unknown ❌	0.13367	0.13359
			z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.06600	0.06597
SMT-COMP 2021		cvc5	cvc5-fixed_default	unsat ✅	0.14348	0.14386
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.05397	0.05395
		OpenSMT	OpenSMT-fixed_default	unsat ✅	0.05426	0.05421
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02306	0.00643
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unsat ✅	1.14337	3.29733
		veriT	veriT_default	unsat ✅	0.02787	0.02814
		YicesLS	YicesLS_0611_1448_default	unsat ✅	0.01826	0.01819
		Z3	z3-4.8.11_default	unsat ✅	0.11497	0.11493
SMT-COMP 2023		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.10750	0.10802
		OpenSMT	OpenSMT a78dcf01_default	unsat ✅	0.04315	0.04308
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02438	0.00630
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unsat ✅	1.26786	3.62788
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.01237	0.01233
		Z3++	Z3++_sq_0526_default	unsat ✅	0.07117	0.07109
SMT-COMP 2024		cvc5	cvc5	unsat ✅	0.27181	0.17183
		OpenSMT	OpenSMT	unsat ✅	0.23920	0.13980
		SMTInterpol	SMTInterpol	unsat ✅	1.61075	4.59696
		Yices2	Yices2	unsat ✅	0.25979	0.16000
		Z3alpha	Z3-alpha	unsat ✅	0.29664	0.19710
SMT-COMP 2025		cvc5	cvc5	unsat ✅	0.30693	0.19073
		OpenSMT	OpenSMT	unsat ✅	0.30928	0.18213
		SMTInterpol	SMTInterpol	unsat ✅	1.36353	3.68949
		Yices2	Yices2	unsat ✅	0.25033	0.13210
		Z3alpha	Z3-alpha	unsat ✅	0.42474	0.39078
		Z3	Z3-alpha-base	unsat ✅	0.34285	0.20917