Benchmark

non-incremental/QF_AUFLIA/check/array_incompleteness1.smt2

This is based on an example in Section 6.2 of "A Decision
Procedure for an Extensional Theory of Arrays" by Stump, Barrett, Dill, and
Levitt.

Benchmark
Size	768
Compressed Size	410
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	check
First Occurrence	2005-07-12
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	760
Compressed Size	405
Max. Term Depth	4
Asserts	1
Declared Functions	2
Declared Constants	6
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not

2

and

1

=

4

store

2

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2005	0.17 (5/6)	CVC	CVC	unsat ✅	—	—
		CVC Lite	CVC Lite	unsat ✅	—	—
		HTP	HTP	unknown ❌	—	—
		Sammy	Sammy	unsat ✅	0.10000	—
		SVC	SVC	unsat ✅	—	—
		Yices	Yices	unsat ✅	—	—
SMT-COMP 2006		Barcelogic	Barcelogic 1.1	unsat ✅	—	—
		CVC	CVC	unsat ✅	—	—
		CVC3	CVC3	unsat ✅	—	—
		Yices	Yices 1.0	unsat ✅	—	—
			Yices 0.1 (2005 winner)	unsat ✅	—	—
SMT-COMP 2007		CVC3	CVC3 1.2	unsat ✅	—	—
		Yices	Yices 1.0	unsat ✅	—	—
			Yices 1.0.10	unsat ✅	—	—
		Z3	Z3 0.1	unsat ✅	—	—
SMT-COMP 2008		Barcelogic	Barcelogic 1.3	unsat ✅	—	—
		CVC3	CVC3-1.5	unsat ✅	—	—
		Yices	Yices 1.0.10	unsat ✅	—	—
		Z3	Z3.2	unsat ✅	—	—
SMT-COMP 2009		CVC3	CVC3 2.0	unsat ✅	—	—
		MathSAT	MathSAT 4.3	sat ✅	—	—
			MathSAT 4.3 (revised)	unsat ✅	—	—
		Yices2	Yices 2 proto	unsat ✅	—	—
		Z3	Z3.2	unsat ✅	—	—
SMT-COMP 2010		CVC3	CVC3 2.3	unsat ✅	—	—
		Yices2	Yices 2 proto	unsat ✅	—	—
		Z3	Z3.2	unsat ✅	—	—
SMT-COMP 2011		CVC3	CVC3 v2.4	unsat ✅	—	—
		MathSAT	MathSAT5	unsat ✅	—	—
		Z3	Z3	unsat ✅	—	—
SMT Evaluation 2013	0.20 (4/5)	CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.00936	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.00929	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.00933	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.00991	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.01489	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.01842	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.01695	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.01151	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	0.00935	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.01170	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.01564	—
SMT-COMP 2015	0.17 (5/6)	CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.01035	0.00800
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.01059	0.00800
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.02232	0.02100
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	0.26208	0.33595
		veriT	veriT default	unknown ❌	0.00817	0.00200
		Yices2	Yices default	unsat ✅	0.00840	0.00200
		Z3	z3 4.4.0 default	unsat ✅	0.02967	0.02999
SMT-COMP 2016	0.17 (5/6)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.01337	0.01179
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.01773	0.01860
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	0.24781	0.32220
		veriT	veriT-dev default	unknown ❌	0.01282	0.00724
		Yices2	Yices-2.4.2 default	unsat ✅	0.01145	0.00285
		Z3	z3-4.4.1 default	unsat ✅	0.02799	0.02910
SMT-COMP 2017	0.17 (5/6)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.01137	0.01094
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.01666	0.01679
		SMTInterpol	SMTInterpol default	unsat ✅	0.24706	0.33046
		veriT	veriT-2017-06-17 default	unknown ❌	0.01189	0.00690
		Yices2	Yices2-Main default	unsat ✅	0.01125	0.00341
		Z3	z3-4.5.0 default	unsat ✅	0.03274	0.03038
SMT-COMP 2018	0.33 (4/6)	CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.01167	0.01179
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.01585	0.01674
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unsat ✅	0.26727	0.33303
		veriT	veriT_default	unknown ❌	0.00759	0.00738
		Yices2	Yices 2.6.0_default	unsat ✅	0.01240	0.00732
		Z3	z3-4.7.1_default	unsat ✅	0.03418	0.03408
SMT-COMP 2019	0.33 (4/6)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	0.04041	0.08798
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.01681	0.01708
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unsat ✅	0.26915	0.35719
		veriT	veriT-wrapped-sq_default	unknown ❌	0.01108	0.01138
		Yices2	Yices 2.6.0_default	unsat ✅	0.00937	0.00667
			Yices 2.6.2-wrapped-sq_default	unsat ✅	0.01009	0.00591
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.03569	0.03567
SMT-COMP 2023		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.01942	0.01999
		OpenSMT	OpenSMT a78dcf01_default	unsat ✅	0.01389	0.00734
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unsat ✅	0.41622	0.58072
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.01019	0.00398
		Z3	z3-4.8.17_default	unsat ✅	0.01644	0.01827
SMT-COMP 2024		cvc5	cvc5	unsat ✅	0.22399	0.12454
		OpenSMT	OpenSMT	unsat ✅	0.21163	0.11208
		SMTInterpol	SMTInterpol	unsat ✅	0.42134	0.43016
		Yices2	Yices2	unsat ✅	0.23111	0.13103