Benchmark

non-incremental/AUFLIRA/peter/symmetric_unsat_99.smt2

Example extracted from Peter Baumgartner's talk at CADE-21: Logical Engineering with Instance-Based Methods.

It was translated to SMT-LIB by Leonardo de Moura

Benchmark
Size	14290
Compressed Size	1895
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2008-07-07
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	14282
Compressed Size	1827
Max. Term Depth	7
Asserts	101
Declared Functions	1
Declared Constants	199
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	1	and	1	=>	1	=	100
forall	2	Int	5	Real	1	<=	4
Array	2	select	102	store	196

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008		Alt-Ergo	Alt-Ergo	sat ✅	4.80000	—
			Alt-Ergo (revised)	unknown ❌	4.80000	—
		CVC3	CVC3 1.2	unsat ✅	562.40000	—
			CVC3-1.5	unsat ✅	392.40000	—
		Z3	Z3.2	unsat ✅	8.60000	—
SMT-COMP 2011	0.50 (1/2)	CVC3	CVC3 v2.4	unknown ❌	1200.10000	—
		Z3	Z3	unsat ✅	2.40000	—
SMT Evaluation 2013	0.25 (3/4)	CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	430.70500	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	725.55200	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	1.83805	—
			Z3-SMT-COMP-2011 default	unsat ✅	1.49922	—
SMT-COMP 2014	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	2400.01000	2401.01000
		CVC4	CVC4 f7118b2 default	unsat ✅	850.72500	850.82900
		veriT	veriT-smtcomp2014 default	unknown ❌	2398.81000	2400.04000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	1.88164	1.87371
SMT-COMP 2015	0.50 (2/4)	CVC3	CVC3 default	unknown ❌	2401.21000	2402.16000
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	2127.28000	2127.75000
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	2189.52000	2190.17000
		veriT	veriT default	unknown ❌	2400.01000	2401.02000
		Z3	z3 4.4.0 default	unsat ✅	1.58265	1.58376
SMT-COMP 2016	0.25 (3/4)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	791.33900	784.95700
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	91.80600	92.35710
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	75.79770	97.19770
		veriT	veriT-dev default	unknown ❌	2400.01000	2401.40000
		Z3	z3-4.4.1 default	unsat ✅	1.66351	1.66591
SMT-COMP 2017	0.50 (2/4)	CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.02700	560.33000
		Vampire	vampire4.2-smt vampire	unsat ✅	73.93790	132.59800
		veriT	veriT-2017-06-17 default	unknown ❌	600.03500	600.03400
		Z3	z3-4.5.0 default	unsat ✅	1.75187	1.74916
SMT-COMP 2018	0.60 (2/5)	Alt-Ergo	Alt-Ergo-SMTComp-2018_default	unknown ❌	1200.09000	2198.24000
		CVC4	master-2018-06-10-b19c840-competition-default_default	unknown ❌	1200.11000	1195.60000
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	229.21500	911.71000
		veriT	veriT_default	unknown ❌	1200.05000	1199.99000
		Z3	z3-4.7.1_default	unsat ✅	1.57216	1.57203
SMT-COMP 2019	0.50 (4/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unknown ❌	2400.06000	7801.61000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	135.03900	132.75300
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	unsat ✅	136.89800	134.12300
		Par4	Par4-wrapped-sq_default	unsat ✅	1.47150	2.90000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	3472.97000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.42848	4.10310
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.44015	4.04100
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.09573	3.47752
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	500.96400	2028.16000
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.05000	2400.10000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	1.46249	1.46253
			z3-4.7.1_default	unsat ✅	1.50208	1.49800
SMT-COMP 2020	0.62 (3/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unknown ❌	1200.12000	3350.70000
		CVC4	CVC4-sq-final_default	unsat ✅	74.77690	73.80050
		Par4	Par4-wrapped-sq_default	unsat ✅	1.57201	3.02000
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	378.48700	1099.86000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.55154	4.31093
		Vampire	vampire_smt_4.5_vampire_smtcomp	unknown ❌	1200.09000	4670.02000
		veriT	veriT_default	unknown ❌	1200.02000	1199.77000
			veriT+vite_default	unknown ❌	539.32500	539.25000
		Z3	z3-4.8.8_default	unsat ✅	1.83896	1.83879
SMT-COMP 2021	0.50 (4/8)	CVC4	CVC4-sq-final_default	unsat ✅	75.15380	73.98360
		cvc5	cvc5-fixed_default	unknown ❌	1200.02000	120.52800
		Par4	Par4-wrapped-sq_default	unsat ✅	1.50591	2.92000
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.09000	1970.11000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	5.56656	8.65270
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	858.44100	3349.49000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	773.07000	2988.63000
		veriT	veriT_default	unknown ❌	90.71020	90.44000
		Z3	z3-4.8.11_default	unsat ✅	26.57950	26.57520
			z3-4.8.8_default	unsat ✅	1.81235	1.81219