Benchmark

non-incremental/AUFLIRA/peter/symmetric_unsat_45.smt2

Example extracted from Peter Baumgartner's talk at CADE-21: Logical Engineering with Instance-Based Methods.

It was translated to SMT-LIB by Leonardo de Moura

Benchmark
Size	6784
Compressed Size	1171
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2008-07-07
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	6776
Compressed Size	1137
Max. Term Depth	7
Asserts	47
Declared Functions	1
Declared Constants	91
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	1	and	1	=>	1	=	46
forall	2	Int	5	Real	1	<=	4
Array	2	select	48	store	88

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008		Alt-Ergo	Alt-Ergo	sat ✅	0.90000	—
			Alt-Ergo (revised)	unknown ❌	0.90000	—
		CVC3	CVC3 1.2	unsat ✅	41.40000	—
			CVC3-1.5	unsat ✅	27.70000	—
		Z3	Z3.2	unsat ✅	0.90000	—
SMT Evaluation 2013	0.25 (3/4)	CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	36.11980	—
			CVC3-SMT-COMP-2011 default	unsat ✅	122.24700	—
			CVC3-SMT-COMP-2012 default	unsat ✅	98.72360	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	29.95630	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.20905	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.19943	—
SMT-COMP 2014	0.25 (3/4)	CVC3	CVC3 default	unsat ✅	120.45900	120.44100
		CVC4	CVC4 f7118b2 default	unsat ✅	77.95530	77.96110
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.01000	2400.08000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.22502	0.21397
SMT-COMP 2015	0.25 (3/4)	CVC3	CVC3 default	unsat ✅	150.88900	150.95200
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	139.54900	139.55300
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	140.35200	140.34600
		veriT	veriT default	unknown ❌	2400.01000	2401.00000
		Z3	z3 4.4.0 default	unsat ✅	0.22774	0.22797
SMT-COMP 2016	0.25 (3/4)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	77.88370	76.92970
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	17.51070	35.07530
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	5.11061	20.27000
		veriT	veriT-dev default	unknown ❌	2400.01000	2401.64000
		Z3	z3-4.4.1 default	unsat ✅	0.22070	0.22190
SMT-COMP 2017	0.25 (3/4)	CVC4	CVC4-smtcomp2017-main default	unsat ✅	76.00550	75.72280
		Vampire	vampire4.2-smt vampire	unsat ✅	4.28035	16.79000
		veriT	veriT-2017-06-17 default	unknown ❌	600.02500	600.05000
		Z3	z3-4.5.0 default	unsat ✅	0.24778	0.24687
SMT-COMP 2018	0.20 (4/5)	Alt-Ergo	Alt-Ergo-SMTComp-2018_default	unsat ✅	343.67000	1142.31000
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	82.85270	82.52980
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	6.50812	25.45000
		veriT	veriT_default	unknown ❌	1200.02000	1199.98000
		Z3	z3-4.7.1_default	unsat ✅	0.22849	0.22845
SMT-COMP 2019	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	415.26600	1649.77000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	122.02300	121.80900
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	unsat ✅	121.97300	121.87700
		Par4	Par4-wrapped-sq_default	unsat ✅	0.20310	0.00567
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2637.50000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.45683	3.71371
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.46604	3.48852
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.19399	3.38976
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	24.69330	97.71940
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.04000	2399.92000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.22172	0.22172
			z3-4.7.1_default	unsat ✅	0.22536	0.22530
SMT-COMP 2020	0.38 (5/8)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	286.13700	1136.56000
		CVC4	CVC4-sq-final_default	unsat ✅	61.84080	61.80250
		Par4	Par4-wrapped-sq_default	unsat ✅	0.20732	0.00639
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unknown ❌	1200.08000	1426.59000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.3_s_default	unknown ❌	2.62173	4.23243
		Vampire	vampire_smt_4.5_vampire_smtcomp	unsat ✅	366.63300	1375.76000
		veriT	veriT_default	unknown ❌	1200.02000	1199.58000
			veriT+vite_default	unknown ❌	532.41900	532.07000
		Z3	z3-4.8.8_default	unsat ✅	0.28373	0.28368
SMT-COMP 2022	0.43 (4/7)	CVC4	CVC4-sq-final_default	unsat ✅	62.08100	61.84520
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	96.41190	95.69300
		SMTInterpol	smtinterpol-fixed-2.5-1148-gf2d8e6b0_default	unknown ❌	1200.04000	1246.54000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	3.33820	5.79350
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	426.13100	1692.85000
		veriT	veriT_default	unknown ❌	88.99840	88.87000
		Z3	z3-4.8.17_default	unsat ✅	0.31048	0.31233
SMT-COMP 2023	0.60 (2/5)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	97.09340	96.94330
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	94.16420	94.07830
		iProver	iProver-3.8-fix_iprover_SMT	unknown ❌	1200.06000	4742.87000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.09000	1245.35000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	3.63940	6.26622
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	289.12200	1148.84000
SMT-COMP 2024	0.67 (1/3)	cvc5	cvc5	unsat ✅	94.95033	94.80606
		iProver	iProver v3.9	unknown ❌	1201.72687	4747.28165
		SMTInterpol	SMTInterpol	unknown ❌	1201.74283	1275.99373