Benchmark

non-incremental/UFLIA/boogie/AddMethod_Bag.SpecSharp.CheckInvariant_System.Boolean.smt2

Boogie/Spec# benchmarks.
  This benchmark was translated by Michal Moskal.

Benchmark
Size	45200
Compressed Size	7743
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	—
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	45192
Compressed Size	7758
Max. Term Depth	77
Asserts	246
Declared Functions	81
Declared Constants	113
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	70	false	3	not	85	or	16
and	93	=>	247	=	433	distinct	2
forall	138	let	33	Int	304	+	6
-	8	*	1	<	21	<=	48
>	3	>=	1

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2011		CVC3	CVC3 v2.4	unsat ✅	0.20000	—
		Z3	Z3	unsat ✅	—	—
SMT Evaluation 2013	0.25 (3/4)	CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.09614	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.09244	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.08990	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.10987	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.12469	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.04521	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.04994	—
SMT-COMP 2014	0.25 (3/4)	CVC3	CVC3 default	unknown ❌	0.01664	0.00800
		CVC4	CVC4 f7118b2 default	unsat ✅	0.13942	0.12798
		veriT	veriT-smtcomp2014 default	unsat ✅	0.05637	0.04799
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.04311	0.03799
SMT-COMP 2015	0.25 (3/4)	CVC3	CVC3 default	unknown ❌	0.00859	0.00800
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.14713	0.12398
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.12515	0.12198
		veriT	veriT default	unsat ✅	0.05488	0.05399
		Z3	z3 4.4.0 default	unsat ✅	0.06004	0.05999
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.13439	0.13461
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	2.82054	2.83368
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.26656	0.14309
		veriT	veriT-dev default	unsat ✅	0.03800	0.03858
		Z3	z3-4.4.1 default	unsat ✅	0.06080	0.06199
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.14015	0.13889
		Vampire	vampire4.2-smt vampire	unsat ✅	0.17832	0.17669
		veriT	veriT-2017-06-17 default	unsat ✅	0.04135	0.04127
		Z3	z3-4.5.0 default	unsat ✅	0.06680	0.06605
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.15140	0.15156
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	4.92882	19.37000
		veriT	veriT_default	unsat ✅	0.04501	0.04528
		Z3	z3-4.7.1_default	unsat ✅	0.07027	0.07022
SMT-COMP 2019	0.25 (6/8)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	0.31570	0.31637
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.17766	0.17417
			master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.15521	0.15548
		Par4	Par4-wrapped-sq_default	unsat ✅	0.05873	0.00609
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.04000	2471.64000
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.43272	3.46825
			UltimateEliminator+SMTInterpol-wrapped-sq_default	unknown ❌	2.24053	3.43864
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.23937	3.53222
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	1.87635	9.05495
		veriT	veriT-wrapped-sq_default	unsat ✅	0.04895	0.04930
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.07633	0.07629
SMT-COMP 2021	0.25 (6/8)	CVC4	CVC4-sq-final_default	unsat ✅	0.17683	0.17579
		cvc5	cvc5-fixed_default	unsat ✅	0.15069	0.15112
		Par4	Par4-wrapped-sq_default	unsat ✅	0.06205	0.00742
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	1200.03000	1250.09000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	3.10001	5.11046
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	0.84102	3.10000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.45823	0.37510
		veriT	veriT_default	unsat ✅	0.04734	0.04765
		Z3	z3-4.8.11_default	unsat ✅	0.09168	0.09164
			z3-4.8.8_default	unsat ✅	0.10457	0.10447