Benchmark

non-incremental/UFNIA/vcc-havoc/baby.2.16.handle_illegal.smt2

VCC and HAVOC benchmarks.  Contributed by Nikolaj Bjorner, Leonardo de Moura,
    Michal Moskal, and Shaz Qadeer.

Benchmark
Size	174963
Compressed Size	17928
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	174955
Compressed Size	17969
Max. Term Depth	182
Asserts	3
Declared Functions	249
Declared Constants	140
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	42	false	2	ite	18	not	3034
or	586	=>	750	=	877	distinct	2
forall	924	exists	2	let	129	Int	1566
+	48	-	217	*	83	<	610
<=	826	>	4	>=	13	repeat	1

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.50 (1/2)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	0.33245	—
			CVC3-SMT-COMP-2011 default	unknown ❌	0.43984	—
			CVC3-SMT-COMP-2012 default	unknown ❌	0.16774	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.32584	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.29631	—
SMT-COMP 2015	0.33 (2/3)	CVC3	CVC3 default	unknown ❌	0.15672	0.15598
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	2.89993	2.89856
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	2.83146	2.82957
		Z3	z3 4.4.0 default	unsat ✅	0.34830	0.34795
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	6.90513	6.90878
		Vampire	vampire_smt_4.1 vampire_smtcomp	unsat ✅	0.24475	0.24582
			vampire_smt_4.1_parallel vampire_smtcomp	unsat ✅	0.14677	0.14614
		Z3	z3-4.4.1 default	unsat ✅	0.39180	0.39373
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	2.40624	2.40551
		Vampire	vampire4.2-smt vampire	unsat ✅	0.22324	0.22391
		Z3	z3-4.5.0 default	unsat ✅	0.42934	0.42731
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	5.27433	5.27424
		Vampire	vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.24860	0.31694
		Z3	z3-4.7.1_default	unsat ✅	0.30175	0.30153
SMT-COMP 2019	0.17 (5/6)	Alt-Ergo	Alt-Ergo-SMTComp-2019-wrapped-sq_default	unsat ✅	68.90350	182.36000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	3.40129	3.40121
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	unsat ✅	4.05497	4.05014
		Par4	Par4-wrapped-sq_default	unsat ✅	0.31820	0.00584
		UltimateEliminator	UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default	unknown ❌	2.48622	4.32660
			UltimateEliminator+Yices-2.6.1-wrapped-sq_default	unknown ❌	2.54278	4.34915
		Vampire	vampire-4.4-smtcomp-wrapped-sq_default	unsat ✅	1.26865	4.38000
			vampire-4.3-smt_vampire_smtcomp	unsat ✅	0.27528	0.30588
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.30531	0.30528
			z3-4.7.1_default	unsat ✅	0.31003	0.31000
SMT-COMP 2021	0.43 (4/7)	CVC4	CVC4-sq-final_default	unsat ✅	6.32349	6.32280
		cvc5	cvc5-fixed_default	unknown ❌	1200.04000	30.01110
		Par4	Par4-wrapped-sq_default	unsat ✅	0.31689	0.00617
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	unknown ❌	0.75997	1.84600
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.6_default	unknown ❌	8.07753	17.93990
		Vampire	vampire_smt_4.6-fixed_vampire_smtcomp	unsat ✅	0.62272	2.04000
			vampire_smt_4.5_vampire_smtcomp	unsat ✅	0.27706	0.27913
		Z3	z3-4.8.11_default	unsat ✅	0.31462	0.31457
SMT-COMP 2022	0.20 (4/5)	CVC4	CVC4-sq-final_default	unsat ✅	4.38150	8.67141
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	39.56770	39.39460
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.7-wrapped_default	unknown ❌	195.89400	223.52900
		Vampire	vampire_4.7_smt_fix-wrapped_vampire_smtcomp	unsat ✅	0.40614	0.28421
		Z3	z3-4.8.17_default	unsat ✅	0.32093	0.32277
SMT-COMP 2023	0.25 (3/4)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	83.55070	77.89980
			cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	80.75240	80.15950
		iProver	iProver-3.8-fix_iprover_SMT	unsat ✅	2.16022	6.96000
		UltimateEliminator	UltimateEliminator+MathSAT-5.6.9_default	unknown ❌	285.31000	315.79900
		Vampire	vampire_4.8_smt_pre_vampire_smtcomp	unsat ✅	0.32745	0.32345
SMT-COMP 2024	0.33 (2/3)	cvc5	cvc5	unsat ✅	35.40937	35.30073
		iProver	iProver v3.9	unsat ✅	4.37765	15.89644
		SMTInterpol	SMTInterpol	unknown ❌	1202.21019	1492.95840