Benchmark

non-incremental/QF_ABV/platania/bellford/bf9.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bellmann Ford algorithm on a graph
of 5 nodes and N (the increasing parameter) arcs.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	306220
Compressed Size	16325
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	306212
Compressed Size	16336
Max. Term Depth	952
Asserts	558
Declared Functions	0
Declared Constants	571
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	523	not	374	and	2477	=>	563
=	584	let	281	bvadd	621	bvult	2173
bvule	306	select	1701	store	126

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008		Boolector	Boolector	unsat ✅	—	—
		CVC3	CVC3-1.5	unsat ✅	2.00000	—
		Z3	Z3 0.1	unsat ✅	0.10000	—
			Z3.2	unsat ✅	0.10000	—
SMT-COMP 2011		Boolector	Boolector 1.5.23-833	unsat ✅	—	—
		CVC3	CVC3 v2.4	unsat ✅	0.60000	—
		MathSAT	MathSAT5	unsat ✅	283.30000	—
		SONOLAR	SONOLAR	unsat ✅	—	—
		Z3	Z3	unsat ✅	706.10000	—
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.01737	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.02160	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.02377	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.49486	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.44528	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.44254	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.09941	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.11007	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.07273	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.11809	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.08559	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.05760	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	0.03656	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.06035	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unsat ✅	0.03693	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.04372	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.05018	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	unsat ✅	0.04099	0.03000
			Boolector boolectorj	unsat ✅	0.04115	0.02999
		CVC4	CVC4 f7118b2 default	unsat ✅	0.15816	0.14798
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02479	0.01600
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.03945	0.03100
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.06113	0.05199
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.05455	0.05099
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.02668	0.01800
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.03666	0.03499
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.02345	0.02300
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.15845	0.15698
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.16095	0.15798
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.05101	0.04999
		Yices2	Yices default	unsat ✅	0.01901	0.01800
		Z3	z3 4.4.0 default	unsat ✅	0.05813	0.05799
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.02452	0.02470
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.15880	0.15897
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.04504	0.04577
		Yices2	Yices-2.4.2 default	unsat ✅	0.02052	0.02049
		Z3	z3-4.4.1 default	unsat ✅	0.05580	0.05701
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.02423	0.02352
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.15785	0.15738
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.04475	0.04447
		Yices2	Yices2-Main default	unsat ✅	0.01949	0.01852
		Z3	z3-4.5.0 default	unsat ✅	0.06181	0.05995
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.02216	0.02213
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.16788	0.16811
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.04257	0.04347
		Yices2	Yices 2.6.0_default	unsat ✅	0.02077	0.02073
		Z3	z3-4.7.1_default	unsat ✅	0.06535	0.06525