Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort14.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	414090
Compressed Size	26849
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	414082
Compressed Size	26858
Max. Term Depth	1423
Asserts	901
Declared Functions	0
Declared Constants	907
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	884	not	15	and	3111	=>	690
=	914	let	860	bvadd	858	bvsub	2601
bvult	2953	bvule	352	select	1366	store	352

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008		Boolector	Boolector	unsat ✅	—	—
		CVC3	CVC3-1.5	unsat ✅	4.50000	—
		Z3	Z3 0.1	unsat ✅	0.10000	—
			Z3.2	unsat ✅	0.10000	—
SMT-COMP 2010		Boolector	Boolector 1.2	unsat ✅	—	—
		CVC3	CVC3 2.3	unsat ✅	8.50000	—
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.03319	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.04326	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.04006	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	1.20726	—
			CVC3-SMT-COMP-2011 default	unsat ✅	1.05838	—
			CVC3-SMT-COMP-2012 default	unsat ✅	1.06635	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.19223	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.19322	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.11648	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.19904	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.16499	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.09822	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	0.10999	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.10772	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unsat ✅	0.06054	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.06530	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.07497	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	unsat ✅	0.08827	0.07799
			Boolector boolectorj	unsat ✅	0.09160	0.07999
		CVC4	CVC4 f7118b2 default	unsat ✅	0.26586	0.25496
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02477	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.03950	0.02999
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.10587	0.09699
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.10833	0.09698
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.03885	0.02999
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.06791	0.05999
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.05185	0.05099
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.27287	0.27096
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.27202	0.26896
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.08701	0.08599
		Yices2	Yices default	unsat ✅	0.03059	0.03000
		Z3	z3 4.4.0 default	unsat ✅	0.07990	0.07999
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.04938	0.04935
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.27101	0.27113
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.07733	0.07836
		Yices2	Yices-2.4.2 default	unsat ✅	0.03137	0.03135
		Z3	z3-4.4.1 default	unsat ✅	0.07727	0.07877
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.04415	0.04411
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.27449	0.27335
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.07697	0.07725
		Yices2	Yices2-Main default	unsat ✅	0.03004	0.02942
		Z3	z3-4.5.0 default	unsat ✅	0.08086	0.07998
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.04067	0.04062
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.30624	0.30429
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.07574	0.07668
		Yices2	Yices 2.6.0_default	unsat ✅	0.03094	0.03086
		Z3	z3-4.7.1_default	unsat ✅	0.08707	0.08698