Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe2.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	4951
Compressed Size	1119
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	4943
Compressed Size	1123
Max. Term Depth	17
Asserts	11
Declared Functions	0
Declared Constants	17
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	8	not	3	and	24	=>	6
=	10	let	8	bvadd	6	bvsub	21
bvult	25	bvule	5	select	10	store	2

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.00973	—
			Boolector-SMT-COMP-2011 default	sat ✅	0.01030	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.00991	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	0.02795	—
			CVC3-SMT-COMP-2011 default	sat ✅	0.02479	—
			CVC3-SMT-COMP-2012 default	sat ✅	0.02526	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.01406	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.01067	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.02007	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.01955	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.01389	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.01026	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.00978	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.00981	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	0.02213	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.00991	—
			Z3-SMT-COMP-2011 default	sat ✅	0.01852	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	sat ✅	0.01565	0.00500
			Boolector boolectorj	sat ✅	0.01490	0.00400
		CVC4	CVC4 f7118b2 default	sat ✅	0.01879	0.00800
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.01689	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.03539	0.03399
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.02521	0.01600
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.01420	0.00300
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.01099	0.00200
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.01641	0.00900
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.03361	0.03299
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.01195	0.01000
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.01249	0.01000
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.02636	0.02499
		Yices2	Yices default	sat ✅	0.00826	0.00200
		Z3	z3 4.4.0 default	sat ✅	0.03218	0.03199
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.04335	0.04350
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.01409	0.01425
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.02129	0.02233
		Yices2	Yices-2.4.2 default	sat ✅	0.01287	0.00466
		Z3	z3-4.4.1 default	sat ✅	0.03077	0.03198
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.04354	0.04360
		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.01571	0.01454
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.02073	0.02162
		Yices2	Yices2-Main default	sat ✅	0.00772	0.00370
		Z3	z3-4.5.0 default	sat ✅	0.03447	0.03310
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.04328	0.04318
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.01391	0.01410
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.01933	0.02031
		Yices2	Yices 2.6.0_default	sat ✅	0.00826	0.00653
		Z3	z3-4.7.1_default	sat ✅	0.03619	0.03611
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.01154	0.00659
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.00968	0.00896
		CVC4	CVC4-sq-final_default	sat ✅	0.02115	0.01986
		MathSAT	MathSAT5_default.sh	sat ✅	0.02255	0.02250
		Par4	Par4-wrapped-sq_default	sat ✅	0.02219	0.00588
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.01039	0.00461
		Z3	z3-4.8.8_default	sat ✅	0.03589	0.03581