Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort18.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	707554
Compressed Size	45239
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	707546
Compressed Size	45249
Max. Term Depth	2403
Asserts	1517
Declared Functions	0
Declared Constants	1523
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	1496	not	19	and	5291	=>	1174
=	1534	let	1464	bvadd	1462	bvsub	4421
bvult	5017	bvule	596	select	2330	store	596

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007	0.50 (1/2)	Yices	Yices 1.0.10	unknown ❌	1800.80000	—
		Z3	Z3 0.1	unsat ✅	0.20000	—
			Z3 0.1 (fixed BV)	unsat ✅	0.20000	—
SMT-COMP 2008		Boolector	Boolector	unsat ✅	0.10000	—
		CVC3	CVC3-1.5	unsat ✅	9.20000	—
		Z3	Z3 0.1	unsat ✅	0.20000	—
			Z3.2	unsat ✅	0.20000	—
SMT Evaluation 2013	0.57 (3/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.05356	—
			Boolector-SMT-COMP-2011 default	unsat ✅	—	—
			Boolector-SMT-COMP-2012 default	unknown ❌	—	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.32667	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.10954	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	unsat ✅	0.16424	0.15198
			Boolector boolectorj	unsat ✅	0.16374	0.15098
		CVC4	CVC4 f7118b2 default	unsat ✅	0.47358	0.45893
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.03064	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.04335	0.03099
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.18849	0.17597
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.18673	0.16897
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.06227	0.04799
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.11081	0.09998
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.08728	0.08599
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.48551	0.48293
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.48056	0.47793
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.15220	0.15098
		Yices2	Yices default	unsat ✅	0.04878	0.04799
		Z3	z3 4.4.0 default	unsat ✅	0.11789	0.11798
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.08330	0.08306
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.47896	0.47943
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.13810	0.13910
		Yices2	Yices-2.4.2 default	unsat ✅	0.04951	0.04950
		Z3	z3-4.4.1 default	unsat ✅	0.11239	0.11341
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.07219	0.07216
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.48918	0.48856
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.13878	0.13968
		Yices2	Yices2-Main default	unsat ✅	0.04801	0.04717
		Z3	z3-4.5.0 default	unsat ✅	0.11797	0.11714
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.06654	0.06644
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.53577	0.53594
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.13595	0.13698
		Yices2	Yices 2.6.0_default	unsat ✅	0.04911	0.04901
		Z3	z3-4.7.1_default	unsat ✅	0.12576	0.12565
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.09941	0.09930
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.10295	0.10297
		CVC4	CVC4-sq-final_default	unsat ✅	0.77665	0.77700
		MathSAT	MathSAT5_default.sh	unsat ✅	0.15091	0.15082
		Par4	Par4-wrapped-sq_default	unsat ✅	0.05678	0.00656
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.05487	0.05482
		Z3	z3-4.8.8_default	unsat ✅	0.12105	0.12093