Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort10.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	199627
Compressed Size	14186
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	199619
Compressed Size	14036
Max. Term Depth	699
Asserts	445
Declared Functions	0
Declared Constants	451
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	432	not	11	and	1507	=>	334
=	454	let	416	bvadd	414	bvsub	1261
bvult	1433	bvule	172	select	658	store	172

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007		Yices	Yices 1.0.10	unsat ✅	51.20000	—
		Z3	Z3 0.1	unsat ✅	—	—
			Z3 0.1 (fixed BV)	unsat ✅	—	—
SMT-COMP 2008		Boolector	Boolector	unsat ✅	—	—
		CVC3	CVC3-1.5	unsat ✅	1.80000	—
		Z3	Z3 0.1	unsat ✅	—	—
			Z3.2	unsat ✅	—	—
SMT Evaluation 2013	0.29 (5/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	—	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.02288	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.01840	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.07278	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.04818	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unsat ✅	0.03138	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unsat ✅	—	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	unsat ✅	0.04596	0.03499
			Boolector boolectorj	unsat ✅	0.03829	0.03499
		CVC4	CVC4 f7118b2 default	unsat ✅	0.12756	0.12498
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02458	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.04034	0.03099
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.05837	0.04999
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.05760	0.04699
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.02388	0.01500
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.04019	0.03200
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.02613	0.02499
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.13448	0.13298
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.13501	0.13198
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.04954	0.04899
		Yices2	Yices default	unsat ✅	0.01630	0.01500
		Z3	z3 4.4.0 default	unsat ✅	0.05372	0.05299
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.02478	0.02480
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.13434	0.13481
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.04299	0.04397
		Yices2	Yices-2.4.2 default	unsat ✅	0.01650	0.01643
		Z3	z3-4.4.1 default	unsat ✅	0.05192	0.05321
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.02412	0.02313
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.13662	0.13616
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.04425	0.04351
		Yices2	Yices2-Main default	unsat ✅	0.01830	0.01705
		Z3	z3-4.5.0 default	unsat ✅	0.05702	0.05475
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.02151	0.02142
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.14738	0.14743
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.04164	0.04281
		Yices2	Yices 2.6.0_default	unsat ✅	0.01827	0.01822
		Z3	z3-4.7.1_default	unsat ✅	0.06000	0.05994
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	unsat ✅	0.04487	0.04486
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.01906	0.01899
			Yices 2.6.2 for SMTCOMP2020_default	unsat ✅	0.01885	0.01882
		Z3	z3-4.8.11_default	unsat ✅	0.04176	0.04172
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.24713	0.14749
		cvc5	cvc5	unsat ✅	0.29535	0.19532
		SMTInterpol	SMTInterpol	unsat ✅	340.63483	381.27113
		Yices2	Yices2	unsat ✅	0.24919	0.14956