Benchmark

non-incremental/QF_ABV/platania/bubble_sort/bubble_sort16.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	551169
Compressed Size	35369
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	551161
Compressed Size	35379
Max. Term Depth	1881
Asserts	1189
Declared Functions	0
Declared Constants	1195
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	1170	not	17	and	4129	=>	916
=	1204	let	1142	bvadd	1140	bvsub	3451
bvult	3917	bvule	466	select	1816	store	466

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008		Boolector	Boolector	unsat ✅	0.10000	—
		CVC3	CVC3-1.5	unsat ✅	6.60000	—
		Z3	Z3 0.1	unsat ✅	0.10000	—
			Z3.2	unsat ✅	0.10000	—
SMT-COMP 2009	0.25 (3/4)	Boolector	Boolector	unsat ✅	0.10000	—
			Boolector 1.2	unsat ✅	0.10000	—
		CVC3	CVC3 2.0	unsat ✅	2.40000	—
		MathSAT	MathSAT 4.3	unknown ❌	752.30000	—
		Yices2	Yices 2 proto	unsat ✅	—	—
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.04252	—
			Boolector-SMT-COMP-2011 default	unknown ❌	—	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.04584	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unsat ✅	1.41690	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.25896	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.25110	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.27636	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.23059	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	0.14678	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.14294	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unsat ✅	0.08438	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.08626	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.08787	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	unsat ✅	0.12498	0.11398
			Boolector boolectorj	unsat ✅	0.12464	0.11498
		CVC4	CVC4 f7118b2 default	unsat ✅	0.35161	0.34095
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02446	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.03903	0.03000
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.14044	0.13198
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.14231	0.13098
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.04627	0.03799
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.08581	0.07799
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.06823	0.06699
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.36529	0.36294
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.36171	0.35895
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.11553	0.11498
		Yices2	Yices default	unsat ✅	0.03857	0.03799
		Z3	z3 4.4.0 default	unsat ✅	0.09721	0.09699
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.06394	0.06394
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.35935	0.36020
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.10136	0.10240
		Yices2	Yices-2.4.2 default	unsat ✅	0.03932	0.03927
		Z3	z3-4.4.1 default	unsat ✅	0.09367	0.09500
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.06097	0.05885
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.38907	0.38740
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.10495	0.10458
		Yices2	Yices2-Main default	unsat ✅	0.03966	0.03838
		Z3	z3-4.5.0 default	unsat ✅	0.09795	0.09626
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.05285	0.05275
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.40574	0.40581
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.10155	0.10241
		Yices2	Yices 2.6.0_default	unsat ✅	0.03942	0.03933
		Z3	z3-4.7.1_default	unsat ✅	0.10413	0.10407
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	unsat ✅	0.07579	0.07576
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.56494	0.56449
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.10902	0.10893
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.04397	0.04392
		Z3	z3-4.8.17_default	unsat ✅	0.08772	0.08939
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	unsat ✅	0.32332	0.22319
		cvc5	cvc5	unsat ✅	0.37687	0.27576
		SMTInterpol	SMTInterpol	unknown ❌	1201.74439	1248.16923
		Yices2	Yices2	unsat ✅	0.24291	0.14264
SMT-COMP 2025		Bitwuzla	Bitwuzla	unsat ✅	0.30335	0.18023
		cvc5	cvc5	unsat ✅	0.43083	0.30735
		SMTInterpol	SMTInterpol	unsat ✅	937.71648	990.44370
		Yices2	Yices2	unsat ✅	0.27306	0.15402
		Z3	Z3-Owl-base	unsat ✅	0.57392	0.44709
		Z3-Owl	Z3-Owl	unsat ✅	0.88787	0.76623