Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe22.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	1182684
Compressed Size	68902
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1182676
Compressed Size	68892
Max. Term Depth	3657
Asserts	2271
Declared Functions	0
Declared Constants	2277
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	2268	not	43	and	8044	=>	1826
=	2270	let	2268	bvadd	2226	bvsub	6721
bvult	7625	bvule	925	select	3550	store	882

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2008	0.33 (2/3)	Boolector	Boolector	sat ✅	42.20000	—
		CVC3	CVC3-1.5	sat ✅	132.00000	—
		Z3	Z3 0.1	unknown ❌	1800.80000	—
			Z3.2	unknown ❌	1801.00000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	44.40000	—
		CVC3	CVC3 2.3	unknown ❌	54.60000	—
SMT-COMP 2012	0.25 (3/4)	Boolector	Boolector	sat ✅	15.60000	—
			Boolector 1.5.23-833	unknown ❌	1200.00000	—
		CVC3	CVC3 v2.4.2	sat ✅	13.20000	—
			CVC4 1.0rc.3931	unknown ❌	1200.00000	—
			CVC4 1.0rc.3970	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	3.30000	—
SMT-COMP 2011	0.80 (1/5)	Boolector	Boolector 1.5.23-833	unknown ❌	1200.00000	—
		CVC3	CVC3 v2.4	sat ✅	13.00000	—
		MathSAT	MathSAT5	unknown ❌	1200.10000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		Z3	Z3	unknown ❌	1200.00000	—
SMT Evaluation 2013	0.29 (5/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	19.65200	—
			Boolector-SMT-COMP-2011 default	unknown ❌	—	—
			Boolector-SMT-COMP-2012 default	sat ✅	9.20231	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	8.55665	—
			CVC3-SMT-COMP-2011 default	sat ✅	8.37284	—
			CVC3-SMT-COMP-2012 default	sat ✅	8.14364	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	215.58000	—
			CVC4-SMT-EVAL-2013 default	sat ✅	189.36700	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	23.79100	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	140.11700	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	206.65400	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	1.54955	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2014	0.43 (4/7)	Boolector	Boolector boolectord	sat ✅	0.67703	0.66590
			Boolector boolectorj	sat ✅	0.57027	0.55891
		CVC4	CVC4 f7118b2 default	sat ✅	106.98500	106.99800
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02439	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.03895	0.02899
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	23.50650	23.50740
		SONOLAR	sonolar_smtcomp-2014 default	unknown ❌	2398.91000	2400.04000
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	6.26987	6.26305
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.31000	2400.08000
SMT-COMP 2015	0.20 (4/5)	Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	2.99736	2.99754
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	2.63050	2.62960
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	13.48890	13.49090
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	22.58990	22.59360
		Yices2	Yices default	sat ✅	0.19211	0.19097
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.74000
SMT-COMP 2016	0.20 (4/5)	Boolector	Boolector boolector	sat ✅	4.88162	4.88292
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	12.61510	12.62290
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	20.70350	20.71860
		Yices2	Yices-2.4.2 default	sat ✅	17.74670	17.75660
		Z3	z3-4.4.1 default	unknown ❌	2400.02000	2401.42000
SMT-COMP 2017	0.20 (4/5)	Boolector	Boolector SMT17 final boolector	sat ✅	4.79001	4.78789
		CVC4	CVC4-smtcomp2017-main default	sat ✅	15.96610	15.96080
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	20.92200	20.91870
		Yices2	Yices2-Main default	sat ✅	4.60314	4.60190
		Z3	z3-4.5.0 default	unknown ❌	600.02800	599.78000
SMT-COMP 2018	0.60 (2/5)	Boolector	Boolector_default	unknown ❌	1200.02000	1200.00000
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	14.60640	14.60510
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	21.96640	21.96630
		Yices2	Yices 2.6.0_default	sat ✅	16.40360	16.39790
		Z3	z3-4.7.1_default	unknown ❌	1200.11000	1200.08000
SMT-COMP 2019	0.20 (4/5)	Boolector	Boolector-wrapped-sq_default	sat ✅	1.94119	1.94097
			Poolector-wrapped-sq_default	sat ✅	2.32959	8.73000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	14.20780	14.20790
		Par4	Par4-wrapped-sq_default	sat ✅	4.26586	12.70000
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	4.40104	4.40079
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.12000	2399.68000
SMT-COMP 2021	0.33 (2/3)	MathSAT	mathsat-5.6.6_default	sat ✅	15.00090	14.99990
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	86.98920	86.98890
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	87.72430	87.72450
		Z3	z3-4.8.11_default	unknown ❌	1200.03000	1199.51000
SMT-COMP 2022	0.20 (4/5)	Bitwuzla	Bitwuzla-wrapped_default	sat ✅	1.35875	1.35504
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	17.71810	17.71520
		MathSAT	MathSAT-5.6.8_default	sat ✅	15.63770	15.63540
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	23.62030	23.62030
		Z3	z3-4.8.17_default	unknown ❌	1200.02000	1199.88000
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	109.40500	109.41400
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	17.33280	17.33080
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.12000	1247.80000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	4.45860	4.45817
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.12047	2.06391
			z3-Owl-Final_default	unknown ❌	1200.11000	1199.68000
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	1.12984	1.02958
		cvc5	cvc5	sat ✅	12.02973	11.92909
		SMTInterpol	SMTInterpol	unknown ❌	1201.71791	1246.71095
		Yices2	Yices2	sat ✅	0.35926	0.25943
SMT-COMP 2025	0.50 (3/6)	Bitwuzla	Bitwuzla	sat ✅	1.95152	1.83092
		cvc5	cvc5	sat ✅	2.26547	2.14757
		SMTInterpol	SMTInterpol	unknown ❌	1201.34234	1236.72260
		Yices2	Yices2	sat ✅	47.62238	47.47968
		Z3	Z3-Owl-base	unknown ❌	1201.33472	1201.07795
		Z3-Owl	Z3-Owl	unknown ❌	1201.76187	1201.11031