Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_unsafe27.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.

Benchmark
Size	1812886
Compressed Size	104508
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1812878
Compressed Size	104517
Max. Term Depth	5567
Asserts	3461
Declared Functions	0
Declared Constants	3467
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	3458	not	53	and	12299	=>	2781
=	3460	let	3458	bvadd	3406	bvsub	10271
bvult	11650	bvule	1405	select	5435	store	1352

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007	1.00 (0/2)	Yices	Yices 1.0.10	unknown ❌	1801.00000	—
		Z3	Z3 0.1	unknown ❌	1800.80000	—
			Z3 0.1 (fixed BV)	unknown ❌	1800.80000	—
SMT-COMP 2008	0.67 (1/3)	Boolector	Boolector	unknown ❌	1800.70000	—
		CVC3	CVC3-1.5	sat ✅	301.40000	—
		Z3	Z3 0.1	unknown ❌	1800.70000	—
			Z3.2	unknown ❌	1801.10000	—
SMT-COMP 2009	0.75 (1/4)	Boolector	Boolector	unknown ❌	900.00000	—
			Boolector 1.2	sat ✅	835.10000	—
		CVC3	CVC3 2.0	unknown ❌	71.50000	—
		MathSAT	MathSAT 4.3	unknown ❌	194.20000	—
		Yices2	Yices 2 proto	unknown ❌	900.10000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	841.00000	—
		CVC3	CVC3 2.3	unknown ❌	65.80000	—
SMT-COMP 2012	0.25 (3/4)	Boolector	Boolector	sat ✅	35.30000	—
			Boolector 1.5.23-833	unknown ❌	1200.00000	—
		CVC3	CVC3 v2.4.2	sat ✅	28.90000	—
			CVC4 1.0rc.3931	unknown ❌	1200.00000	—
			CVC4 1.0rc.3970	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	3.80000	—
SMT-COMP 2011	0.80 (1/5)	Boolector	Boolector 1.5.23-833	unknown ❌	1200.00000	—
		CVC3	CVC3 v2.4	sat ✅	28.60000	—
		MathSAT	MathSAT5	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		Z3	Z3	unknown ❌	1200.00000	—
SMT Evaluation 2013	0.86 (1/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unknown ❌	—	—
			Boolector-SMT-COMP-2011 default	unknown ❌	—	—
			Boolector-SMT-COMP-2012 default	unknown ❌	—	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	63.08420	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2014	0.43 (4/7)	Boolector	Boolector boolectord	sat ✅	1.21510	1.20182
			Boolector boolectorj	sat ✅	1.04840	1.03784
		CVC4	CVC4 f7118b2 default	sat ✅	360.67700	360.79300
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.02460	0.01500
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.04156	0.02999
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	61.66650	61.66860
		SONOLAR	sonolar_smtcomp-2014 default	unknown ❌	2399.12000	2400.04000
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	8.74017	8.73467
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unknown ❌	2399.71000	2400.06000
SMT-COMP 2015	0.20 (4/5)	Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	81.22690	81.23460
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	5.62727	5.62714
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	44.75030	44.75720
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	59.47860	59.49800
		Yices2	Yices default	sat ✅	8.77151	8.77267
		Z3	z3 4.4.0 default	unknown ❌	2400.01000	2400.63000
SMT-COMP 2016	0.20 (4/5)	Boolector	Boolector boolector	sat ✅	7.33812	7.34216
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	39.40510	39.41380
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	54.85900	54.89260
		Yices2	Yices-2.4.2 default	sat ✅	8.70728	17.30230
		Z3	z3-4.4.1 default	unknown ❌	2400.02000	2401.10000
SMT-COMP 2017	0.20 (4/5)	Boolector	Boolector SMT17 final boolector	sat ✅	7.26453	7.25956
		CVC4	CVC4-smtcomp2017-main default	sat ✅	104.02600	103.84100
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	55.85910	55.85700
		Yices2	Yices2-Main default	sat ✅	4.62481	4.62021
		Z3	z3-4.5.0 default	unknown ❌	600.01300	599.79000
SMT-COMP 2018	0.60 (2/5)	Boolector	Boolector_default	unknown ❌	1200.09000	1200.02000
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	42.99490	42.99020
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	57.92310	57.91700
		Yices2	Yices 2.6.0_default	sat ✅	7.33656	7.33637
		Z3	z3-4.7.1_default	unknown ❌	1200.02000	1199.93000
SMT-COMP 2019	0.20 (4/5)	Boolector	Boolector-wrapped-sq_default	sat ✅	3.56431	3.56446
			Poolector-wrapped-sq_default	sat ✅	4.12530	15.77570
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	41.81080	41.80740
		Par4	Par4-wrapped-sq_default	sat ✅	4.49270	13.27000
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	4.52851	4.52848
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.12000	2400.02000
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	3.44013	3.43986
		Boolector	Boolector-wrapped-sq_default	sat ✅	3.58292	3.58267
		CVC4	CVC4-sq-final_default	sat ✅	42.73770	42.73610
		MathSAT	MathSAT5_default.sh	sat ✅	49.51920	49.50240
		Par4	Par4-wrapped-sq_default	sat ✅	13.38030	40.00000
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	14.38670	14.38590
		Z3	z3-4.8.8_default	sat ✅	34.90990	34.90690
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	3.08018	3.07947
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	128.40800	127.28600
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1256.80000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	4.59011	4.58931
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.50174	2.50161
			z3-Owl-Final_default	unknown ❌	1200.02000	1199.81000
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	2.54076	2.44078
		cvc5	cvc5	sat ✅	36.70793	36.60702
		SMTInterpol	SMTInterpol	unknown ❌	1201.71724	1243.07195
		Yices2	Yices2	sat ✅	7.31319	7.21303