Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-no-caches/_lbracket-query-000075.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	3434647
Compressed Size	6369
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3434638
Compressed Size	6356
Max. Term Depth	89
Asserts	1617
Declared Functions	0
Declared Constants	14
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	14	ite	5771	and	78	=	1692
let	1	concat	35573	extract	6040	bvand	25
bvxor	11543	bvadd	5412	bvmul	5856	bvsub	5770
bvult	5783	bvslt	5	zero_extend	86	sign_extend	5854
select	49297	store	6924

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	54.68980	54.69170
			Boolector boolectorj	sat ✅	22.65830	22.66460
		CVC4	CVC4 f7118b2 default	sat ✅	45.99920	46.01100
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.43970	0.43093
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.57168	0.78788
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	1.60657	1.59876
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	1.25541	1.24281
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.25424	0.24596
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.65612	0.65590
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.58857	0.58791
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	3.76712	3.76543
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	3.38602	3.38349
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1.33561	1.33480
		Yices2	Yices default	sat ✅	0.24505	0.24396
		Z3	z3 4.4.0 default	sat ✅	0.65358	0.65390
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.53095	0.53118
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	3.02600	3.02570
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.44411	1.44595
		Yices2	Yices-2.4.2 default	sat ✅	0.24063	0.24066
		Z3	z3-4.4.1 default	sat ✅	0.63280	0.63445
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.61308	0.60806
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.35400	3.35327
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.97176	1.97162
		Yices2	Yices2-Main default	sat ✅	0.23060	0.22289
		Z3	z3-4.5.0 default	sat ✅	0.78272	0.78194
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.63016	0.63008
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	3.92344	3.92334
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.77967	0.78060
		Yices2	Yices 2.6.0_default	sat ✅	0.21512	0.21505
		Z3	z3-4.7.1_default	sat ✅	0.74043	0.74028
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.52148	0.52154
			Poolector-wrapped-sq_default	sat ✅	0.68560	2.15000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	4.19333	4.19361
		Par4	Par4-wrapped-sq_default	sat ✅	0.22560	0.00578
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.22021	0.20817
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.74503	0.74497
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.90412	0.90409
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.25612	0.25609
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.26025	0.26022
		Z3	z3-4.8.11_default	sat ✅	0.82383	0.82370
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.55434	0.55267
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	15.60530	15.59540
		MathSAT	MathSAT-5.6.8_default	sat ✅	1.02161	1.02155
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.23142	0.23137
		Z3	z3-4.8.17_default	sat ✅	0.77980	0.78164
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.70718	0.70712
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	18.71880	18.71730
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1243.33000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.23059	0.23058
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.64479	2.64493
			z3-Owl-Final_default	sat ✅	1.91867	1.84877
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	0.68309	0.58330
		cvc5	cvc5	sat ✅	13.11577	13.01450
		SMTInterpol	SMTInterpol	sat ✅	245.27347	284.56437
		Yices2	Yices2	sat ✅	0.36726	0.26700