Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-no-caches/_lbracket-query-000012.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	766924
Compressed Size	4613
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	766915
Compressed Size	4602
Max. Term Depth	50
Asserts	1593
Declared Functions	0
Declared Constants	13
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	12	ite	1163	and	29	=	1621
let	1	concat	7185	extract	1206	bvand	8
bvxor	2327	bvadd	1074	bvmul	1176	bvsub	1162
bvult	1171	bvslt	5	zero_extend	14	sign_extend	1174
select	11190	store	1316

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	6.16161	6.15206
			Boolector boolectorj	sat ✅	4.05869	4.05838
		CVC4	CVC4 f7118b2 default	sat ✅	14.11970	14.11590
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.13907	0.12998
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.21563	0.40894
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.69211	0.68390
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	1.04125	1.03084
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.08670	0.08499
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.27024	0.26296
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.16625	0.16497
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	2.08481	2.08368
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	1.95122	1.94870
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.68807	0.68590
		Yices2	Yices default	sat ✅	0.08807	0.08699
		Z3	z3 4.4.0 default	sat ✅	0.28152	0.28196
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.15721	0.15727
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	2.66905	2.67104
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.63175	0.63315
		Yices2	Yices-2.4.2 default	sat ✅	0.08699	0.08701
		Z3	z3-4.4.1 default	sat ✅	0.29971	0.29985
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.16886	0.16789
		CVC4	CVC4-smtcomp2017-main default	sat ✅	2.85196	2.85057
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.62876	0.62897
		Yices2	Yices2-Main default	sat ✅	0.08281	0.08206
		Z3	z3-4.5.0 default	sat ✅	0.41845	0.41821
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.13871	0.13864
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	2.17689	2.17675
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.34446	0.34545
		Yices2	Yices 2.6.0_default	sat ✅	0.07193	0.07175
		Z3	z3-4.7.1_default	sat ✅	0.37548	0.37332
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.15834	0.15837
			Poolector-wrapped-sq_default	sat ✅	0.27637	0.59614
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	2.33036	2.33046
		Par4	Par4-wrapped-sq_default	sat ✅	0.08119	0.00709
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.07138	0.07137
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.41986	0.41983
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.46436	0.46424
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.08103	0.08101
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.08204	0.08200
		Z3	z3-4.8.11_default	sat ✅	0.41721	0.41715
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.19211	0.19207
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	4.49635	4.49668
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.49420	0.49409
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.07650	0.07646
		Z3	z3-4.8.17_default	sat ✅	0.43033	0.43209
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.56712	2.56672
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	13.73790	13.73230
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1265.84000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.07704	0.07696
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.19043	2.19018
			z3-Owl-Final_default	sat ✅	1.47092	1.47109
SMT-COMP 2025	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	0.36395	0.24355
		cvc5	cvc5	sat ✅	15.84659	15.72444
		SMTInterpol	SMTInterpol	unknown ❌	1201.39429	1232.48632
		Yices2	Yices2	sat ✅	0.31630	0.19864
		Z3	Z3-Owl-base	sat ✅	2.17932	2.05650
		Z3-Owl	Z3-Owl	sat ✅	1.20565	1.07877