Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-047.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	799415
Compressed Size	4209
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	799406
Compressed Size	4194
Max. Term Depth	50
Asserts	1593
Declared Functions	0
Declared Constants	8
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	8	ite	1227	and	21
=	1613	let	1	concat	7517	extract	1271
bvand	4	bvxor	2455	bvadd	1132	bvmul	1240
bvsub	1226	bvult	1231	bvslt	4	zero_extend	14
sign_extend	1239	select	11643	store	1381

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	11.75220	11.74820
			Boolector boolectorj	sat ✅	6.27995	6.27205
		CVC4	CVC4 f7118b2 default	sat ✅	11.65180	11.64720
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.13898	0.12998
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.21010	0.38494
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.75922	0.75089
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.89283	0.88187
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.06962	0.06799
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.25852	0.24996
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.16477	0.16397
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	2.59002	2.58861
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	1.76996	1.76773
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.74329	0.74289
		Yices2	Yices default	sat ✅	0.07065	0.06999
		Z3	z3 4.4.0 default	sat ✅	0.27494	0.27496
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.15019	0.15025
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	1.84054	1.84197
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.67082	0.67232
		Yices2	Yices-2.4.2 default	sat ✅	0.06996	0.06996
		Z3	z3-4.4.1 default	sat ✅	0.28586	0.28727
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.15782	0.15704
		CVC4	CVC4-smtcomp2017-main default	sat ✅	1.93560	1.93447
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.71375	0.71359
		Yices2	Yices2-Main default	sat ✅	0.06537	0.06437
		Z3	z3-4.5.0 default	sat ✅	0.38882	0.38767
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.14052	0.14043
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	2.33324	2.33323
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.43164	0.43243
		Yices2	Yices 2.6.0_default	sat ✅	0.06203	0.06197
		Z3	z3-4.7.1_default	sat ✅	0.39297	0.39282
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.17303	0.17304
			Poolector-wrapped-sq_default	sat ✅	0.28224	0.59760
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	2.63614	2.63610
		Par4	Par4-wrapped-sq_default	sat ✅	0.07141	0.00770
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.06148	0.06150
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.38710	0.38707
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.18801	0.18799
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.17474	0.17474
		CVC4	CVC4-sq-final_default	sat ✅	3.14366	3.14348
		MathSAT	MathSAT5_default.sh	sat ✅	0.45360	0.45350
		Par4	Par4-wrapped-sq_default	sat ✅	0.07271	0.00688
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.07093	0.07087
		Z3	z3-4.8.8_default	sat ✅	0.44406	0.44403
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.44659	0.44650
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.07085	0.07081
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.07144	0.07140
		Z3	z3-4.8.11_default	sat ✅	0.37770	0.37755
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.17625	0.17622
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	6.19696	6.19688
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.46526	0.46523
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.06619	0.06618
		Z3	z3-4.8.17_default	sat ✅	0.39129	0.39314
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.92892	1.92867
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	17.00380	17.00220
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	208.81600	258.54500
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.06641	0.06638
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.20128	2.20130
			z3-Owl-Final_default	sat ✅	1.39860	1.39880
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	1.36934	1.26953
		cvc5	cvc5	sat ✅	8.54379	8.43879
		SMTInterpol	SMTInterpol	sat ✅	90.61056	125.20050
		Yices2	Yices2	sat ✅	0.25664	0.15613
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	1.18319	1.05657
		cvc5	cvc5	sat ✅	15.71799	15.59102
		SMTInterpol	SMTInterpol	sat ✅	85.62363	109.18928
		Yices2	Yices2	sat ✅	0.35244	0.22748
		Z3	Z3-Owl-base	sat ✅	1.77366	1.65466
		Z3-Owl	Z3-Owl	sat ✅	1.22384	1.08923