Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-no-caches/_lbracket-query-000110.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	3427370
Compressed Size	5991
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3427361
Compressed Size	5977
Max. Term Depth	63
Asserts	1617
Declared Functions	0
Declared Constants	14
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	13	ite	5771	and	49	=	1660
let	1	concat	35454	extract	6040	bvand	14
bvxor	11543	bvadd	5412	bvmul	5856	bvsub	5770
bvult	5785	bvslt	5	zero_extend	86	sign_extend	5854
select	49157	store	6924

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	49.47960	49.46250
			Boolector boolectorj	sat ✅	21.83340	21.83270
		CVC4	CVC4 f7118b2 default	sat ✅	46.16410	46.16300
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.43456	0.42593
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.55915	0.76088
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	1.28908	1.28080
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	1.29167	1.28880
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.25460	0.24596
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.63863	0.63090
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.58009	0.57891
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	3.51693	3.51646
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	3.11206	3.11053
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1.14953	1.14882
		Yices2	Yices default	sat ✅	0.24124	0.23996
		Z3	z3 4.4.0 default	sat ✅	0.62785	0.62790
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.51752	0.51766
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	3.12393	3.12632
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.23653	1.23818
		Yices2	Yices-2.4.2 default	sat ✅	0.23773	0.23783
		Z3	z3-4.4.1 default	sat ✅	0.63082	0.63261
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.46925	0.46812
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.32944	3.32896
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.05289	1.05230
		Yices2	Yices2-Main default	sat ✅	0.22080	0.21944
		Z3	z3-4.5.0 default	sat ✅	0.71728	0.71672
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.46226	0.46214
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	3.54007	3.53991
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.57715	0.57800
		Yices2	Yices 2.6.0_default	sat ✅	0.21400	0.21390
		Z3	z3-4.7.1_default	sat ✅	0.72449	0.72431
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.50502	0.50504
			Poolector-wrapped-sq_default	sat ✅	0.68086	2.10000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	3.86741	3.86777
		Par4	Par4-wrapped-sq_default	sat ✅	0.22304	0.00612
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.20812	0.20812
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.70759	0.70755
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.50102	0.50096
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.51073	0.51067
		CVC4	CVC4-sq-final_default	sat ✅	15.74030	15.74010
		MathSAT	MathSAT5_default.sh	sat ✅	0.90118	0.90106
		Par4	Par4-wrapped-sq_default	sat ✅	0.23341	0.00609
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.25400	0.25395
		Z3	z3-4.8.8_default	sat ✅	0.80051	0.80041
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.88922	0.88670
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.25454	0.25452
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.25354	0.25348
		Z3	z3-4.8.11_default	sat ✅	0.83220	0.83210
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.51331	0.51320
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	15.99340	15.99060
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.90420	0.90414
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.22850	0.22840
		Z3	z3-4.8.17_default	sat ✅	0.80255	0.80290
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.67120	0.67111
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	180.58200	178.96500
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1251.91000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.22887	0.22879
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.48684	2.48644
			z3-Owl-Final_default	sat ✅	2.81437	2.81436
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	0.49962	0.37908
		cvc5	cvc5	sat ✅	114.78962	114.66005
		SMTInterpol	SMTInterpol	sat ✅	255.95106	288.64375
		Yices2	Yices2	sat ✅	0.35987	0.24305
		Z3	Z3-Owl-base	sat ✅	8.82657	8.70615
		Z3-Owl	Z3-Owl	sat ✅	2.11111	1.98025