Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-large-qids/_lbracket-query-062.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	435573
Compressed Size	4052
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	435564
Compressed Size	4040
Max. Term Depth	42
Asserts	1593
Declared Functions	0
Declared Constants	8
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	5	ite	587	and	19
=	1610	let	1	concat	3606	extract	605
bvand	3	bvxor	1175	bvadd	543	bvmul	591
bvsub	586	bvult	589	bvslt	4	zero_extend	5
sign_extend	590	select	6400	store	732

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	3.09401	3.08553
			Boolector boolectorj	sat ✅	2.19252	2.18367
		CVC4	CVC4 f7118b2 default	sat ✅	9.28839	9.28159
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.09528	0.08599
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.15659	0.31495
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.56638	0.55791
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.51036	0.50692
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.05479	0.04599
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.20883	0.20097
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.10281	0.10198
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	2.89979	2.89856
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	2.52064	2.51862
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.57094	0.56991
		Yices2	Yices default	sat ✅	0.04752	0.04699
		Z3	z3 4.4.0 default	sat ✅	0.22140	0.22096
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.11092	0.11095
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	2.47638	2.47838
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.46236	0.46350
		Yices2	Yices-2.4.2 default	sat ✅	0.04769	0.04767
		Z3	z3-4.4.1 default	sat ✅	0.48644	0.48915
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.12143	0.11886
		CVC4	CVC4-smtcomp2017-main default	sat ✅	2.53633	2.53582
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.49430	0.49441
		Yices2	Yices2-Main default	sat ✅	0.04544	0.04523
		Z3	z3-4.5.0 default	sat ✅	0.29704	0.29628
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.09075	0.09063
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	1.95507	1.95502
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.30135	0.30206
		Yices2	Yices 2.6.0_default	sat ✅	0.04181	0.04177
		Z3	z3-4.7.1_default	sat ✅	0.30518	0.30472
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.10734	0.10738
			Poolector-wrapped-sq_default	sat ✅	0.27691	0.56599
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	2.56283	2.56292
		Par4	Par4-wrapped-sq_default	sat ✅	0.05174	0.00607
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.04136	0.04137
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.30737	0.30732
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.37656	0.37650
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.04631	0.04626
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.04618	0.04616
		Z3	z3-4.8.11_default	sat ✅	0.40617	0.40613
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.11921	0.11913
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	3.04893	3.04916
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.40898	0.40893
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.04424	0.04421
		Z3	z3-4.8.17_default	sat ✅	0.48088	0.48037
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.67905	1.67885
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	9.31076	9.30293
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	189.73900	235.69800
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.04454	0.04451
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.15229	2.15221
			z3-Owl-Final_default	sat ✅	1.46372	1.46390
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	1.20672	1.08750
		cvc5	cvc5	sat ✅	12.02181	11.88314
		SMTInterpol	SMTInterpol	sat ✅	49.96228	74.12313
		Yices2	Yices2	sat ✅	0.29588	0.17606
		Z3	Z3-Owl-base	sat ✅	1.75680	1.63984
		Z3-Owl	Z3-Owl	sat ✅	1.20071	1.08038