Benchmark

non-incremental/QF_ABV/klee-selected-smt2/cu-no-caches/_lbracket-query-000115.smt2

Hristina Palikareva, Cristian Cadar, KLEE 2014 experiments

Benchmark
Size	3428818
Compressed Size	6132
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3428809
Compressed Size	6118
Max. Term Depth	65
Asserts	1617
Declared Functions	0
Declared Constants	14
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	13	ite	5771	and	54	=	1665
let	1	concat	35478	extract	6040	bvand	16
bvxor	11543	bvadd	5412	bvmul	5856	bvsub	5770
bvult	5785	bvslt	5	zero_extend	86	sign_extend	5854
select	49185	store	6924

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	51.38430	51.38520
			Boolector boolectorj	sat ✅	22.93100	22.91850
		CVC4	CVC4 f7118b2 default	sat ✅	39.81960	39.81990
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.43772	0.42693
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.56263	0.77388
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	1.27149	1.26281
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	1.43126	1.42878
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.24445	0.24096
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.65593	0.64490
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.58361	0.58291
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	3.28762	3.28650
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	3.41331	3.41248
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1.23127	1.23081
		Yices2	Yices default	sat ✅	0.24288	0.24196
		Z3	z3 4.4.0 default	sat ✅	0.63165	0.63190
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.52037	0.52085
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	3.14422	3.14621
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.26820	1.26984
		Yices2	Yices-2.4.2 default	sat ✅	0.23951	0.23958
		Z3	z3-4.4.1 default	sat ✅	0.62606	0.62767
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.45722	0.45666
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.32193	3.31634
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.32402	1.32426
		Yices2	Yices2-Main default	sat ✅	0.22229	0.22135
		Z3	z3-4.5.0 default	sat ✅	0.76850	0.76789
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.47198	0.47182
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	3.86322	3.86268
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.70428	0.69997
		Yices2	Yices 2.6.0_default	sat ✅	0.21860	0.21698
		Z3	z3-4.7.1_default	sat ✅	0.78974	0.78964
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.50817	0.50814
			Poolector-wrapped-sq_default	sat ✅	0.69261	2.16000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	4.12090	4.12084
		Par4	Par4-wrapped-sq_default	sat ✅	0.22340	0.00602
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.21463	0.21462
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.71458	0.71453
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.86907	0.86902
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.25578	0.25574
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.25347	0.25344
		Z3	z3-4.8.11_default	sat ✅	0.78157	0.78145
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.51415	0.51409
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	15.83060	15.83100
		MathSAT	MathSAT-5.6.8_default	sat ✅	1.05859	1.05846
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.22742	0.22739
		Z3	z3-4.8.17_default	sat ✅	0.77555	0.77736
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.65338	0.65331
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	13.85160	13.84940
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1251.22000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.24935	0.24929
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.49198	2.49165
			z3-Owl-Final_default	sat ✅	1.85209	1.85227