Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_noof_functions_wp_shuf.isaac_mix.il.wp.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>

Benchmark
Size	35254
Compressed Size	4223
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	35246
Compressed Size	4232
Max. Term Depth	127
Asserts	1
Declared Functions	0
Declared Constants	8
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	38	=	39	let	108	concat	193
extract	149	bvnot	55	bvand	123	bvor	162
bvxor	102	bvneg	1	bvadd	214	bvsub	6
bvshl	152	bvlshr	151	select	192	store	140

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.14 (6/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	5.58469	—
			Boolector-SMT-COMP-2011 default	sat ✅	42.01320	—
			Boolector-SMT-COMP-2012 default	sat ✅	3.19096	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	sat ✅	389.17800	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	7.36338	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	101.64600	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	361.86100	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	6.21542	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	10.71060	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	2.54234	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	7.83448	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	122.24900	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	sat ✅	9.30046	9.28659
			Boolector boolectorj	sat ✅	8.65970	8.65268
		CVC4	CVC4 f7118b2 default	sat ✅	581.71900	581.80600
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.03889	0.01900
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.04341	0.03499
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	4.36621	4.35834
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	6.22709	6.21705
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	1.34722	1.33880
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	81.68510	81.67160
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.54116	0.53992
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	238.68000	238.67200
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	1.56799	1.56476
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	3.13503	3.13452
		Yices2	Yices default	sat ✅	1.35229	1.35179
		Z3	z3 4.4.0 default	sat ✅	138.21300	138.21700
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.49360	0.49382
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	1.63986	1.64095
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	3.65701	3.66082
		Yices2	Yices-2.4.2 default	sat ✅	1.35216	1.35288
		Z3	z3-4.4.1 default	sat ✅	163.10900	163.16600
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	3.15722	3.15221
		CVC4	CVC4-smtcomp2017-main default	sat ✅	2.14329	2.14119
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	7.92272	7.92288
		Yices2	Yices2-Main default	sat ✅	1.30193	1.30084
		Z3	z3-4.5.0 default	sat ✅	145.26300	145.21800
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	5.24291	5.23636
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	1.73595	1.73584
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.50254	0.50353
		Yices2	Yices 2.6.0_default	sat ✅	1.26342	1.26335
		Z3	z3-4.7.1_default	sat ✅	113.51600	113.51600
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.47502	0.47494
		Boolector	Boolector-wrapped-sq_default	sat ✅	1.72738	1.72716
		CVC4	CVC4-sq-final_default	sat ✅	30.07080	30.06810
		MathSAT	MathSAT5_default.sh	sat ✅	10.32240	10.32220
		Par4	Par4-wrapped-sq_default	sat ✅	1.36928	3.92000
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	1.85712	1.85691
		Z3	z3-4.8.8_default	sat ✅	618.44400	618.42100
SMT-COMP 2023	0.20 (4/5)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	5.36482	5.36419
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	5.32285	5.32110
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.06000	1251.76000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	1.89679	1.89674
		Z3-Owl	z3-Owl-Final_default	sat ✅	2.39804	2.39780
			z3-Owl-Final_default	sat ✅	445.70200	445.61700
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	1.74497	1.64332
		cvc5	cvc5	sat ✅	8.19863	8.09849
		SMTInterpol	SMTInterpol	unknown ❌	1201.74295	1242.15362
		Yices2	Yices2	sat ✅	1.65418	1.55384