Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_noof_functions_fse-bfs_pr.reset_status.il.fse-bfs.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>

Benchmark
Size	6646
Compressed Size	1122
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	6638
Compressed Size	1125
Max. Term Depth	38
Asserts	1
Declared Functions	0
Declared Constants	4
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	15	=	16	let	21	concat	33
extract	22	bvnot	14	bvand	49	bvor	23
bvxor	18	bvadd	14	bvsub	12	bvshl	18
bvlshr	21	select	27	store	20

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.03614	—
			Boolector-SMT-COMP-2011 default	sat ✅	0.11506	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.02451	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	3.56565	—
			CVC3-SMT-COMP-2011 default	sat ✅	3.07977	—
			CVC3-SMT-COMP-2012 default	sat ✅	3.18129	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.22737	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.05813	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.04265	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.11162	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.11689	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.01886	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.01679	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.02276	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	0.17046	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.05652	—
			Z3-SMT-COMP-2011 default	sat ✅	0.11142	—
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	0.06806	0.05699
			Boolector boolectorj	sat ✅	0.06292	0.05199
		CVC4	CVC4 f7118b2 default	sat ✅	0.08404	0.07399
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.06291	0.05399
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.06037	0.12798
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.02706	0.02600
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.03114	0.02000
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.01239	0.00400
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.05781	0.04999
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.04002	0.03899
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.06958	0.06799
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.05439	0.05199
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.03605	0.03499
		Yices2	Yices default	sat ✅	0.00825	0.00400
		Z3	z3 4.4.0 default	sat ✅	0.13367	0.13398
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.05222	0.05249
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.04866	0.04914
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.02972	0.03068
		Yices2	Yices-2.4.2 default	sat ✅	0.01187	0.00510
		Z3	z3-4.4.1 default	sat ✅	0.11799	0.11943
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.04249	0.04197
		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.05467	0.05430
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.09767	0.03317
		Yices2	Yices2-Main default	sat ✅	0.00826	0.00488
		Z3	z3-4.5.0 default	sat ✅	0.11134	0.11070
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.06884	0.06874
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.05741	0.05765
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.02807	0.02907
		Yices2	Yices 2.6.0_default	sat ✅	0.01074	0.00808
		Z3	z3-4.7.1_default	sat ✅	0.12552	0.12539
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.02801	0.01725
			Poolector-wrapped-sq_default	sat ✅	0.17615	0.23056
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	0.04220	0.04254
		Par4	Par4-wrapped-sq_default	sat ✅	0.01775	0.00628
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.00945	0.00676
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.12898	0.12895
SMT-COMP 2025	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	0.29190	0.16316
		cvc5	cvc5	sat ✅	0.65855	0.53074
		SMTInterpol	SMTInterpol	unknown ❌	1201.48883	1242.08352
		Yices2	Yices2	sat ✅	0.29230	0.15779
		Z3	Z3-Owl-base	sat ✅	0.46292	0.33607
		Z3-Owl	Z3-Owl	sat ✅	0.85567	0.72588