Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_true_functions_fse-bfs_vdir.rev_xstrcoll_atime.il.fse-bfs.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>

Benchmark
Size	4851
Compressed Size	858
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	4843
Compressed Size	845
Max. Term Depth	33
Asserts	1
Declared Functions	0
Declared Constants	6
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	4	=	5	let	14	concat	27
extract	19	bvnot	3	bvand	11	bvor	21
bvxor	3	bvadd	48	bvsub	7	bvshl	18
bvlshr	14	select	24	store	16

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.14 (6/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.05842	—
			Boolector-SMT-COMP-2011 default	sat ✅	0.16023	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.02924	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	1.02551	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.91743	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.03295	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.19509	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.27251	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.01532	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.02151	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.01840	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	0.62062	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.15393	—
			Z3-SMT-COMP-2011 default	sat ✅	0.40947	—
SMT-COMP 2014		Boolector	Boolector boolectord	sat ✅	0.19877	0.18897
			Boolector boolectorj	sat ✅	0.24275	0.23296
		CVC4	CVC4 f7118b2 default	sat ✅	1.22171	1.21181
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	sat ✅	0.17573	0.16597
			Kleaver-indie-more-typed kleaver_portfolio	sat ✅	0.08557	0.18997
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.03745	0.02899
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.02422	0.01300
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.01708	0.00800
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.06630	0.05599
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.05818	0.05699
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.40756	0.40594
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.03212	0.02899
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.03930	0.03799
		Yices2	Yices default	sat ✅	0.00914	0.00800
		Z3	z3 4.4.0 default	sat ✅	0.08812	0.08699
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.14601	0.14596
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.03503	0.03538
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.03328	0.03414
		Yices2	Yices-2.4.2 default	sat ✅	0.01456	0.01036
		Z3	z3-4.4.1 default	sat ✅	0.07663	0.07822
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.06912	0.06974
		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.03713	0.03637
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.03125	0.03133
		Yices2	Yices2-Main default	sat ✅	0.00982	0.01027
		Z3	z3-4.5.0 default	sat ✅	0.10014	0.09921
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.08822	0.08818
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.03547	0.03571
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.03114	0.03215
		Yices2	Yices 2.6.0_default	sat ✅	0.01165	0.01159
		Z3	z3-4.7.1_default	sat ✅	0.09024	0.09014
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.03400	0.03395
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.03199	0.03197
		CVC4	CVC4-sq-final_default	sat ✅	0.04001	0.04033
		MathSAT	MathSAT5_default.sh	sat ✅	0.09827	0.09821
		Par4	Par4-wrapped-sq_default	sat ✅	0.02610	0.00981
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.01846	0.01074
		Z3	z3-4.8.8_default	sat ✅	0.54592	0.54588
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	0.24638	0.14685
		cvc5	cvc5	sat ✅	1.04470	0.94454
		SMTInterpol	SMTInterpol	sat ✅	446.30372	484.32159
		Yices2	Yices2	sat ✅	0.21771	0.11829
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	0.30719	0.17350
		cvc5	cvc5	sat ✅	118.97979	118.82077
		SMTInterpol	SMTInterpol	sat ✅	632.48720	663.34414
		Yices2	Yices2	sat ✅	0.28015	0.15814
		Z3	Z3-Owl-base	sat ✅	1.00690	0.88754
		Z3-Owl	Z3-Owl	sat ✅	0.94782	0.81091