Benchmark

non-incremental/QF_BV/sage/app9/bench_3138.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	43679
Compressed Size	7876
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	43671
Compressed Size	7888
Max. Term Depth	131
Asserts	1
Declared Functions	0
Declared Constants	155
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	2	not	143	and	1
=	210	let	121	extract	3	bvand	9
bvor	63	bvadd	393	bvmul	11	bvsub	114
bvult	117	bvule	278	bvslt	6	bvsle	11
bvshl	71	zero_extend	147	sign_extend	1

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.22 (7/9)	4Simp	4Simp-SMT-COMP-2012 default	unknown ❌	—	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	sat ✅	0.55128	—
			abziz_portfolio_2011_solvers_2 default	sat ✅	0.54444	—
			abziz_portfolio_2012_minfeatures default	sat ✅	0.54612	—
			abziz_portfolio_2012_solvers default	sat ✅	0.56680	—
			AbzizPortfolio-SMT-COMP-2012 default	sat ✅	0.55172	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.15403	—
			Boolector-SMT-COMP-2011 default	unknown ❌	—	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.07149	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.38962	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.48614	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.14411	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	sat ✅	0.22299	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.12713	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.12675	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.20763	—
			SONOLAR-SMT-COMP-2010 default	sat ✅	0.71955	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.52776	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.26622	—
		STP	STP2-SMT-COMP-2011 default	sat ✅	0.18375	—
			STP2-SMT-COMP-2012 default	sat ✅	0.28310	—
			simplifyingSTP-SMT-COMP-2010 default	sat ✅	0.51095	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.52815	—
			Z3-SMT-COMP-2011 default	sat ✅	0.54753	—
SMT-COMP 2015		Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	0.49691	0.49392
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.63828	1.23881
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.65315	1.26881
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.35185	0.35095
		SMT-RAT	SMT-RAT-final default	sat ✅	96.54490	96.57130
		STP	stp-cryptominisat4 default	sat ✅	0.24139	0.23996
			stp-cmsat4-v15 default	sat ✅	0.28980	0.28896
			stp-cmsat4-mt-v15 default	unknown ❌	0.21316	0.21197
			stp-minisat-v15 default	sat ✅	0.20771	0.20697
		Yices2	Yices default	sat ✅	0.03514	0.03399
		Z3	z3 4.4.0 default	sat ✅	0.64245	0.64290
SMT-COMP 2016	0.10 (9/10)	ABC	ABC_default default_abc	sat ✅	0.59025	0.58984
			ABC_glucose glucose	sat ✅	4.11119	4.11325
		Boolector	Boolector boolector	sat ✅	1.25542	1.25610
			Boolector preprop boolector	sat ✅	2.52896	2.53032
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.63315	1.23173
		MapleSTP	MapleSTP default	sat ✅	0.29163	0.29178
			MapleSTP-mt default	sat ✅	0.63386	1.41178
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.27505	0.27629
		MinkeyRink	Minkeyrink 2016 default	sat ✅	1.29619	1.86079
		Q3B	Q3B default	unknown ❌	2400.05000	7203.78000
		STP	stp-cms-exp-2016 default	sat ✅	0.35453	0.35469
			stp-cms-mt-2016 default	sat ✅	0.33268	0.76727
			stp-cms-st-2016 default	sat ✅	0.31950	0.31963
			stp-minisat-st-2016 default	sat ✅	0.28963	0.28972
		Yices2	Yices-2.4.2 default	sat ✅	0.05427	0.05420
		Z3	z3-4.4.1 default	sat ✅	0.59994	0.59278
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.20662	0.20508
			Boolector SMT17 final boolector	sat ✅	1.12614	1.12603
		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.74754	1.43799
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.39855	0.38830
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.44185	0.43679
		Q3B	Q3B default	unknown ❌	600.05800	1425.07000
		STP	stp_st default	sat ✅	0.44630	0.44556
			stp_mt default	sat ✅	0.59349	1.22251
		Yices2	Yices2-Main default	sat ✅	0.02367	0.02261
		Z3	z3-4.5.0 default	sat ✅	0.82686	0.82602
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.16947	0.16937
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.70095	0.70093
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.30532	0.30640
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.28403	0.46516
			Minkeyrink ST_st	sat ✅	0.26682	0.26697
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.31112	0.31107
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.33655	0.71169
			STP-Riss-st-2018_riss-no-stderr	sat ✅	0.86965	0.86972
		Yices2	Yices 2.6.0_default	sat ✅	0.03098	0.03092
		Z3	z3-4.7.1_default	sat ✅	0.73066	0.73054