Benchmark

non-incremental/QF_BV/sage/app12/bench_3425.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	63429
Compressed Size	8630
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	63421
Compressed Size	8642
Max. Term Depth	59
Asserts	1
Declared Functions	0
Declared Constants	348
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	43	not	266	and	1
=	472	let	49	bvor	164	bvadd	180
bvsub	248	bvult	177	bvule	158	bvslt	43
bvsle	44	bvshl	173	zero_extend	356

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	sat ✅	0.40661	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	sat ✅	0.30134	—
			abziz_portfolio_2011_solvers_2 default	sat ✅	0.29779	—
			abziz_portfolio_2012_minfeatures default	sat ✅	0.30053	—
			abziz_portfolio_2012_solvers default	sat ✅	0.30202	—
			AbzizPortfolio-SMT-COMP-2012 default	sat ✅	0.30452	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	4.85721	—
			Boolector-SMT-COMP-2011 default	sat ✅	2.47743	—
			Boolector-SMT-COMP-2012 default	sat ✅	1.47495	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	10.71110	—
			CVC3-SMT-COMP-2011 default	sat ✅	9.61687	—
			CVC3-SMT-COMP-2012 default	sat ✅	9.85253	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.28713	—
			CVC4-SMT-EVAL-2013 default	sat ✅	17.41510	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.62872	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	sat ✅	1.01574	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.49713	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.81616	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.12182	—
			SONOLAR-SMT-COMP-2010 default	sat ✅	1.45127	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.60340	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.12674	—
		STP	STP2-SMT-COMP-2011 default	sat ✅	0.09694	—
			STP2-SMT-COMP-2012 default	sat ✅	0.16149	—
			simplifyingSTP-SMT-COMP-2010 default	sat ✅	0.44798	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.32506	—
			Z3-SMT-COMP-2011 default	sat ✅	0.29721	—
SMT-COMP 2015		Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	4.29559	4.29635
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.66371	1.27581
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.76323	1.47778
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.84081	0.83987
		SMT-RAT	SMT-RAT-final default	sat ✅	178.44200	178.48000
		STP	stp-cryptominisat4 default	sat ✅	0.24670	0.24596
			stp-cmsat4-v15 default	sat ✅	0.25254	0.25196
			stp-cmsat4-mt-v15 default	unknown ❌	0.18250	0.15998
			stp-minisat-v15 default	sat ✅	0.20365	0.20297
		Yices2	Yices default	sat ✅	0.01973	0.01700
		Z3	z3 4.4.0 default	sat ✅	0.25320	0.25296
SMT-COMP 2016	0.10 (9/10)	ABC	ABC_default default_abc	sat ✅	38.75890	38.77850
			ABC_glucose glucose	sat ✅	5.13200	5.13425
		Boolector	Boolector boolector	sat ✅	3.79089	3.79001
			Boolector preprop boolector	sat ✅	3.70858	3.70878
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.63611	1.22691
		MapleSTP	MapleSTP default	sat ✅	0.12740	0.12762
			MapleSTP-mt default	sat ✅	0.14201	0.27323
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.69060	0.69194
		MinkeyRink	Minkeyrink 2016 default	sat ✅	0.27716	0.38086
		Q3B	Q3B default	unknown ❌	2400.02000	7202.75000
		STP	stp-cms-exp-2016 default	sat ✅	0.13221	0.13290
			stp-cms-mt-2016 default	sat ✅	0.14134	0.27687
			stp-cms-st-2016 default	sat ✅	0.12930	0.12932
			stp-minisat-st-2016 default	sat ✅	0.21129	0.21114
		Yices2	Yices-2.4.2 default	sat ✅	0.02055	0.02048
		Z3	z3-4.4.1 default	sat ✅	0.24176	0.24309
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	2.38119	2.38064
			Boolector SMT17 final boolector	sat ✅	5.87911	5.87594
		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.82603	1.60618
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.75907	0.75900
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.14045	0.12503
		Q3B	Q3B default	unknown ❌	600.04800	1786.92000
		STP	stp_st default	sat ✅	1.07941	1.07873
			stp_mt default	sat ✅	1.51632	3.39028
		Yices2	Yices2-Main default	sat ✅	0.02712	0.02653
		Z3	z3-4.5.0 default	sat ✅	0.46422	0.46310
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.56090	0.56085
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.84788	0.84788
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.68742	0.68829
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.09736	0.12292
			Minkeyrink ST_st	sat ✅	0.09325	0.09349
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.27374	0.27390
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.25726	0.37841
			STP-Riss-st-2018_riss-no-stderr	sat ✅	0.90676	0.90689
		Yices2	Yices 2.6.0_default	sat ✅	0.01872	0.01868
		Z3	z3-4.7.1_default	sat ✅	0.45563	0.45548