Benchmark

non-incremental/QF_BV/sage/app2/bench_614.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	219496
Compressed Size	28122
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	219488
Compressed Size	27793
Max. Term Depth	618
Asserts	1
Declared Functions	0
Declared Constants	760
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	31	ite	1	not	211	and	1
=	375	let	583	extract	163	bvand	1104
bvor	40	bvxor	60	bvadd	2160	bvmul	22
bvsub	1455	bvsdiv	22	bvult	120	bvule	248
bvslt	158	bvsle	58	bvshl	1286	bvashr	701
zero_extend	894

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.22 (7/9)	4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.03176	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unknown ❌	—	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.18516	—
			abziz_portfolio_2012_minfeatures default	unknown ❌	—	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.18484	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.18532	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unknown ❌	—	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.04569	—
			Boolector-SMT-COMP-2012 default	unknown ❌	—	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.17686	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.15956	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	881.37000	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	2.52193	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.23268	—
		STP	STP2-SMT-COMP-2011 default	unknown ❌	—	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.03102	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.03251	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.17974	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.04946	0.04803
			Boolector SMT17 final boolector	unsat ✅	0.05667	0.05555
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	1.85069	3.58508
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.06457	0.06500
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.13001	0.12918
		Q3B	Q3B default	unsat ✅	0.25784	0.48671
		STP	stp_st default	unsat ✅	0.04309	0.03850
			stp_mt default	unsat ✅	0.03746	0.03668
		Yices2	Yices2-Main default	unsat ✅	0.03011	0.02241
		Z3	z3-4.5.0 default	unsat ✅	0.06255	0.06125
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.05031	0.05027
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.10793	1.10785
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.06214	0.06323
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.13210	0.13218
			Minkeyrink ST_st	unsat ✅	0.13173	0.13172
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.08502	0.08510
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.08506	0.08507
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.08579	0.08578
		Yices2	Yices 2.6.0_default	unsat ✅	0.02301	0.02292
		Z3	z3-4.7.1_default	unsat ✅	0.11673	0.11667
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.08796	0.08792
			Poolector-wrapped-sq_default	unsat ✅	0.17978	0.28471
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.08016	0.08008
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.93237	0.93259
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.19004	0.19006
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.19096	0.19100
		Par4	Par4-wrapped-sq_default	unsat ✅	0.03628	0.00675
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.04343	0.04357
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.04393	0.04406
			stp-minisat-wrapped-sq_default	unsat ✅	0.04323	0.04336
			stp-mt-wrapped-sq_default	unsat ✅	0.04341	0.04352
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.04304	0.04320
			stp-riss-wrapped-sq_default	unsat ✅	0.04298	0.04315
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.02322	0.02321
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.02149	0.02144
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.02330	0.02331
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.02279	0.02280
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.02326	0.02326
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.13077	0.13072