Benchmark

non-incremental/QF_BV/sage/app7/bench_5.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3333780
Compressed Size	210905
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3333772
Compressed Size	210911
Max. Term Depth	12808
Asserts	1
Declared Functions	0
Declared Constants	42
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	2230	and	1
=	2930	let	12703	extract	1617	bvand	34146
bvor	22407	bvxor	2082	bvadd	36778	bvmul	5
bvsub	11943	bvsdiv	13	bvult	531	bvule	579
bvslt	215	bvsle	122	bvshl	11740	bvashr	22017
zero_extend	1398

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.49676	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.53937	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.53765	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.54901	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.53877	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.53991	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.66728	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.80199	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.70090	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	351.28800	—
			CVC3-SMT-COMP-2011 default	unsat ✅	293.97300	—
			CVC3-SMT-COMP-2012 default	unsat ✅	306.62400	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	2.85246	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	4.54463	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	1.00373	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.96309	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.24089	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	1.20982	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.86973	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	4.05672	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	6.16728	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.33837	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.52630	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.49779	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.53026	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.59004	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.53829	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	1.60815	0.99644
			Boolector SMT17 final boolector	unsat ✅	0.99107	0.95898
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.62646	7.31532
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.65365	0.64816
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.31765	1.31305
		Q3B	Q3B default	unsat ✅	0.84346	2.01000
		STP	stp_st default	unsat ✅	0.56206	0.56131
			stp_mt default	unsat ✅	0.56203	0.56123
		Yices2	Yices2-Main default	unsat ✅	0.36242	0.36197
		Z3	z3-4.5.0 default	unsat ✅	0.53051	0.52930
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.78236	0.78220
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	3.96983	3.97002
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.63704	0.63813
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.26876	1.26877
			Minkeyrink ST_st	unsat ✅	1.26720	1.26709
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.57900	0.57903
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.57635	0.57640
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.58412	0.57703
		Yices2	Yices 2.6.0_default	unsat ✅	0.36866	0.36860
		Z3	z3-4.7.1_default	unsat ✅	0.59113	0.59099
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	1.50183	1.50179
			Poolector-wrapped-sq_default	unsat ✅	1.79988	6.71945
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	1.21335	1.21340
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	4.13936	4.13962
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.89995	0.89996
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.89174	0.89173
		Par4	Par4-wrapped-sq_default	unsat ✅	0.37741	0.00676
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.62169	0.62187
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.61772	0.61785
			stp-minisat-wrapped-sq_default	unsat ✅	0.59031	0.59045
			stp-mt-wrapped-sq_default	unsat ✅	0.59263	0.59270
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.58648	0.58659
			stp-riss-wrapped-sq_default	unsat ✅	0.58980	0.58992
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.34638	0.34638
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.34229	0.34227
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.34228	0.34224
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.33828	0.33824
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.34072	0.34055
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.78375	0.78366
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.24759	1.24759
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.67023	0.67015
		STP	STP 2021.0_default	unsat ✅	0.56527	0.56533
		Z3	z3-4.8.11_default	unsat ✅	0.44319	0.44314