Benchmark

non-incremental/QF_BV/sage/app7/bench_231.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3311949
Compressed Size	208720
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3311941
Compressed Size	208729
Max. Term Depth	12713
Asserts	1
Declared Functions	0
Declared Constants	42
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	2150	and	1
=	2836	let	12608	extract	1549	bvand	34128
bvor	22407	bvxor	1963	bvadd	36603	bvmul	2
bvsub	11906	bvsdiv	5	bvult	487	bvule	526
bvslt	212	bvsle	121	bvshl	11682	bvashr	21999
zero_extend	1312

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.48950	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.53700	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.53890	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.53923	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.54826	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.54360	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.65894	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.79384	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.69566	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	173.92700	—
			CVC3-SMT-COMP-2011 default	unsat ✅	147.04900	—
			CVC3-SMT-COMP-2012 default	unsat ✅	153.84600	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	2.83699	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	4.53409	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.99074	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.94677	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.23981	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.86696	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	3.95980	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	6.15326	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.33725	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.52038	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.49301	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.52560	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.58530	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.53103	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.87547	0.87453
			Boolector SMT17 final boolector	unsat ✅	0.86646	0.86339
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.21232	6.76520
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.64145	0.64073
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.25144	1.25051
		Q3B	Q3B default	unsat ✅	0.82250	2.01000
		STP	stp_st default	unsat ✅	0.58666	0.58622
			stp_mt default	unsat ✅	0.59984	0.59949
		Yices2	Yices2-Main default	unsat ✅	0.36552	0.36531
		Z3	z3-4.5.0 default	unsat ✅	0.50968	0.50919
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.78253	0.78234
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	3.93902	3.93892
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.63141	0.63246
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.26210	1.26216
			Minkeyrink ST_st	unsat ✅	1.26177	1.26161
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.57595	0.57591
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.57446	0.57453
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.57492	0.57494
		Yices2	Yices 2.6.0_default	unsat ✅	0.36621	0.36611
		Z3	z3-4.7.1_default	unsat ✅	0.54623	0.54593
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.23454	1.23444
		Boolector	Boolector-wrapped-sq_default	unsat ✅	1.50032	1.50038
			Poolector-wrapped-sq_default	unsat ✅	1.78115	6.57000
		CVC4	CVC4-sq-final_default	unsat ✅	5.39060	5.39125
		LazyBV2Int	LazyBV2Int20200523_default.sh	unsat ✅	0.78791	0.78779
		MathSAT	MathSAT5_default.sh	unsat ✅	0.65207	0.65198
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unsat ✅	0.74036	0.74047
			MinkeyRink Solver 2020.3_default	unsat ✅	0.76445	0.76447
		STP	STP_default	unsat ✅	0.53482	0.53487
			STP ++ Mergsat v1_default	unsat ✅	0.53617	0.53791
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.38125	0.38115
		Z3	z3-4.8.8_default	unsat ✅	0.54022	0.54013
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	1.25083	1.15070
		cvc5	cvc5	unsat ✅	0.77243	0.67291
		SMTInterpol	SMTInterpol	unknown ❌	1202.21671	1354.81524
		STP	STP	unsat ✅	33.18547	33.07705
		Yices2	Yices2	unsat ✅	0.46198	0.36204
		Z3alpha	Z3-alpha	unsat ✅	0.64815	0.54859
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	unsat ✅	0.98724	0.86242
			Bitwuzla-MachBV-base	unsat ✅	1.16551	1.04745
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	1.39432	1.26079
		BVDecide	bv_decide	unknown ❌	1201.38369	1201.02553
			bv_decide-nokernel	unknown ❌	1201.38774	1201.01490
		cvc5	cvc5	unsat ✅	0.73092	0.60470
		SMTInterpol	SMTInterpol	unknown ❌	1201.87424	1833.63512
		Yices2	Yices2	unsat ✅	0.50037	0.37343
		Z3alpha	Z3-alpha	unsat ✅	0.94807	0.93517
		Z3	Z3-alpha-base	unsat ✅	0.52349	0.39740
			Z3-Owl-base	unsat ✅	1.20238	1.08679
			z3siri-base	unsat ✅	0.51601	0.38943
		Z3-Owl	Z3-Owl	unsat ✅	1.02393	0.90006