Benchmark

non-incremental/QF_BV/sage/app7/bench_400.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3273557
Compressed Size	205601
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3273549
Compressed Size	205609
Max. Term Depth	12478
Asserts	1
Declared Functions	0
Declared Constants	42
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	2023	and	1
=	2695	let	12373	extract	1435	bvand	33987
bvor	22378	bvxor	1749	bvadd	36229	bvmul	2
bvsub	11845	bvsdiv	3	bvult	483	bvule	519
bvslt	211	bvsle	121	bvshl	11571	bvashr	21883
zero_extend	1158

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.49449	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.49652	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.50251	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.49398	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.49822	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.49274	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.66339	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.79025	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.70278	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	172.77100	—
			CVC3-SMT-COMP-2011 default	unsat ✅	146.10100	—
			CVC3-SMT-COMP-2012 default	unsat ✅	152.86600	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	2.81422	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	4.47308	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.97546	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.94326	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.21489	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	1.18604	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.85191	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	3.94241	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	6.11013	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.33155	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.51530	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.48808	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.51615	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.51929	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.48959	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.91004	0.90918
			Boolector SMT17 final boolector	unsat ✅	0.88720	0.88512
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.60763	7.39331
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.63786	0.63774
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.29653	1.29562
		Q3B	Q3B default	unsat ✅	0.82733	2.02000
		STP	stp_st default	unsat ✅	0.58277	0.58208
			stp_mt default	unsat ✅	0.59144	0.59031
		Yices2	Yices2-Main default	unsat ✅	0.37076	0.36634
		Z3	z3-4.5.0 default	unsat ✅	0.67121	0.67039
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.77648	0.77638
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	3.87651	3.87676
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.62167	0.62270
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.25828	1.25825
			Minkeyrink ST_st	unsat ✅	1.25872	1.25875
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.57296	0.57298
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.57203	0.57207
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.57172	0.57169
		Yices2	Yices 2.6.0_default	unsat ✅	0.36068	0.36061
		Z3	z3-4.7.1_default	unsat ✅	0.54340	0.54329
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.22066	1.22059
		Boolector	Boolector-wrapped-sq_default	unsat ✅	1.53217	1.53219
			Poolector-wrapped-sq_default	unsat ✅	1.78415	6.71000
		CVC4	CVC4-sq-final_default	unsat ✅	5.31210	5.31221
		LazyBV2Int	LazyBV2Int20200523_default.sh	unsat ✅	0.78792	0.78784
		MathSAT	MathSAT5_default.sh	unsat ✅	0.64310	0.64306
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unsat ✅	0.72692	0.72698
			MinkeyRink Solver 2020.3_default	unsat ✅	0.75116	0.75108
		STP	STP_default	unsat ✅	0.53958	0.53969
			STP ++ Mergsat v1_default	unsat ✅	0.53582	0.53755
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.37886	0.37880
		Z3	z3-4.8.8_default	unsat ✅	0.46775	0.46761
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.20559	1.20559
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.65987	0.65981
		STP	STP 2021.0_default	unsat ✅	0.56128	0.56139
		Z3	z3-4.8.11_default	unsat ✅	0.63665	0.63647
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.20890	1.20875
			Bitwuzla-wrapped_default	unsat ✅	1.29951	1.29880
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	4.03113	4.03052
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.66129	0.66120
		STP	STP 2022.4_default	unsat ✅	0.59813	0.59810
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.37805	0.37800
		Z3++BV	z3++bv_0702_default	unsat ✅	0.49642	0.49631
		Z3	z3-4.8.17_default	unsat ✅	0.48446	0.48631