Benchmark

non-incremental/QF_BV/sage/app7/bench_3703.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3998174
Compressed Size	251641
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3998166
Compressed Size	251645
Max. Term Depth	15355
Asserts	1
Declared Functions	0
Declared Constants	45
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	11	not	2534	and	1
=	3304	let	15149	extract	1707	bvand	41041
bvor	27030	bvxor	2276	bvadd	44255	bvmul	7
bvsub	14618	bvsdiv	19	bvult	604	bvule	626
bvslt	219	bvsle	124	bvshl	14311	bvashr	26780
zero_extend	1511

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.63986	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.62916	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.63350	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.63265	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.64037	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.63638	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.79118	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.95911	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.83512	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	212.32800	—
			CVC3-SMT-COMP-2011 default	unsat ✅	179.50700	—
			CVC3-SMT-COMP-2012 default	unsat ✅	187.97400	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	3.41045	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	5.19758	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	1.18711	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	1.13841	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.48062	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	1.45010	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	1.03980	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	5.12083	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	7.38536	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.69497	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.67041	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.64775	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.63132	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.69776	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.62877	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	1.05711	1.05513
			Boolector SMT17 final boolector	unsat ✅	1.11501	1.11208
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	5.51561	8.94020
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.79983	0.80001
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.57529	1.56641
		Q3B	Q3B default	unsat ✅	1.01284	2.51000
		STP	stp_st default	unsat ✅	0.75919	0.75823
			stp_mt default	unsat ✅	0.67533	0.67467
		Yices2	Yices2-Main default	unsat ✅	0.43471	0.43374
		Z3	z3-4.5.0 default	unsat ✅	0.66349	0.66129
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.95752	0.95733
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	4.87431	4.87411
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.76372	0.76486
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.53882	1.53879
			Minkeyrink ST_st	unsat ✅	1.53996	1.53998
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.70541	0.70537
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.70981	0.70954
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.70251	0.70247
		Yices2	Yices 2.6.0_default	unsat ✅	0.44606	0.44443
		Z3	z3-4.7.1_default	unsat ✅	0.90967	0.90550
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.49211	1.49197
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.79848	0.79836
		STP	STP 2021.0_default	unsat ✅	0.72085	0.72089
		Z3	z3-4.8.11_default	unsat ✅	0.78755	0.78753
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	2.31590	2.31562
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	3.80558	3.80583
		STP	STP 2022.4_default	unsat ✅	0.76181	0.76174
			STP 2022.4_default	unsat ✅	0.76915	0.76920
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.14000	1326.44000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.43997	0.43983
		Z3-Owl	z3-Owl-Final_default	unsat ✅	1.46560	1.40502
			z3-Owl-Final_default	unsat ✅	1.40968	1.40961
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	1.40355	1.30342
		cvc5	cvc5	unsat ✅	0.86088	0.76123
		SMTInterpol	SMTInterpol	unknown ❌	1202.72146	1435.00065
		STP	STP	unsat ✅	53.12502	53.02066
		Yices2	Yices2	unsat ✅	0.51573	0.41529
		Z3alpha	Z3-alpha	unsat ✅	0.59174	0.49221
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	unsat ✅	1.09282	0.97113
			Bitwuzla-MachBV-base	unsat ✅	1.39340	1.25985
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	1.60833	1.47530
		BVDecide	bv_decide	unknown ❌	1201.36251	1201.04706
			bv_decide-nokernel	unknown ❌	1201.39107	1201.06672
		cvc5	cvc5	unsat ✅	1.40272	1.28467
		SMTInterpol	SMTInterpol	unknown ❌	1201.89187	1589.19511
		Yices2	Yices2	unsat ✅	0.53898	0.41330
		Z3alpha	Z3-alpha	unsat ✅	1.03163	1.03049
		Z3	Z3-alpha-base	unsat ✅	0.64289	0.52436
			Z3-Owl-base	unsat ✅	2.20119	2.07512
			z3siri-base	unsat ✅	0.69194	0.56228
		Z3-Owl	Z3-Owl	unsat ✅	1.27081	1.14623