Benchmark

non-incremental/QF_BV/sage/app7/bench_134.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3328569
Compressed Size	209987
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3328561
Compressed Size	209994
Max. Term Depth	12796
Asserts	1
Declared Functions	0
Declared Constants	42
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	2198	and	1
=	2890	let	12691	extract	1617	bvand	34146
bvor	22407	bvxor	2082	bvadd	36733	bvmul	3
bvsub	11937	bvsdiv	7	bvult	501	bvule	543
bvslt	213	bvsle	121	bvshl	11740	bvashr	22015
zero_extend	1398

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.50026	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.54042	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.54323	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.53970	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.54386	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.53860	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.66752	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.80465	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.69986	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	351.22900	—
			CVC3-SMT-COMP-2011 default	unsat ✅	293.78300	—
			CVC3-SMT-COMP-2012 default	unsat ✅	306.24600	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	2.86178	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	4.55422	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.99587	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.95369	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.23972	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	1.20792	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.87127	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	4.01432	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	6.16699	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.34679	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.52462	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.49706	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.52737	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.58724	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.54347	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.87507	0.87438
			Boolector SMT17 final boolector	unsat ✅	0.87347	0.87281
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.27329	6.85944
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.69383	0.69254
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.25057	1.24903
		Q3B	Q3B default	unsat ✅	0.89831	2.30000
		STP	stp_st default	unsat ✅	0.56335	0.56239
			stp_mt default	unsat ✅	0.56237	0.56232
		Yices2	Yices2-Main default	unsat ✅	0.36384	0.36259
		Z3	z3-4.5.0 default	unsat ✅	0.51077	0.51015
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.78726	0.78711
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	3.95810	3.95808
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.63743	0.63846
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.26259	1.26249
			Minkeyrink ST_st	unsat ✅	1.27006	1.27004
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.57558	0.57557
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.57680	0.57674
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.57808	0.57812
		Yices2	Yices 2.6.0_default	unsat ✅	0.36923	0.36909
		Z3	z3-4.7.1_default	unsat ✅	0.60602	0.60588
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.90921	1.90892
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	3.15095	3.13932
		STP	STP 2022.4_default	unsat ✅	0.60789	0.60788
			STP 2022.4_default	unsat ✅	0.60514	0.60512
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1313.39000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.37637	0.37632
		Z3-Owl	z3-Owl-Final_default	unsat ✅	1.31497	1.31479
			z3-Owl-Final_default	unsat ✅	1.31144	1.31108
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	1.18576	1.08537
		cvc5	cvc5	unsat ✅	1.00025	0.90128
		SMTInterpol	SMTInterpol	unknown ❌	1202.72343	1378.02734
		STP	STP	unsat ✅	33.64352	33.54213
		Yices2	Yices2	unsat ✅	0.48620	0.38661
		Z3alpha	Z3-alpha	unsat ✅	0.55470	0.45523
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	unsat ✅	0.99377	0.86275
			Bitwuzla-MachBV-base	unsat ✅	1.24514	1.12053
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	1.41747	1.28929
		BVDecide	bv_decide	unknown ❌	1201.38972	1201.03206
			bv_decide-nokernel	unknown ❌	1201.38969	1200.96411
		cvc5	cvc5	unsat ✅	1.25560	1.13851
		SMTInterpol	SMTInterpol	unknown ❌	1201.85893	1842.42011
		Yices2	Yices2	unsat ✅	0.46037	0.34347
		Z3alpha	Z3-alpha	unsat ✅	0.96876	0.95732
		Z3	Z3-alpha-base	unsat ✅	0.50212	0.38547
			Z3-Owl-base	unsat ✅	1.33452	1.21463
			z3siri-base	unsat ✅	0.54892	0.41757
		Z3-Owl	Z3-Owl	unsat ✅	1.05335	0.93347