Benchmark

non-incremental/QF_BV/sage/app7/bench_68.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3331460
Compressed Size	210944
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	3331452
Compressed Size	210952
Max. Term Depth	12801
Asserts	1
Declared Functions	0
Declared Constants	42
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	2214	and	1
=	2909	let	12696	extract	1617	bvand	34146
bvor	22407	bvxor	2082	bvadd	36763	bvmul	4
bvsub	11941	bvsdiv	10	bvult	517	bvule	562
bvslt	214	bvsle	122	bvshl	11740	bvashr	22016
zero_extend	1398

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.49878	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.51678	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.49960	—
			abziz_portfolio_2012_minfeatures default	unsat ✅	0.50109	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.50602	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.51203	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.67174	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.79387	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.70079	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	173.67400	—
			CVC3-SMT-COMP-2011 default	unsat ✅	146.82500	—
			CVC3-SMT-COMP-2012 default	unsat ✅	153.27900	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	2.85882	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	4.54879	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.99538	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.96011	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	1.24443	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	1.20392	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.86769	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	4.03201	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	6.16992	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	1.35104	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.52491	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.49845	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.52992	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.53892	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.50189	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.91804	0.91544
			Boolector SMT17 final boolector	unsat ✅	0.88679	0.88513
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.58241	7.38872
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.64716	0.64819
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	1.25266	1.25156
		Q3B	Q3B default	unsat ✅	0.83957	2.04000
		STP	stp_st default	unsat ✅	0.56528	1.11522
			stp_mt default	unsat ✅	0.57170	0.57155
		Yices2	Yices2-Main default	unsat ✅	0.36787	0.36318
		Z3	z3-4.5.0 default	unsat ✅	0.48408	0.48318
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.79354	0.79301
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	3.96807	3.96770
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.63713	0.63682
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	1.28135	1.28130
			Minkeyrink ST_st	unsat ✅	1.28314	1.28309
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.58474	0.58456
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.58736	0.58738
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.58960	0.58959
		Yices2	Yices 2.6.0_default	unsat ✅	0.38305	0.38129
		Z3	z3-4.7.1_default	unsat ✅	0.83074	0.82943
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.23950	1.23945
			Bitwuzla-wrapped_default	unsat ✅	1.47206	1.46767
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	4.19941	4.19940
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.67171	0.67168
		STP	STP 2022.4_default	unsat ✅	0.60713	0.60712
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.37294	0.37285
		Z3++BV	z3++bv_0702_default	unsat ✅	0.40757	0.40738
		Z3	z3-4.8.17_default	unsat ✅	0.41807	0.41995
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.89205	1.89197
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	3.05672	3.05509
		STP	STP 2022.4_default	unsat ✅	0.60474	0.60477
			STP 2022.4_default	unsat ✅	0.60267	0.60275
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1313.54000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.37587	0.37581
		Z3-Owl	z3-Owl-Final_default	unsat ✅	1.12954	1.08464
			z3-Owl-Final_default	unsat ✅	1.10380	1.10390
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	unsat ✅	0.95156	0.83269
			Bitwuzla-MachBV-base	unsat ✅	1.20755	1.07657
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	1.36888	1.24007
		BVDecide	bv_decide	unknown ❌	1201.39114	1201.04777
			bv_decide-nokernel	unknown ❌	1201.39004	1201.06397
		cvc5	cvc5	unsat ✅	0.82365	0.69461
		SMTInterpol	SMTInterpol	unknown ❌	1201.86731	1737.80841
		Yices2	Yices2	unsat ✅	0.48278	0.35853
		Z3alpha	Z3-alpha	unsat ✅	0.94526	0.92214
		Z3	Z3-alpha-base	unsat ✅	0.47593	0.36104
			Z3-Owl-base	unsat ✅	1.20326	1.09140
			z3siri-base	unsat ✅	0.51374	0.39079
		Z3-Owl	Z3-Owl	unsat ✅	1.01586	0.89705