Benchmark

non-incremental/QF_BV/sage/app2/bench_588.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	263422
Compressed Size	33627
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	263414
Compressed Size	33617
Max. Term Depth	768
Asserts	1
Declared Functions	0
Declared Constants	970
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	32	ite	1	not	221	and	1
=	386	let	648	extract	163	bvand	1351
bvor	46	bvxor	60	bvadd	2709	bvmul	22
bvsub	1791	bvsdiv	22	bvult	121	bvule	248
bvslt	159	bvsle	61	bvshl	1623	bvashr	862
zero_extend	1104

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.11 (8/9)	4Simp	4Simp-SMT-COMP-2012 default	sat ✅	0.03670	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	sat ✅	0.08918	—
			abziz_portfolio_2011_solvers_2 default	sat ✅	0.08899	—
			abziz_portfolio_2012_minfeatures default	sat ✅	0.08979	—
			abziz_portfolio_2012_solvers default	sat ✅	0.09919	—
			AbzizPortfolio-SMT-COMP-2012 default	sat ✅	0.09449	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.03700	—
			Boolector-SMT-COMP-2011 default	sat ✅	0.05418	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.04381	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	0.77543	—
			CVC3-SMT-COMP-2011 default	sat ✅	0.67791	—
			CVC3-SMT-COMP-2012 default	sat ✅	0.68450	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	226.94400	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	869.50900	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.10284	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	sat ✅	0.08880	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	2.50950	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.11075	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.30181	—
			SONOLAR-SMT-COMP-2010 default	sat ✅	2.62906	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.33556	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.28083	—
		STP	STP2-SMT-COMP-2011 default	sat ✅	0.19648	—
			STP2-SMT-COMP-2012 default	sat ✅	0.03574	—
			simplifyingSTP-SMT-COMP-2010 default	sat ✅	0.03723	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.07877	—
			Z3-SMT-COMP-2011 default	sat ✅	0.09027	—
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.05487	0.05402
			Boolector SMT17 final boolector	unsat ✅	0.05796	0.05713
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	2.53235	4.93088
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.07346	0.07258
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.15903	0.15764
		Q3B	Q3B default	unsat ✅	0.30826	0.65392
		STP	stp_st default	unsat ✅	0.04402	0.04284
			stp_mt default	unsat ✅	0.04370	0.04293
		Yices2	Yices2-Main default	unsat ✅	0.02508	0.02445
		Z3	z3-4.5.0 default	unsat ✅	0.14696	0.14433
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.05951	0.05943
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.49265	1.49254
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.07231	0.07342
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.15621	0.15624
			Minkeyrink ST_st	unsat ✅	0.15708	0.15711
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.10761	0.10761
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.11054	0.11058
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.10722	0.10730
		Yices2	Yices 2.6.0_default	unsat ✅	0.02609	0.02603
		Z3	z3-4.7.1_default	unsat ✅	0.18914	0.18906
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08467	0.08464
		MathSAT	mathsat-5.6.6_default	unsat ✅	2.92670	2.92666
		STP	STP 2021.0_default	unsat ✅	0.04580	0.04591
		Z3	z3-4.8.11_default	unsat ✅	0.03812	0.03807
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08593	0.08590
			Bitwuzla-wrapped_default	unsat ✅	0.08919	0.08907
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	1.42462	1.42512
		MathSAT	MathSAT-5.6.8_default	unsat ✅	3.30570	3.30552
		STP	STP 2022.4_default	unsat ✅	0.04422	0.04327
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.02934	0.02924
		Z3++BV	z3++bv_0702_default	unsat ✅	47.42340	47.42090
		Z3	z3-4.8.17_default	unsat ✅	0.16561	0.16635
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.12086	0.12082
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	1.42723	1.42768
		STP	STP 2022.4_default	unsat ✅	0.04322	0.04324
			STP 2022.4_default	unsat ✅	0.04357	0.04352
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unsat ✅	10.75660	31.89820
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.02826	0.02825
		Z3-Owl	z3-Owl-Final_default	unsat ✅	0.78104	0.78100
			z3-Owl-Final_default	unsat ✅	0.78880	0.78905