Benchmark

non-incremental/QF_BV/sage/app1/bench_47.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	62568
Compressed Size	8472
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	62560
Compressed Size	8465
Max. Term Depth	126
Asserts	1
Declared Functions	0
Declared Constants	285
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	54	not	68	and	1
=	170	let	116	extract	1	bvand	30
bvor	171	bvadd	320	bvmul	5	bvsub	164
bvult	195	bvule	429	bvslt	1	bvsle	22
bvshl	172	bvashr	5	zero_extend	282

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.56 (4/9)	4Simp	4Simp-SMT-COMP-2012 default	unknown ❌	—	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unknown ❌	—	—
			abziz_portfolio_2011_solvers_2 default	unknown ❌	—	—
			abziz_portfolio_2012_minfeatures default	unknown ❌	—	—
			abziz_portfolio_2012_solvers default	sat ✅	3.72559	—
			AbzizPortfolio-SMT-COMP-2012 default	unknown ❌	—	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unknown ❌	—	—
			Boolector-SMT-COMP-2011 default	sat ✅	3.43025	—
			Boolector-SMT-COMP-2012 default	unknown ❌	—	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	1.18704	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2010 default	sat ✅	1.71892	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.68225	—
		STP	STP2-SMT-COMP-2011 default	unknown ❌	—	—
			STP2-SMT-COMP-2012 default	unknown ❌	—	—
			simplifyingSTP-SMT-COMP-2010 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2015		Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	1.50062	1.49977
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	4.26316	8.49271
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	4.15864	8.28774
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1.89110	1.89071
		SMT-RAT	SMT-RAT-final default	sat ✅	253.46400	253.56800
		STP	stp-cryptominisat4 default	sat ✅	5.47557	5.47617
			stp-cmsat4-v15 default	sat ✅	11.32440	11.32630
			stp-cmsat4-mt-v15 default	unknown ❌	0.43058	0.42893
			stp-minisat-v15 default	sat ✅	5.84253	5.84211
		Yices2	Yices default	sat ✅	0.09820	0.09698
		Z3	z3 4.4.0 default	sat ✅	4.08591	4.08238
SMT-COMP 2016	0.10 (9/10)	ABC	ABC_default default_abc	sat ✅	0.84825	0.84819
			ABC_glucose glucose	sat ✅	9.32730	9.31671
		Boolector	Boolector boolector	sat ✅	2.79047	2.79244
			Boolector preprop boolector	sat ✅	2.79512	2.79666
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	3.05169	6.07586
		MapleSTP	MapleSTP default	sat ✅	3.79448	3.79663
			MapleSTP-mt default	sat ✅	2.73989	9.47780
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.86354	1.86579
		MinkeyRink	Minkeyrink 2016 default	sat ✅	2.14170	3.96435
		Q3B	Q3B default	unknown ❌	2400.03000	7203.09000
		STP	stp-cms-exp-2016 default	sat ✅	55.11390	55.14570
			stp-cms-mt-2016 default	sat ✅	9.59296	36.91900
			stp-cms-st-2016 default	sat ✅	12.05300	12.06100
			stp-minisat-st-2016 default	sat ✅	8.87961	8.88549
		Yices2	Yices-2.4.2 default	sat ✅	0.11361	0.11366
		Z3	z3-4.4.1 default	sat ✅	3.27371	3.27676
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.83165	0.83109
			Boolector SMT17 final boolector	sat ✅	3.10656	3.10479
		CVC4	CVC4-smtcomp2017-main default	sat ✅	4.45282	8.86980
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.03514	1.03501
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.05436	1.03712
		Q3B	Q3B default	unknown ❌	600.08800	1799.64000
		STP	stp_st default	sat ✅	12.37350	12.25250
			stp_mt default	sat ✅	11.62900	44.63950
		Yices2	Yices2-Main default	sat ✅	0.17806	0.17686
		Z3	z3-4.5.0 default	sat ✅	5.72707	5.72581
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.22692	0.22680
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	4.85486	4.85453
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	1.70080	1.70151
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.78152	2.27635
			Minkeyrink ST_st	sat ✅	0.71283	0.71143
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	11.96730	11.96750
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	6.36519	20.81190
			STP-Riss-st-2018_riss-no-stderr	sat ✅	4.49359	4.49355
		Yices2	Yices 2.6.0_default	sat ✅	0.14799	0.14793
		Z3	z3-4.7.1_default	sat ✅	5.70791	5.70807
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.55747	0.55732
			Bitwuzla-wrapped_default	sat ✅	0.46662	0.46655
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	6.77611	6.77610
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.63249	0.63239
		STP	STP 2022.4_default	sat ✅	0.32584	0.32584
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.36400	0.36392
		Z3++BV	z3++bv_0702_default	sat ✅	0.65776	0.65766
		Z3	z3-4.8.17_default	sat ✅	1.69536	1.69696
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.90941	0.90887
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	3.86480	3.86277
		STP	STP 2022.4_default	sat ✅	0.34544	0.34545
			STP 2022.4_default	sat ✅	0.34430	0.34429
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1253.17000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.12528	0.12524
		Z3-Owl	z3-Owl-Final_default	sat ✅	17.17370	17.17230
			z3-Owl-Final_default	sat ✅	19.40030	19.39850
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	0.49892	0.38415
			Bitwuzla-MachBV-base	sat ✅	0.46693	0.34320
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.59395	0.47232
		BVDecide	bv_decide	sat ✅	5.96748	5.83109
			bv_decide-nokernel	sat ✅	5.51657	5.37841
		cvc5	cvc5	sat ✅	2.75013	2.63019
		SMTInterpol	SMTInterpol	unknown ❌	1201.59531	1226.33466
		Yices2	Yices2	sat ✅	0.80436	0.68756
		Z3alpha	Z3-alpha	sat ✅	5.52013	19.28987
		Z3	Z3-alpha-base	sat ✅	3.15442	3.02827
			Z3-Owl-base	sat ✅	12.72868	12.61264
			z3siri-base	sat ✅	3.13673	3.02074
		Z3-Owl	Z3-Owl	sat ✅	8.40539	8.27875