Benchmark

non-incremental/QF_BV/sage/app1/bench_2598.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	64214
Compressed Size	8843
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	64206
Compressed Size	8857
Max. Term Depth	132
Asserts	1
Declared Functions	0
Declared Constants	285
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	56	not	69	and	1
=	175	let	122	extract	1	bvand	32
bvor	171	bvadd	331	bvmul	5	bvsub	173
bvult	199	bvule	449	bvslt	1	bvsle	27
bvshl	172	bvashr	5	zero_extend	284

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	1.00 (0/9)	4Simp	4Simp-SMT-COMP-2012 default	unknown ❌	—	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unknown ❌	—	—
			abziz_portfolio_2011_solvers_2 default	unknown ❌	—	—
			abziz_portfolio_2012_minfeatures default	unknown ❌	—	—
			abziz_portfolio_2012_solvers default	unknown ❌	—	—
			AbzizPortfolio-SMT-COMP-2012 default	unknown ❌	—	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unknown ❌	—	—
			Boolector-SMT-COMP-2011 default	unknown ❌	—	—
			Boolector-SMT-COMP-2012 default	unknown ❌	—	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2010 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		STP	STP2-SMT-COMP-2011 default	unknown ❌	—	—
			STP2-SMT-COMP-2012 default	unknown ❌	—	—
			simplifyingSTP-SMT-COMP-2010 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unknown ❌	—	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2015		Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	1.44784	1.44778
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	4.32436	8.61669
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	7.36843	14.72380
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1.41924	1.41878
		SMT-RAT	SMT-RAT-final default	sat ✅	280.36800	280.42900
		STP	stp-cryptominisat4 default	sat ✅	12.20270	12.20710
			stp-cmsat4-v15 default	sat ✅	32.03600	32.04010
			stp-cmsat4-mt-v15 default	unknown ❌	0.41478	0.41394
			stp-minisat-v15 default	sat ✅	2.69683	2.69659
		Yices2	Yices default	sat ✅	0.15597	0.15498
		Z3	z3 4.4.0 default	sat ✅	3.79413	3.79542
SMT-COMP 2016	0.10 (9/10)	ABC	ABC_default default_abc	sat ✅	1.06207	1.06239
			ABC_glucose glucose	sat ✅	9.90983	9.91618
		Boolector	Boolector boolector	sat ✅	1.52791	1.52877
			Boolector preprop boolector	sat ✅	1.54969	1.55055
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	6.10431	12.19350
		MapleSTP	MapleSTP default	sat ✅	46.82880	46.83440
			MapleSTP-mt default	sat ✅	3.55919	12.80780
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.46633	1.46836
		MinkeyRink	Minkeyrink 2016 default	sat ✅	2.15241	4.30472
		Q3B	Q3B default	unknown ❌	2400.03000	7203.04000
		STP	stp-cms-exp-2016 default	sat ✅	88.23340	88.29230
			stp-cms-mt-2016 default	sat ✅	20.81790	81.05200
			stp-cms-st-2016 default	sat ✅	23.61990	23.63340
			stp-minisat-st-2016 default	sat ✅	26.68370	26.69880
		Yices2	Yices-2.4.2 default	sat ✅	0.13307	0.13380
		Z3	z3-4.4.1 default	sat ✅	3.63727	3.64061
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.75256	0.75130
			Boolector SMT17 final boolector	sat ✅	1.61724	1.61612
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.87007	7.60797
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.19808	1.19784
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.83069	0.79781
		Q3B	Q3B default	unknown ❌	600.06200	1786.46000
		STP	stp_st default	sat ✅	11.28120	11.28080
			stp_mt default	sat ✅	9.98497	38.18220
		Yices2	Yices2-Main default	sat ✅	0.12540	0.12030
		Z3	z3-4.5.0 default	sat ✅	7.74515	7.74448
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.31839	0.31829
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	3.66416	3.66420
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	1.66878	1.66968
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.86024	2.62482
			Minkeyrink ST_st	sat ✅	0.78423	0.78414
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	4.90137	4.89979
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	8.86495	26.62000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	5.22623	5.22643
		Yices2	Yices 2.6.0_default	sat ✅	0.11592	0.11581
		Z3	z3-4.7.1_default	sat ✅	4.21346	4.21298
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.47936	0.47937
			Poolector-wrapped-sq_default	sat ✅	0.38365	0.38620
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	1.45065	1.45058
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	6.24239	6.24262
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.53298	1.39232
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.53769	0.53776
		Par4	Par4-wrapped-sq_default	sat ✅	0.11640	0.00599
		STP	STP-2019-wrapped-sq_default	sat ✅	5.68731	5.68758
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	12.51000	12.51000
			stp-minisat-wrapped-sq_default	sat ✅	1.46052	1.46055
			stp-mt-wrapped-sq_default	sat ✅	12.76070	49.30120
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	13.42570	20.33080
			stp-riss-wrapped-sq_default	unknown ❌	0.46134	0.46153
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.11564	0.11565
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.27969	1.27969
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	1.02711	1.02709
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	1.18350	1.18340
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.32790	0.32771
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	2.31145	2.31125
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.42672	0.42663
		MathSAT	mathsat-5.6.6_default	sat ✅	0.47241	0.47231
		STP	STP 2021.0_default	sat ✅	0.34838	0.72869
		Z3	z3-4.8.11_default	sat ✅	4.46423	4.46348
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	0.54852	0.44869
		cvc5	cvc5	sat ✅	5.93924	5.83935
		SMTInterpol	SMTInterpol	unknown ❌	1201.71551	1235.90698
		STP	STP	sat ✅	0.45405	0.35400
		Yices2	Yices2	sat ✅	0.45312	0.35335
		Z3alpha	Z3-alpha	sat ✅	3.62171	3.52185