Benchmark

non-incremental/QF_BV/Sage2/bench_13209.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	496987
Compressed Size	41834
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	496979
Compressed Size	41845
Max. Term Depth	29
Asserts	1330
Declared Functions	0
Declared Constants	1260
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	182	=	487	let	8549
extract	31	bvand	12	bvor	758	bvadd	4891
bvmul	730	bvult	85	bvule	41	bvugt	26
bvuge	112	bvslt	105	bvsle	181	bvsgt	87
bvsge	205	bvshl	798	bvlshr	44	zero_extend	1103

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	7.24078	7.09529
			Boolector SMT17 final boolector	sat ✅	23.91460	23.91210
		CVC4	CVC4-smtcomp2017-main default	sat ✅	41.72880	83.47280
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	49.54400	49.54160
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	3.08612	3.08337
		Q3B	Q3B default	unknown ❌	600.03300	1787.21000
		STP	stp_st default	sat ✅	21.26420	21.26250
			stp_mt default	sat ✅	26.74990	100.81200
		Yices2	Yices2-Main default	sat ✅	0.48784	0.48701
		Z3	z3-4.5.0 default	sat ✅	125.17000	125.16700
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.14431	2.14394
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	21.63140	21.63100
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	37.35270	37.35050
		MinkeyRink	Minkeyrink MT_mt	sat ✅	2.43971	5.59394
			Minkeyrink ST_st	sat ✅	2.05633	2.05602
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	51.14200	51.14130
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	44.69410	172.51600
			STP-Riss-st-2018_riss-no-stderr	sat ✅	19.64060	19.63900
		Yices2	Yices 2.6.0_default	sat ✅	0.67722	0.67715
		Z3	z3-4.7.1_default	sat ✅	180.00700	179.99800
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	11.87180	11.87090
			Poolector-wrapped-sq_default	sat ✅	9.58089	37.33000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	47.18980	47.19200
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	33.86540	33.86530
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	2.34053	6.38286
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.92858	1.92833
		Par4	Par4-wrapped-sq_default	sat ✅	0.67041	0.00586
		STP	STP-2019-wrapped-sq_default	sat ✅	50.98450	50.94910
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	18.26230	18.24910
			stp-minisat-wrapped-sq_default	sat ✅	13.10730	13.10670
			stp-mt-wrapped-sq_default	sat ✅	66.51710	258.29700
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	54.17930	87.84850
			stp-riss-wrapped-sq_default	unknown ❌	1.74401	1.74420
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.83843	0.83849
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.89735	1.89708
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	5.04813	5.04785
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	664.27500	664.14700
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	1.52086	1.52094
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	124.30800	124.26400
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	21.06270	21.06240
		MathSAT	mathsat-5.6.6_default	sat ✅	7.77461	7.77394
		STP	STP 2021.0_default	sat ✅	1.48405	3.11761
		Z3	z3-4.8.11_default	sat ✅	24.41540	24.41380
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	24.33650	24.33390
			Bitwuzla-wrapped_default	sat ✅	22.88740	22.88630
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	16.81380	16.81410
		MathSAT	MathSAT-5.6.8_default	sat ✅	47.58210	47.56730
		STP	STP 2022.4_default	sat ✅	1.42564	1.42536
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	2.71976	2.71947
		Z3++BV	z3++bv_0702_default	sat ✅	7.11941	7.11832
		Z3	z3-4.8.17_default	sat ✅	14.70920	14.70490
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	1.66672	1.56685
		cvc5	cvc5	sat ✅	26.74499	26.64471
		SMTInterpol	SMTInterpol	unknown ❌	1202.21882	1248.11880
		STP	STP	sat ✅	1.27526	1.17290
		Yices2	Yices2	sat ✅	1.21214	1.11196
		Z3alpha	Z3-alpha	sat ✅	44.48453	44.36587