Benchmark

non-incremental/QF_BV/Sage2/bench_11754.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	552469
Compressed Size	16122
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	552461
Compressed Size	16111
Max. Term Depth	108
Asserts	453
Declared Functions	0
Declared Constants	253
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	78	=	90
let	11799	extract	5	bvand	3	bvor	7
bvadd	4098	bvmul	300	bvult	73	bvule	91
bvugt	9	bvuge	184	bvsle	2	bvsgt	2
bvsge	2	bvshl	3103	bvlshr	56	bvashr	6
zero_extend	4142

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	1.36642	1.36596
			Boolector SMT17 final boolector	sat ✅	6.84334	6.84362
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.47479	6.73332
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	26.00600	26.00220
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.03383	1.03342
		Q3B	Q3B default	unknown ❌	600.05700	1799.74000
		STP	stp_st default	sat ✅	1.80825	1.80800
			stp_mt default	sat ✅	2.41396	5.85946
		Yices2	Yices2-Main default	sat ✅	0.20166	0.20101
		Z3	z3-4.5.0 default	sat ✅	7.54204	7.54109
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.42651	0.42635
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	3.91619	3.91340
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	18.98920	37.90740
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.72218	1.74748
			Minkeyrink ST_st	sat ✅	0.64523	0.64513
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	1.55611	1.55604
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	1.84545	5.82525
			STP-Riss-st-2018_riss-no-stderr	sat ✅	2.12545	2.12410
		Yices2	Yices 2.6.0_default	sat ✅	0.08427	0.08421
		Z3	z3-4.7.1_default	sat ✅	20.44670	20.44390
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	2.22682	2.22675
			Poolector-wrapped-sq_default	sat ✅	1.29096	4.54000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	6.69591	6.69562
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	7.79720	7.79731
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.65274	1.57901
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.62621	0.62626
		Par4	Par4-wrapped-sq_default	sat ✅	0.19936	0.00612
		STP	STP-2019-wrapped-sq_default	sat ✅	1.27374	1.26994
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	10.89270	10.89220
			stp-minisat-wrapped-sq_default	sat ✅	1.46254	1.46277
			stp-mt-wrapped-sq_default	sat ✅	1.59722	4.65878
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	10.57060	12.64140
			stp-riss-wrapped-sq_default	unknown ❌	0.53693	0.53718
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.16720	0.16718
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.15250	0.15252
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.92826	0.92818
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.84000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.22625	0.22625
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	12.51590	12.51540
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.83605	0.83592
		Boolector	Boolector-wrapped-sq_default	sat ✅	2.07873	2.07865
			Poolector-wrapped-sq_default	sat ✅	1.19064	4.16194
		CVC4	CVC4-sq-final_default	sat ✅	7.51757	7.51767
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.03000	1199.87000
		MathSAT	MathSAT5_default.sh	sat ✅	61.49110	61.48240
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.41008	0.40702
			MinkeyRink Solver 2020.3_default	sat ✅	0.62517	1.48282
		STP	STP_default	sat ✅	0.58890	1.47927
			STP ++ Mergsat v1_default	sat ✅	0.52149	0.52303
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.31688	0.31670
		Z3	z3-4.8.8_default	sat ✅	12.30590	12.29990
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.70546	0.70433
			Bitwuzla-wrapped_default	sat ✅	2.18068	2.18043
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	7.99401	7.99370
		MathSAT	MathSAT-5.6.8_default	sat ✅	219.83900	219.71800
		STP	STP 2022.4_default	sat ✅	1.02638	1.02638
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.57133	0.57120
		Z3++BV	z3++bv_0702_default	sat ✅	0.85296	0.85268
		Z3	z3-4.8.17_default	sat ✅	2.20616	2.20787
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.95185	0.95181
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	7.64557	7.64521
		STP	STP 2022.4_default	sat ✅	0.53151	0.53153
			STP 2022.4_default	sat ✅	0.53858	0.53739
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	1031.35000	1080.27000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.15237	0.15220
		Z3-Owl	z3-Owl-Final_default	sat ✅	27.78550	27.78520
			z3-Owl-Final_default	sat ✅	28.56700	28.55930
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	1.66977	1.56976
		cvc5	cvc5	sat ✅	6.41496	6.31499
		SMTInterpol	SMTInterpol	sat ✅	21.95857	42.85982
		STP	STP	sat ✅	0.63193	0.53219
		Yices2	Yices2	sat ✅	0.42202	0.32222
		Z3alpha	Z3-alpha	sat ✅	4.33395	4.23417