Benchmark

non-incremental/QF_BV/Sage2/bench_4980.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1950099
Compressed Size	11483
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1950091
Compressed Size	11473
Max. Term Depth	481
Asserts	325
Declared Functions	0
Declared Constants	94
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	1	not	103	=	132
let	46020	extract	8	bvand	4	bvor	2
bvadd	23193	bvmul	5882	bvudiv	80	bvult	10
bvule	47	bvugt	1	bvuge	96	bvsle	19
bvsgt	2	bvsge	18	bvshl	3	bvlshr	26
zero_extend	16717

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	35.92530	35.92230
			Boolector SMT17 final boolector	unknown ❌	600.04700	599.85000
		CVC4	CVC4-smtcomp2017-main default	sat ✅	80.93050	161.73200
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	27.09640	27.08530
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.45516	1.45188
		Q3B	Q3B default	unknown ❌	600.04600	1201.14000
		STP	stp_st default	sat ✅	206.34100	206.32800
			stp_mt default	sat ✅	142.38800	557.99400
		Yices2	Yices2-Main default	sat ✅	0.26010	0.25884
		Z3	z3-4.5.0 default	sat ✅	139.61400	139.61500
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	1.02991	1.02958
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	7.88464	7.88409
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	21.08130	21.08140
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.06375	2.19018
			Minkeyrink ST_st	sat ✅	0.99972	0.99984
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	1019.49000	1019.42000
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	91.89490	359.22600
			STP-Riss-st-2018_riss-no-stderr	sat ✅	915.21600	915.12300
		Yices2	Yices 2.6.0_default	sat ✅	0.24046	0.24040
		Z3	z3-4.7.1_default	sat ✅	79.80960	79.81070
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	7.34129	7.33712
			Poolector-wrapped-sq_default	sat ✅	8.88054	34.72000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	374.59300	374.50800
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	4.45096	4.45145
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	1.47460	2.85184
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.32029	1.32039
		Par4	Par4-wrapped-sq_default	sat ✅	0.25917	0.00589
		STP	STP-2019-wrapped-sq_default	sat ✅	462.96800	462.88400
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	424.32400	424.25600
			stp-minisat-wrapped-sq_default	sat ✅	880.41500	880.27300
			stp-mt-wrapped-sq_default	sat ✅	450.76500	1762.57000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	929.63000	1954.42000
			stp-riss-wrapped-sq_default	unknown ❌	2.17347	2.17375
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.25186	0.25183
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.31102	0.31100
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	1.70237	1.70217
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.01000	2399.64000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.31357	0.31361
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	73.63390	73.63630
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.08120	14.08110
		MathSAT	mathsat-5.6.6_default	sat ✅	13.68240	13.68090
		STP	STP 2021.0_default	sat ✅	1.24534	2.58776
		Z3	z3-4.8.11_default	sat ✅	67.87050	67.85850
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	12.78400	12.78270
			Bitwuzla-wrapped_default	sat ✅	12.95270	12.95220
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	11.54010	11.53930
		MathSAT	MathSAT-5.6.8_default	sat ✅	10.23350	10.23270
		STP	STP 2022.4_default	sat ✅	2.26179	2.25674
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.32997	0.32984
		Z3++BV	z3++bv_0702_default	sat ✅	12.14240	12.14060
		Z3	z3-4.8.17_default	sat ✅	158.69900	158.69200
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.53124	1.53120
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	8.29546	8.29418
		STP	STP 2022.4_default	sat ✅	0.60439	0.60419
			STP 2022.4_default	sat ✅	0.61446	0.61443
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	6.21735	18.45570
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.29431	0.29426
		Z3-Owl	z3-Owl-Final_default	sat ✅	1079.55000	1079.47000
			z3-Owl-Final_default	sat ✅	550.11000	550.01500
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	0.47583	0.35223
			Bitwuzla-MachBV-base	sat ✅	0.90427	0.77615
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	1.45015	1.32956
		BVDecide	bv_decide	sat ✅	36.44750	36.28621
			bv_decide-nokernel	sat ✅	36.62442	36.49543
		cvc5	cvc5	sat ✅	5.07409	4.95569
		SMTInterpol	SMTInterpol	unknown ❌	1201.48392	1229.46362
		Yices2	Yices2	sat ✅	0.55991	0.43370
		Z3alpha	Z3-alpha	sat ✅	157.82209	626.83436
		Z3	Z3-alpha-base	unknown ❌	1201.37377	1201.07915
			Z3-Owl-base	unknown ❌	1201.36735	1201.06163
			z3siri-base	unknown ❌	1201.38557	1201.03933
		Z3-Owl	Z3-Owl	sat ✅	217.42617	217.27908