Benchmark

non-incremental/QF_BV/Sage2/bench_899.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	11008466
Compressed Size	31349
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	11008458
Compressed Size	31337
Max. Term Depth	2196
Asserts	502
Declared Functions	0
Declared Constants	728
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	24	not	52	=	67
let	261419	extract	4	bvand	2	bvadd	108630
bvmul	179	bvult	98	bvule	118	bvugt	23
bvuge	215	bvsge	4	bvshl	65121	bvlshr	15
zero_extend	87368

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.62 (3/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unknown ❌	600.03500	599.92000
			Boolector SMT17 final boolector	unknown ❌	600.01200	599.96100
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.13500	1199.87000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	2.95845	2.95588
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	2.04235	2.03520
		Q3B	Q3B default	unknown ❌	600.04900	1788.47000
		STP	stp_st default	unknown ❌	600.01400	599.90600
			stp_mt default	unknown ❌	600.05000	2370.06000
		Yices2	Yices2-Main default	sat ✅	0.66450	0.66297
		Z3	z3-4.5.0 default	unknown ❌	600.01300	599.90000
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	1.16570	1.16558
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	13.22210	13.22180
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	2.69203	2.69296
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.97618	2.22142
			Minkeyrink ST_st	sat ✅	1.93859	1.93860
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	5.76961	5.76517
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	6.19252	9.07117
			STP-Riss-st-2018_riss-no-stderr	sat ✅	18.25370	18.24990
		Yices2	Yices 2.6.0_default	sat ✅	0.67134	0.67127
		Z3	z3-4.7.1_default	unknown ❌	1200.01000	1199.90000
SMT-COMP 2019	0.12 (7/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	19.59250	19.59140
			Poolector-wrapped-sq_default	sat ✅	23.14390	91.19240
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unknown ❌	2400.11000	2399.80000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	17.32370	17.32200
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	1.99844	2.20732
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.94328	1.94345
		Par4	Par4-wrapped-sq_default	sat ✅	0.68803	1.91000
		STP	STP-2019-wrapped-sq_default	sat ✅	5.71851	5.71873
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	13.63430	13.63450
			stp-minisat-wrapped-sq_default	sat ✅	7.80912	7.80936
			stp-mt-wrapped-sq_default	sat ✅	6.18446	8.01108
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	14.00060	18.34060
			stp-riss-wrapped-sq_default	unknown ❌	5.82189	5.42541
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.65774	0.65772
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.85889	0.85894
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	1.52362	1.52327
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	1.00404	1.00405
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.77742	0.77749
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	1488.72000	1488.45000
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	18.03220	18.01490
			Bitwuzla-wrapped_default	sat ✅	15.70470	15.70430
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	81.42810	81.41540
		MathSAT	MathSAT-5.6.8_default	sat ✅	2.06913	2.06908
		STP	STP 2022.4_default	sat ✅	1.48833	1.48840
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	1.14306	1.14281
		Z3++BV	z3++bv_0702_default	sat ✅	41.25610	41.25200
		Z3	z3-4.8.17_default	unknown ❌	1200.11000	1199.93000
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.44518	2.44532
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	98.61400	98.60230
		STP	STP 2022.4_default	sat ✅	1.48744	1.48733
			STP 2022.4_default	sat ✅	1.49156	1.49154
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1246.22000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.77452	0.77446
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.11000	1199.79000
			z3-Owl-Final_default	sat ✅	427.00100	426.96200
SMT-COMP 2025	0.33 (6/9)	Bitwuzla	Bitwuzla	sat ✅	0.80151	0.67936
			Bitwuzla-MachBV-base	sat ✅	1.14580	1.01335
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	1.18891	1.06073
		BVDecide	bv_decide	sat ✅	48.96677	48.82390
			bv_decide-nokernel	sat ✅	48.11369	47.98324
		cvc5	cvc5	sat ✅	65.57877	65.45106
		SMTInterpol	SMTInterpol	sat ✅	26.20873	45.38952
		Yices2	Yices2	sat ✅	0.91862	0.79908
		Z3alpha	Z3-alpha	unknown ❌	1201.76106	4800.77789
		Z3	Z3-alpha-base	unknown ❌	1201.40405	1201.18913
			Z3-Owl-base	unknown ❌	1201.42906	1201.07968
			z3siri-base	unknown ❌	1201.44316	1201.10480
		Z3-Owl	Z3-Owl	unknown ❌	1201.79085	1201.20897