Benchmark

non-incremental/QF_BV/Sage2/bench_12866.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2175972
Compressed Size	36262
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2175964
Compressed Size	36251
Max. Term Depth	217
Asserts	1030
Declared Functions	0
Declared Constants	364
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	211	=	233	let	48877
extract	25	bvand	22	bvor	26	bvadd	18181
bvmul	1236	bvult	147	bvule	219	bvugt	19
bvuge	360	bvsle	13	bvsgt	19	bvsge	19
bvshl	12350	bvlshr	327	bvashr	60	zero_extend	16439

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	12.60400	12.60170
			Boolector SMT17 final boolector	sat ✅	126.12900	126.08200
		CVC4	CVC4-smtcomp2017-main default	sat ✅	64.57450	99.48560
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	143.92100	143.88600
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	5.03371	5.11916
		Q3B	Q3B default	unknown ❌	600.08700	1787.19000
		STP	stp_st default	sat ✅	65.65960	65.65430
			stp_mt default	sat ✅	64.67300	197.23300
		Yices2	Yices2-Main default	sat ✅	5.54669	5.54548
		Z3	z3-4.5.0 default	sat ✅	222.71100	222.63700
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	6.25431	6.25416
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	30.08250	30.08420
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	332.49100	332.48300
		MinkeyRink	Minkeyrink MT_mt	sat ✅	5.00730	16.59120
			Minkeyrink ST_st	sat ✅	3.94824	3.94804
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	47.21170	47.20720
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	69.96910	272.45600
			STP-Riss-st-2018_riss-no-stderr	sat ✅	38.01080	38.01050
		Yices2	Yices 2.6.0_default	sat ✅	4.81159	4.81148
		Z3	z3-4.7.1_default	sat ✅	520.45400	520.41500
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	13.14680	13.14600
			Poolector-wrapped-sq_default	sat ✅	15.75630	61.99000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	136.45000	136.44200
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	41.10630	41.10130
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	3.97616	25.51160
			MinkeyRink ST-wrapped-sq_default	sat ✅	3.87497	3.87520
		Par4	Par4-wrapped-sq_default	sat ✅	6.69311	19.98000
		STP	STP-2019-wrapped-sq_default	sat ✅	102.97300	102.96500
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	29.41330	29.41140
			stp-minisat-wrapped-sq_default	sat ✅	123.16900	123.14500
			stp-mt-wrapped-sq_default	sat ✅	45.10300	172.41400
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	139.34900	286.90700
			stp-riss-wrapped-sq_default	unknown ❌	1.99273	1.99225
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	3.68173	3.68165
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	4.46152	4.46124
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	7.24798	7.24705
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.04000	2399.67000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	1.86854	1.86843
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	281.46100	281.39400
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.12130	14.11790
		Boolector	Boolector-wrapped-sq_default	sat ✅	15.16050	15.16020
			Poolector-wrapped-sq_default	sat ✅	14.71770	57.87000
		CVC4	CVC4-sq-final_default	sat ✅	82.77260	82.75630
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.10000	1200.03000
		MathSAT	MathSAT5_default.sh	sat ✅	1095.82000	1095.55000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	1.02576	1.02435
			MinkeyRink Solver 2020.3_default	sat ✅	3.58444	11.12490
		STP	STP_default	sat ✅	2.61959	8.25323
			STP ++ Mergsat v1_default	sat ✅	6.80180	6.80288
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	4.27818	4.27796
		Z3	z3-4.8.8_default	sat ✅	184.84100	184.78100
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	17.63410	17.63380
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.06000	1199.60000
		STP	STP 2021.0_default	sat ✅	3.12771	10.20940
		Z3	z3-4.8.11_default	sat ✅	111.17600	111.13200