Benchmark

non-incremental/QF_BV/Sage2/bench_13450.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2298387
Compressed Size	35701
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2298379
Compressed Size	35691
Max. Term Depth	232
Asserts	1005
Declared Functions	0
Declared Constants	364
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	196	=	222	let	51415
extract	31	bvand	28	bvor	20	bvadd	19164
bvmul	1158	bvult	159	bvule	201	bvugt	23
bvuge	353	bvsle	12	bvsgt	17	bvsge	17
bvshl	13068	bvlshr	307	bvashr	66	zero_extend	17377

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	15.55950	15.55720
			Boolector SMT17 final boolector	sat ✅	242.50600	242.48000
		CVC4	CVC4-smtcomp2017-main default	sat ✅	72.54380	144.83600
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	160.91300	160.89400
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	10.05010	14.10000
		Q3B	Q3B default	unknown ❌	600.03000	1200.66000
		STP	stp_st default	sat ✅	85.15330	85.14600
			stp_mt default	sat ✅	276.85000	873.36900
		Yices2	Yices2-Main default	sat ✅	2.82650	2.82542
		Z3	z3-4.5.0 default	sat ✅	415.66900	415.61500
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	12.12010	12.11520
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	14.48590	14.48660
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	372.61900	372.51100
		MinkeyRink	Minkeyrink MT_mt	sat ✅	4.68061	15.29420
			Minkeyrink ST_st	sat ✅	4.61394	4.61355
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	88.44450	88.41890
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	64.49670	250.75800
			STP-Riss-st-2018_riss-no-stderr	sat ✅	34.45940	34.45460
		Yices2	Yices 2.6.0_default	sat ✅	1.96194	1.96156
		Z3	z3-4.7.1_default	sat ✅	790.39100	790.39000
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	15.34600	15.34370
			Poolector-wrapped-sq_default	sat ✅	15.53260	61.08000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	220.69400	220.66400
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	42.62300	42.62360
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	5.53588	18.94400
			MinkeyRink ST-wrapped-sq_default	sat ✅	11.20260	11.20270
		Par4	Par4-wrapped-sq_default	sat ✅	1.81961	5.38000
		STP	STP-2019-wrapped-sq_default	sat ✅	150.06100	150.02600
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	28.47980	28.47770
			stp-minisat-wrapped-sq_default	sat ✅	17.83380	17.83130
			stp-mt-wrapped-sq_default	sat ✅	62.14340	238.87400
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	156.87700	209.58200
			stp-riss-wrapped-sq_default	unknown ❌	2.38471	2.38504
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	1.74178	1.74165
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	3.99657	3.99620
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	6.36239	6.35854
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.67000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	1.65596	1.65601
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	423.83600	423.81700
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	13.94390	13.94220
		Boolector	Boolector-wrapped-sq_default	sat ✅	15.42400	15.42220
			Poolector-wrapped-sq_default	sat ✅	14.82120	58.25830
		CVC4	CVC4-sq-final_default	sat ✅	36.49680	36.49610
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.04000	1199.90000
		MathSAT	MathSAT5_default.sh	sat ✅	432.78100	432.62200
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	1.04992	1.05014
			MinkeyRink Solver 2020.3_default	sat ✅	3.89183	12.27490
		STP	STP_default	sat ✅	10.12680	38.02120
			STP ++ Mergsat v1_default	sat ✅	6.68403	6.68569
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	3.91191	3.91172
		Z3	z3-4.8.8_default	sat ✅	236.48200	236.43400
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.33300	14.33220
		MathSAT	mathsat-5.6.6_default	sat ✅	801.58400	801.54800
		STP	STP 2021.0_default	sat ✅	2.98491	9.60066
		Z3	z3-4.8.11_default	sat ✅	258.55800	258.46400
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	13.37150	13.36990
			Bitwuzla-wrapped_default	sat ✅	14.09110	14.08990
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	43.60740	43.60490
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.03000	1199.69000
		STP	STP 2022.4_default	sat ✅	3.57492	3.57500
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	3.22739	3.22702
		Z3++BV	z3++bv_0702_default	sat ✅	17.14720	17.14460
		Z3	z3-4.8.17_default	sat ✅	125.51900	125.47900