Benchmark

non-incremental/QF_BV/Sage2/bench_12216.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3098518
Compressed Size	125994
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3098510
Compressed Size	125982
Max. Term Depth	1064
Asserts	2711
Declared Functions	0
Declared Constants	11035
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	159	=	2415	let	26081
extract	25	bvand	11	bvor	6623	bvadd	70703
bvmul	255	bvult	55	bvule	12	bvugt	15
bvuge	45	bvslt	14	bvsle	68	bvsgt	37
bvsge	49	bvshl	6658	bvlshr	26	zero_extend	8891

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	56.46200	56.45450
			Boolector SMT17 final boolector	unknown ❌	600.01800	599.97500
		CVC4	CVC4-smtcomp2017-main default	sat ✅	540.07100	1085.33000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	109.78800	109.74000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	7.68304	7.77899
		Q3B	Q3B default	unknown ❌	600.09300	1799.56000
		STP	stp_st default	unknown ❌	600.02800	599.88000
			stp_mt default	unknown ❌	600.07100	1854.63000
		Yices2	Yices2-Main default	sat ✅	0.90370	0.90306
		Z3	z3-4.5.0 default	unknown ❌	600.03000	599.93000
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.13619	2.13601
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	121.67100	121.67100
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	11.73250	11.73000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	35.58070	110.62500
			Minkeyrink ST_st	sat ✅	37.39590	37.39430
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	1200.02000	1199.77000
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	1200.06000	4711.05000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	144.84500	144.81100
		Yices2	Yices 2.6.0_default	sat ✅	0.86076	0.86066
		Z3	z3-4.7.1_default	sat ✅	882.31400	882.31000
SMT-COMP 2019	0.25 (6/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	1.85236	1.85234
			Poolector-wrapped-sq_default	sat ✅	2.29968	8.73000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	659.22000	659.23900
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	53.51200	53.51580
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	33.92110	125.86200
			MinkeyRink ST-wrapped-sq_default	sat ✅	29.77100	29.76490
		Par4	Par4-wrapped-sq_default	sat ✅	0.87667	2.50000
		STP	STP-2019-wrapped-sq_default	unknown ❌	2400.11000	2399.77000
			stp-mergesat-fixed-wrapped-sq_default	unknown ❌	2400.08000	2399.75000
			stp-minisat-wrapped-sq_default	unknown ❌	2400.10000	2399.86000
			stp-mt-wrapped-sq_default	unknown ❌	2400.08000	9476.26000
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.05000	7166.53000
			stp-riss-wrapped-sq_default	unknown ❌	23.70770	19.47660
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.97530	0.97524
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	3.32968	3.32911
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	18.55330	18.55200
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	17.45870	17.45730
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	1.49306	1.49296
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.02000	2399.57000
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	9.74745	9.74777
		Boolector	Boolector-wrapped-sq_default	sat ✅	6.04064	6.04019
			Poolector-wrapped-sq_default	sat ✅	6.79626	33.09220
		CVC4	CVC4-sq-final_default	sat ✅	162.49600	162.47700
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.11000	1200.03000
		MathSAT	MathSAT5_default.sh	sat ✅	9.11305	9.11182
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	3.34749	3.34825
			MinkeyRink Solver 2020.3_default	sat ✅	3.61096	4.23459
		STP	STP_default	sat ✅	38.13640	134.25100
			STP ++ Mergsat v1_default	sat ✅	24.95980	24.95940
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	3.70268	3.70254
		Z3	z3-4.8.8_default	sat ✅	251.89700	251.87300
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	3.05136	3.05094
		MathSAT	mathsat-5.6.6_default	sat ✅	7.39813	14.77700
		STP	STP 2021.0_default	sat ✅	36.55350	120.64200
		Z3	z3-4.8.11_default	sat ✅	351.82100	351.79500
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	11.54920	11.54890
			Bitwuzla-wrapped_default	sat ✅	18.72380	18.72190
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	139.84700	139.82300
		MathSAT	MathSAT-5.6.8_default	sat ✅	7.22649	7.22599
		STP	STP 2022.4_default	sat ✅	8.82833	8.82778
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	3.34620	3.34584
		Z3++BV	z3++bv_0702_default	sat ✅	13.63170	13.63030
		Z3	z3-4.8.17_default	sat ✅	86.20490	86.19680
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	8.04208	8.04160
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	68.80730	68.80910
		STP	STP 2022.4_default	sat ✅	7.85080	7.85054
			STP 2022.4_default	sat ✅	7.83538	7.83430
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	266.94600	756.66900
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	1.26488	1.26482
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.04000	1199.81000
			z3-Owl-Final_default	sat ✅	143.31500	143.26600