Benchmark

non-incremental/QF_BV/Sage2/bench_16852.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3127548
Compressed Size	43547
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3127540
Compressed Size	43537
Max. Term Depth	219
Asserts	1214
Declared Functions	0
Declared Constants	372
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	254	=	285	let	69947
extract	43	bvand	40	bvor	26	bvadd	26319
bvmul	1474	bvult	184	bvule	252	bvugt	34
bvuge	404	bvsle	13	bvsgt	20	bvsge	21
bvshl	17715	bvlshr	386	bvashr	90	zero_extend	23600

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	23.43390	23.42980
			Boolector SMT17 final boolector	sat ✅	236.80400	236.77600
		CVC4	CVC4-smtcomp2017-main default	sat ✅	162.93300	325.85000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.07700	599.86000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	6.14920	6.24499
		Q3B	Q3B default	unknown ❌	600.09400	1799.74000
		STP	stp_st default	unknown ❌	600.02000	599.95300
			stp_mt default	sat ✅	203.42500	796.61200
		Yices2	Yices2-Main default	sat ✅	1.43854	1.43855
		Z3	z3-4.5.0 default	unknown ❌	600.01900	599.93300
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	9.87699	9.87702
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	32.75410	32.75270
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	581.51700	581.45500
		MinkeyRink	Minkeyrink MT_mt	sat ✅	5.25991	16.69720
			Minkeyrink ST_st	sat ✅	5.25995	5.25969
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	137.42400	137.41000
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	60.89610	230.46900
			STP-Riss-st-2018_riss-no-stderr	sat ✅	80.31840	80.31000
		Yices2	Yices 2.6.0_default	sat ✅	6.22704	6.22653
		Z3	z3-4.7.1_default	sat ✅	935.11000	934.93200
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	24.68330	24.68290
			Poolector-wrapped-sq_default	sat ✅	25.13910	99.08000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	246.57600	246.54800
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	65.45630	65.45150
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	9.37301	27.46950
			MinkeyRink ST-wrapped-sq_default	sat ✅	13.82390	13.82470
		Par4	Par4-wrapped-sq_default	sat ✅	7.21989	21.41000
		STP	STP-2019-wrapped-sq_default	sat ✅	184.72600	184.67000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	114.06600	114.01700
			stp-minisat-wrapped-sq_default	sat ✅	69.00100	68.99490
			stp-mt-wrapped-sq_default	sat ✅	160.02700	624.95900
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	209.31600	435.89600
			stp-riss-wrapped-sq_default	unknown ❌	3.41906	3.41911
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	11.42170	11.42160
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	6.20943	6.20895
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	8.78158	8.78115
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.04000	2400.04000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	2.31230	2.31206
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	391.70400	391.58700
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	33.45980	33.45480
		Boolector	Boolector-wrapped-sq_default	sat ✅	18.33650	18.33070
			Poolector-wrapped-sq_default	sat ✅	21.83660	85.67970
		CVC4	CVC4-sq-final_default	sat ✅	90.35990	90.34260
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.04000	1200.09000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.02000	1199.66000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	1.27944	1.27960
			MinkeyRink Solver 2020.3_default	sat ✅	7.27371	20.69420
		STP	STP_default	sat ✅	6.51348	19.43110
			STP ++ Mergsat v1_default	sat ✅	13.49460	13.49070
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	3.84127	3.84120
		Z3	z3-4.8.8_default	sat ✅	185.62800	185.59100
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	18.99050	18.98310
			Bitwuzla-wrapped_default	sat ✅	21.64840	21.64690
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	84.42020	84.41310
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.02000	1199.71000
		STP	STP 2022.4_default	sat ✅	4.39220	4.39156
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	6.79108	13.46990
		Z3++BV	z3++bv_0702_default	sat ✅	44.07120	44.06800
		Z3	z3-4.8.17_default	sat ✅	245.83100	245.81100
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	9.51720	9.41678
		cvc5	cvc5	sat ✅	100.01414	99.91009
		SMTInterpol	SMTInterpol	unknown ❌	1201.71860	1239.98224
		STP	STP	sat ✅	4.00538	3.90551
		Yices2	Yices2	sat ✅	4.64857	4.54666
		Z3alpha	Z3-alpha	sat ✅	711.80679	711.40323
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	5.85439	5.72357
			Bitwuzla-MachBV-base	sat ✅	6.74240	6.61721
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	6.72840	6.61162
		BVDecide	bv_decide	sat ✅	38.61704	38.49498
			bv_decide-nokernel	sat ✅	37.15162	37.01179
		cvc5	cvc5	sat ✅	25.19556	25.07253
		SMTInterpol	SMTInterpol	unknown ❌	1201.48918	1242.14243
		Yices2	Yices2	sat ✅	3.92621	3.80111
		Z3alpha	Z3-alpha	sat ✅	383.31375	1529.18056
		Z3	Z3-alpha-base	sat ✅	245.74744	245.55550
			Z3-Owl-base	sat ✅	816.87771	816.66592
			z3siri-base	sat ✅	253.89373	253.71993
		Z3-Owl	Z3-Owl	sat ✅	499.48053	499.31883