Benchmark

non-incremental/QF_BV/Sage2/bench_4663.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	4220680
Compressed Size	65384
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	4220672
Compressed Size	65371
Max. Term Depth	540
Asserts	1677
Declared Functions	0
Declared Constants	1422
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	25	not	232	=	620
let	90343	extract	29	bvand	32	bvor	850
bvadd	53169	bvmul	14166	bvudiv	14265	bvult	86
bvule	15	bvugt	43	bvuge	197	bvslt	143
bvsle	195	bvsgt	92	bvsge	310	bvshl	854
bvlshr	878	bvashr	984	zero_extend	4859

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.62 (3/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	268.89000	268.78800
			Boolector SMT17 final boolector	unknown ❌	600.01300	599.85000
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	118.87000	236.86000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.05800	394.51000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	59.73280	104.09000
		Q3B	Q3B default	unknown ❌	12.88590	37.27990
		STP	stp_st default	unknown ❌	601.06400	161.39000
			stp_mt default	unknown ❌	483.19200	162.29000
		Yices2	Yices2-Main default	sat ✅	7.13518	7.13390
		Z3	z3-4.5.0 default	unknown ❌	600.02100	599.81000
SMT-COMP 2018	0.57 (3/7)	Boolector	Boolector_default	sat ✅	227.73700	227.72400
		CVC4	master-2018-06-10-b19c840-competition-default_default	unknown ❌	379.93400	379.90300
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.02000	1199.62000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	111.68500	405.31000
			Minkeyrink ST_st	sat ✅	109.58300	109.58600
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	1200.10000	1199.94000
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	1200.01000	1199.89000
			STP-Riss-st-2018_riss-no-stderr	unknown ❌	1200.11000	1200.03000
		Yices2	Yices 2.6.0_default	sat ✅	4.06124	4.06099
		Z3	z3-4.7.1_default	unknown ❌	1200.03000	1199.61000
SMT-COMP 2019	0.25 (6/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	93.56480	93.53900
			Poolector-wrapped-sq_default	sat ✅	113.91300	450.94000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	583.46000	583.45500
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unknown ❌	33.64110	33.63020
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	44.40720	141.58900
			MinkeyRink ST-wrapped-sq_default	sat ✅	72.83120	72.82610
		Par4	Par4-wrapped-sq_default	sat ✅	4.18814	12.40000
		STP	STP-2019-wrapped-sq_default	unknown ❌	2400.04000	2221.29000
			stp-mergesat-fixed-wrapped-sq_default	unknown ❌	2400.03000	2215.14000
			stp-minisat-wrapped-sq_default	unknown ❌	2400.03000	2218.60000
			stp-mt-wrapped-sq_default	unknown ❌	2400.06000	2220.09000
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.04000	2226.17000
			stp-riss-wrapped-sq_default	unknown ❌	2400.07000	2225.84000
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	5.52443	5.52481
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	11.86500	11.86440
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	1608.79000	1608.77000
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.82000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	28.33100	28.33230
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	2063.12000	2062.45000
SMT-COMP 2022	0.43 (4/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	79.80560	79.78770
			Bitwuzla-wrapped_default	sat ✅	84.07170	84.04170
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unknown ❌	73.81830	45.44290
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.11000	1199.86000
		STP	STP 2022.4_default	sat ✅	88.85930	88.85400
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	27.86280	27.86330
		Z3++BV	z3++bv_0702_default	sat ✅	537.65900	537.59100
		Z3	z3-4.8.17_default	unknown ❌	1200.04000	1199.88000
SMT-COMP 2023	0.50 (3/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	126.79400	126.75300
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unknown ❌	233.51500	233.50300
		STP	STP 2022.4_default	sat ✅	44.44680	44.44250
			STP 2022.4_default	sat ✅	44.52750	44.52260
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	4.58599	11.87220
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	6.94526	6.94413
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.05000	1199.77000
			z3-Owl-Final_default	unknown ❌	1200.02000	1199.75000
SMT-COMP 2025	0.56 (4/9)	Bitwuzla	Bitwuzla	sat ✅	6.66013	6.53302
			Bitwuzla-MachBV-base	sat ✅	67.98555	67.84454
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	38.53991	38.40359
		BVDecide	bv_decide	sat ✅	480.05083	480.26596
			bv_decide-nokernel	sat ✅	466.70133	466.84961
		cvc5	cvc5	unknown ❌	11.05881	10.93930
		SMTInterpol	SMTInterpol	unknown ❌	1201.75424	1267.32518
		Yices2	Yices2	sat ✅	29.06923	28.94768
		Z3alpha	Z3-alpha	unknown ❌	203.94623	813.40732
		Z3	Z3-alpha-base	unknown ❌	1201.86279	1201.57490
			Z3-Owl-base	unknown ❌	1201.83453	1201.48367
			z3siri-base	unknown ❌	1201.83250	1201.56316
		Z3-Owl	Z3-Owl	unknown ❌	1202.29392	1201.91360