Benchmark

non-incremental/QF_BV/Sage2/bench_2670.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	5004002
Compressed Size	45974
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	5003994
Compressed Size	45962
Max. Term Depth	1014
Asserts	897
Declared Functions	0
Declared Constants	262
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	193	not	180	=	339
let	107509	extract	48	bvand	4	bvor	90
bvadd	78546	bvmul	8429	bvult	298	bvule	159
bvugt	3	bvuge	267	bvsgt	20	bvsge	3
bvshl	90	bvlshr	23	zero_extend	19713

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.25 (6/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	107.56800	107.54500
			Boolector SMT17 final boolector	sat ✅	209.96900	209.91500
		CVC4	CVC4-smtcomp2017-main default	sat ✅	12.53010	23.04040
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.02300	599.79000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	15.44170	25.27000
		Q3B	Q3B default	unknown ❌	600.05000	1799.77000
		STP	stp_st default	sat ✅	15.17090	15.15080
			stp_mt default	sat ✅	14.54960	52.43580
		Yices2	Yices2-Main default	sat ✅	0.40718	0.40667
		Z3	z3-4.5.0 default	sat ✅	6.81590	6.81394
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	66.72140	66.72070
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	11.17760	11.17710
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.01000	1199.85000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	12.46590	46.99550
			Minkeyrink ST_st	sat ✅	12.22270	12.22230
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	35.36930	35.36890
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	21.57060	80.74570
			STP-Riss-st-2018_riss-no-stderr	sat ✅	13.95230	13.95290
		Yices2	Yices 2.6.0_default	sat ✅	0.41867	0.41845
		Z3	z3-4.7.1_default	sat ✅	22.73740	22.73660
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	124.67900	124.64600
			Poolector-wrapped-sq_default	sat ✅	150.53300	596.32000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	105.19200	105.17900
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	13.91500	13.91550
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	16.51980	63.19300
			MinkeyRink ST-wrapped-sq_default	sat ✅	35.27760	35.26700
		Par4	Par4-wrapped-sq_default	sat ✅	0.50526	0.00570
		STP	STP-2019-wrapped-sq_default	sat ✅	14.93940	28.23760
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	90.18570	90.19050
			stp-minisat-wrapped-sq_default	sat ✅	41.75470	41.74950
			stp-mt-wrapped-sq_default	sat ✅	28.84790	108.12700
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	90.35050	150.10300
			stp-riss-wrapped-sq_default	unknown ❌	1.62304	1.62304
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.49454	0.49451
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.06345	1.06322
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.78435	0.78434
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.83000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.37113	0.37116
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	32.42360	32.42520
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	61.21370	61.20960
		Boolector	Boolector-wrapped-sq_default	sat ✅	130.63600	130.62600
			Poolector-wrapped-sq_default	sat ✅	132.26300	523.46500
		CVC4	CVC4-sq-final_default	sat ✅	8.45570	8.45597
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.04000	1199.88000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.12000	1199.80000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.75462	0.75480
			MinkeyRink Solver 2020.3_default	sat ✅	23.09410	89.16680
		STP	STP_default	sat ✅	61.30360	230.45800
			STP ++ Mergsat v1_default	sat ✅	140.33000	140.29800
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.68300	0.68295
		Z3	z3-4.8.8_default	sat ✅	4.55336	4.55309
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	116.76600	116.76600
			Bitwuzla-wrapped_default	sat ✅	106.14600	106.14100
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	9.94577	9.94643
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.08000	1199.88000
		STP	STP 2022.4_default	sat ✅	1.26448	1.26455
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.61944	0.61935
		Z3++BV	z3++bv_0702_default	sat ✅	7.31319	7.31246
		Z3	z3-4.8.17_default	sat ✅	20.13930	20.14120
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.12825	2.12799
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	10.75000	10.74920
		STP	STP 2022.4_default	sat ✅	1.36109	1.36113
			STP 2022.4_default	sat ✅	1.36706	1.36713
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1253.29000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.49325	0.49300
		Z3-Owl	z3-Owl-Final_default	sat ✅	46.84290	46.83370
			z3-Owl-Final_default	sat ✅	50.15250	50.15050
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	1.24731	1.14753
		cvc5	cvc5	sat ✅	3.62035	3.52057
		SMTInterpol	SMTInterpol	unknown ❌	1201.75576	1247.83499
		STP	STP	sat ✅	3.70121	3.60057
		Yices2	Yices2	sat ✅	0.48650	0.38671
		Z3alpha	Z3-alpha	sat ✅	26.98967	26.88935