Benchmark

non-incremental/QF_BV/Sage2/bench_83.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	371520
Compressed Size	36635
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	371512
Compressed Size	36645
Max. Term Depth	24
Asserts	1307
Declared Functions	0
Declared Constants	218
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	8	ite	121	not	680
=	1166	let	7190	extract	507	bvand	25
bvor	136	bvadd	1172	bvmul	751	bvult	21
bvule	64	bvugt	14	bvuge	16	bvslt	12
bvsle	1	bvsgt	141	bvshl	654	zero_extend	2636
sign_extend	379

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.18949	0.18892
			Boolector SMT17 final boolector	unsat ✅	0.64176	0.64169
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	1.59255	3.01449
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	2.75743	2.75791
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.11288	0.11241
		Q3B	Q3B default	unsat ✅	0.50179	1.23029
		STP	stp_st default	unsat ✅	0.43171	0.43073
			stp_mt default	unsat ✅	0.46113	0.97860
		Yices2	Yices2-Main default	unsat ✅	0.04037	0.03918
		Z3	z3-4.5.0 default	unsat ✅	0.13817	0.13813
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.03628	0.03625
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.90335	0.90338
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	2.75825	2.75911
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.12256	0.12256
			Minkeyrink ST_st	unsat ✅	0.12182	0.12186
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.31151	0.31172
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.35000	0.52551
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	1.82391	1.82386
		Yices2	Yices 2.6.0_default	unsat ✅	0.04060	0.04054
		Z3	z3-4.7.1_default	unsat ✅	0.14874	0.14869
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.05784	0.05782
			Poolector-wrapped-sq_default	unsat ✅	0.17681	0.32216
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.05075	0.05077
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.87159	0.87159
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.14577	0.14593
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.14370	0.14380
		Par4	Par4-wrapped-sq_default	unsat ✅	0.04468	0.00590
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.31792	0.31823
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.57058	0.57080
			stp-minisat-wrapped-sq_default	unsat ✅	0.34179	0.34204
			stp-mt-wrapped-sq_default	unsat ✅	0.32926	0.44703
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.61545	0.78123
			stp-riss-wrapped-sq_default	unknown ❌	0.28435	0.28452
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.04265	0.04265
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.06943	0.06942
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.06456	0.06454
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.87000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.05669	0.05666
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.14538	0.14538
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.09249	0.09130
		MathSAT	mathsat-5.6.6_default	unsat ✅	2.32059	2.32046
		STP	STP 2021.0_default	unsat ✅	0.37627	0.49910
		Z3	z3-4.8.11_default	unsat ✅	0.13810	0.13805
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.17874	0.17865
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	1.22578	1.22629
		STP	STP 2022.4_default	unsat ✅	0.16370	0.16374
			STP 2022.4_default	unsat ✅	0.16384	0.16384
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.11000	1254.31000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.04635	0.04632
		Z3-Owl	z3-Owl-Final_default	unsat ✅	0.86195	0.86181
			z3-Owl-Final_default	unsat ✅	0.87286	0.87310
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	0.36359	0.26370
		cvc5	cvc5	unsat ✅	1.19681	1.09717
		SMTInterpol	SMTInterpol	unknown ❌	1201.74258	1236.24913
		STP	STP	unsat ✅	0.31451	0.21468
		Yices2	Yices2	unsat ✅	0.26998	0.17037
		Z3alpha	Z3-alpha	unsat ✅	0.30776	0.20859
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	unsat ✅	0.29189	0.17442
			Bitwuzla-MachBV-base	unsat ✅	0.38236	0.25313
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	0.44440	0.31805
		BVDecide	bv_decide	unsat ✅	30.65543	30.47777
			bv_decide-nokernel	unsat ✅	10.75598	10.58045
		cvc5	cvc5	unsat ✅	0.82642	0.70886
		SMTInterpol	SMTInterpol	unknown ❌	1201.48567	1229.82543
		Yices2	Yices2	unsat ✅	0.32373	0.19885
		Z3alpha	Z3-alpha	unsat ✅	0.44733	0.41450
		Z3	Z3-alpha-base	unsat ✅	0.31532	0.19064
			Z3-Owl-base	unsat ✅	0.53809	0.40931
			z3siri-base	unsat ✅	0.29034	0.17343
		Z3-Owl	Z3-Owl	unsat ✅	0.90346	0.77518