Benchmark

non-incremental/QF_BV/Sage2/bench_3726.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	111142
Compressed Size	6306
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	111134
Compressed Size	6326
Max. Term Depth	24
Asserts	272
Declared Functions	0
Declared Constants	48
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	55	not	32	=	42
let	2362	bvor	28	bvadd	1840	bvmul	206
bvult	122	bvule	80	bvugt	12	bvuge	69
bvslt	1	bvshl	29	bvlshr	5	zero_extend	112

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	5.63908	5.63514
			Boolector SMT17 final boolector	unsat ✅	11.86460	11.86440
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.49534	0.92418
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.89484	0.89539
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.39314	0.37976
		Q3B	Q3B default	unknown ❌	600.06100	1787.40000
		STP	stp_st default	unsat ✅	1.89481	1.89270
			stp_mt default	unsat ✅	2.06986	7.52968
		Yices2	Yices2-Main default	unsat ✅	0.04032	0.03975
		Z3	z3-4.5.0 default	unsat ✅	1.13671	1.13599
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.24494	0.24490
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.47901	1.47806
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.90328	0.90421
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.21997	0.34436
			Minkeyrink ST_st	unsat ✅	0.21948	0.21959
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	1.38375	1.38379
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	1.42756	5.04794
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	1.93411	1.93374
		Yices2	Yices 2.6.0_default	unsat ✅	0.03572	0.03567
		Z3	z3-4.7.1_default	unsat ✅	1.19446	1.19440
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	8.08707	8.08594
			Poolector-wrapped-sq_default	unsat ✅	8.98530	35.22890
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	7.62806	7.62781
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	2.91280	2.91282
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.21371	0.35315
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.19415	0.19421
		Par4	Par4-wrapped-sq_default	unsat ✅	0.07382	0.00610
		STP	STP-2019-wrapped-sq_default	unsat ✅	1.47383	1.47424
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	11.82570	11.82550
			stp-minisat-wrapped-sq_default	unsat ✅	0.83085	0.83100
			stp-mt-wrapped-sq_default	unsat ✅	1.36463	4.74453
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	11.82170	13.83340
			stp-riss-wrapped-sq_default	unknown ❌	0.20454	0.20476
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.04751	0.04752
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.06983	0.06983
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.05795	0.05795
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.15483	0.15481
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.08572	0.08572
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.78194	0.78199
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	2.30764	2.30752
		Boolector	Boolector-wrapped-sq_default	unsat ✅	3.41210	3.41182
			Poolector-wrapped-sq_default	unsat ✅	3.78578	14.63000
		CVC4	CVC4-sq-final_default	unsat ✅	0.41155	0.41185
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.81000
		MathSAT	MathSAT5_default.sh	unsat ✅	0.81312	0.80988
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.16926	0.16951
			MinkeyRink Solver 2020.3_default	unsat ✅	0.21313	0.34369
		STP	STP_default	unsat ✅	0.13757	0.25542
			STP ++ Mergsat v1_default	unsat ✅	0.10701	0.10867
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.06514	0.06507
		Z3	z3-4.8.8_default	unsat ✅	0.49522	0.49515
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	2.27792	2.27776
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.55086	0.55086
		STP	STP 2021.0_default	unsat ✅	0.12005	0.18001
		Z3	z3-4.8.11_default	unsat ✅	0.84560	0.84560
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	1.68228	1.68210
			Bitwuzla-wrapped_default	unsat ✅	2.03713	2.03679
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	2.55510	2.54983
		MathSAT	MathSAT-5.6.8_default	unsat ✅	1.16473	1.16465
		STP	STP 2022.4_default	unsat ✅	0.14957	0.14962
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.05151	0.05148
		Z3++BV	z3++bv_0702_default	unsat ✅	0.21719	0.21711
		Z3	z3-4.8.17_default	unsat ✅	0.46982	0.47150
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	1.63271	1.53270
		cvc5	cvc5	unsat ✅	0.62225	0.52315
		SMTInterpol	SMTInterpol	unsat ✅	22.15430	41.24634
		STP	STP	unsat ✅	0.37923	0.27939
		Yices2	Yices2	unsat ✅	0.25269	0.15283
		Z3alpha	Z3-alpha	unsat ✅	4.64739	4.54759