Benchmark

non-incremental/QF_BV/Sage2/bench_10832.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	81595
Compressed Size	9111
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	81587
Compressed Size	9136
Max. Term Depth	262
Asserts	294
Declared Functions	0
Declared Constants	208
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	134	=	184
let	1500	bvor	7	bvadd	350	bvmul	350
bvule	6	bvuge	14	bvslt	50	bvsle	2
bvsgt	13	bvsge	34	bvshl	17	zero_extend	578
sign_extend	44

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.25 (6/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.02017	0.01968
			Boolector SMT17 final boolector	sat ✅	0.02015	0.01965
		CVC4	CVC4-smtcomp2017-main default	sat ✅	7.30308	14.60670
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	1.54887	1.54897
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	5.80529	5.90000
		Q3B	Q3B default	unknown ❌	600.10900	1799.88000
		STP	stp_st default	sat ✅	14.08530	14.08360
			stp_mt default	sat ✅	20.01080	60.97720
		Yices2	Yices2-Main default	sat ✅	0.09471	0.09362
		Z3	z3-4.5.0 default	unknown ❌	600.01300	599.92500
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.01735	0.01729
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	8.63728	8.63584
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	1.53078	1.53181
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.78929	1.07755
			Minkeyrink ST_st	sat ✅	0.74132	0.74132
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.72323	0.72321
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.77054	1.06967
			STP-Riss-st-2018_riss-no-stderr	sat ✅	2.03422	2.03425
		Yices2	Yices 2.6.0_default	sat ✅	0.08514	0.08503
		Z3	z3-4.7.1_default	sat ✅	366.33900	366.29500
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.03003	0.03002
			Poolector-wrapped-sq_default	sat ✅	0.17952	0.13150
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	366.36400	366.34000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	2.30868	2.30848
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.75812	1.01025
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.69385	0.69393
		Par4	Par4-wrapped-sq_default	sat ✅	0.03029	0.00722
		STP	STP-2019-wrapped-sq_default	sat ✅	0.73520	0.73505
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	9.83594	9.83607
			stp-minisat-wrapped-sq_default	sat ✅	2.75197	2.75213
			stp-mt-wrapped-sq_default	sat ✅	0.77524	0.98500
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	9.76943	12.24830
			stp-riss-wrapped-sq_default	unknown ❌	0.70017	0.70031
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.09721	0.09718
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.32252	0.32249
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	65.20990	65.20630
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	0.04481	0.04476
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.28644	0.28639
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	1673.21000	1673.10000
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.37200	0.37195
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.02851	0.02848
			Poolector-wrapped-sq_default	sat ✅	0.17869	0.12870
		CVC4	CVC4-sq-final_default	sat ✅	2.28546	2.28573
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.07000	1199.99000
		MathSAT	MathSAT5_default.sh	sat ✅	0.45616	0.45610
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.69238	0.69264
			MinkeyRink Solver 2020.3_default	sat ✅	0.75734	1.00888
		STP	STP_default	sat ✅	0.69027	0.89380
			STP ++ Mergsat v1_default	sat ✅	0.59016	0.59196
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	7.75242	7.75207
		Z3	z3-4.8.8_default	sat ✅	53.15950	53.15410
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.82961	2.82918
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	3.02007	3.01818
		STP	STP 2022.4_default	sat ✅	0.65558	0.65549
			STP 2022.4_default	sat ✅	0.65338	0.65332
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.13000	1232.73000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.09752	0.09749
		Z3-Owl	z3-Owl-Final_default	sat ✅	73.39890	73.39340
			z3-Owl-Final_default	sat ✅	65.30270	65.28620
SMT-COMP 2024	0.33 (4/6)	Bitwuzla	Bitwuzla	sat ✅	0.85854	0.75845
		cvc5	cvc5	sat ✅	2.02958	1.93014
		SMTInterpol	SMTInterpol	unknown ❌	1201.71539	1228.51826
		STP	STP	sat ✅	0.81269	0.71244
		Yices2	Yices2	sat ✅	0.28783	0.18761
		Z3alpha	Z3-alpha	unknown ❌	1201.71516	1201.07314
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	0.47632	0.35292
			Bitwuzla-MachBV-base	sat ✅	0.63282	0.49573
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.68091	0.55287
		BVDecide	bv_decide	sat ✅	3.25124	3.10758
			bv_decide-nokernel	sat ✅	3.12764	2.97207
		cvc5	cvc5	sat ✅	1.53679	1.41757
		SMTInterpol	SMTInterpol	unknown ❌	1201.38586	1234.18779
		Yices2	Yices2	sat ✅	0.34159	0.21682
		Z3alpha	Z3-alpha	sat ✅	276.12871	1102.54228
		Z3	Z3-alpha-base	unknown ❌	1201.28003	1200.99355
			Z3-Owl-base	unknown ❌	1201.28857	1201.04225
			z3siri-base	unknown ❌	1201.31422	1201.05061
		Z3-Owl	Z3-Owl	sat ✅	29.24592	29.11730