Benchmark

non-incremental/QF_BV/Sage2/bench_16276.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	553009
Compressed Size	17420
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	553001
Compressed Size	17411
Max. Term Depth	160
Asserts	506
Declared Functions	0
Declared Constants	244
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	85	=	100
let	12041	extract	15	bvand	9	bvor	4
bvadd	4235	bvmul	318	bvult	82	bvule	113
bvugt	14	bvuge	194	bvsle	1	bvsgt	1
bvsge	1	bvshl	3106	bvlshr	54	bvashr	5
zero_extend	4209

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	1.37042	1.36983
			Boolector SMT17 final boolector	sat ✅	5.18727	5.18098
		CVC4	CVC4-smtcomp2017-main default	sat ✅	4.32318	8.43033
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	168.27500	168.25700
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.03809	1.00614
		Q3B	Q3B default	unknown ❌	600.06200	1786.95000
		STP	stp_st default	sat ✅	3.14423	3.14111
			stp_mt default	sat ✅	3.04294	10.43510
		Yices2	Yices2-Main default	sat ✅	0.48319	0.48248
		Z3	z3-4.5.0 default	sat ✅	7.97854	7.97523
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	1.12170	1.12134
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	6.20009	6.19992
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	181.75800	181.75900
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.86561	2.27801
			Minkeyrink ST_st	sat ✅	0.76771	0.76550
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	2.73212	2.73249
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	3.03608	10.52730
			STP-Riss-st-2018_riss-no-stderr	sat ✅	2.34923	2.34931
		Yices2	Yices 2.6.0_default	sat ✅	0.24101	0.24094
		Z3	z3-4.7.1_default	sat ✅	15.56460	15.56470
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.73518	0.73518
			Poolector-wrapped-sq_default	sat ✅	1.01851	3.31523
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	4.85157	4.85147
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	10.33030	10.32970
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.80943	2.20431
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.73121	0.73124
		Par4	Par4-wrapped-sq_default	sat ✅	0.46536	0.00590
		STP	STP-2019-wrapped-sq_default	sat ✅	2.91661	2.91659
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	8.19282	8.17576
			stp-minisat-wrapped-sq_default	sat ✅	1.20933	1.20958
			stp-mt-wrapped-sq_default	sat ✅	3.08840	10.73040
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	8.40016	11.96470
			stp-riss-wrapped-sq_default	unknown ❌	0.48935	0.48953
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.44682	0.44679
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.83994	0.83998
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.96251	0.96249
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.01000	2399.79000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.29668	0.29667
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	27.86850	27.86520
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.83110	0.82709
		MathSAT	mathsat-5.6.6_default	sat ✅	198.18400	198.09400
		STP	STP 2021.0_default	sat ✅	0.74255	2.05566
		Z3	z3-4.8.11_default	sat ✅	9.70702	9.70630
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.01162	2.01140
			Bitwuzla-wrapped_default	sat ✅	1.85059	1.85016
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	18.37500	18.37430
		MathSAT	MathSAT-5.6.8_default	sat ✅	239.65800	239.57700
		STP	STP 2022.4_default	sat ✅	1.25676	1.25673
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.34882	0.34878
		Z3++BV	z3++bv_0702_default	sat ✅	4.65630	4.65610
		Z3	z3-4.8.17_default	sat ✅	3.25759	3.25928
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.07894	1.07871
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	14.99780	14.99410
		STP	STP 2022.4_default	sat ✅	1.04825	1.04829
			STP 2022.4_default	sat ✅	1.04490	1.04493
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	34.98830	63.69830
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.74038	0.74037
		Z3-Owl	z3-Owl-Final_default	sat ✅	25.34610	25.33650
			z3-Owl-Final_default	sat ✅	27.23140	27.22980
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	0.91587	0.81527
		cvc5	cvc5	sat ✅	10.87077	10.76919
		SMTInterpol	SMTInterpol	sat ✅	27.76059	49.36740
		STP	STP	sat ✅	0.96527	0.86531
		Yices2	Yices2	sat ✅	0.65877	0.55835
		Z3alpha	Z3-alpha	sat ✅	3.57901	3.47925
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	0.71004	0.58991
			Bitwuzla-MachBV-base	sat ✅	1.39874	1.27911
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	1.41525	1.29473
		BVDecide	bv_decide	sat ✅	7.87482	7.70892
			bv_decide-nokernel	sat ✅	7.54070	7.40452
		cvc5	cvc5	sat ✅	9.48885	9.36690
		SMTInterpol	SMTInterpol	sat ✅	12.51607	25.95873
		Yices2	Yices2	sat ✅	0.78536	0.66216
		Z3alpha	Z3-alpha	sat ✅	4.33723	15.68778
		Z3	Z3-alpha-base	sat ✅	8.73870	8.61452
			Z3-Owl-base	sat ✅	36.04857	35.91549
			z3siri-base	sat ✅	9.05911	8.92761
		Z3-Owl	Z3-Owl	sat ✅	11.51245	11.38047