Benchmark

non-incremental/QF_BV/Sage2/bench_4243.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1994938
Compressed Size	11496
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1994930
Compressed Size	11487
Max. Term Depth	481
Asserts	330
Declared Functions	0
Declared Constants	94
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	1	not	105	=	134
let	47081	extract	8	bvand	4	bvor	2
bvadd	23731	bvmul	6053	bvudiv	81	bvult	10
bvule	48	bvugt	1	bvuge	96	bvsle	20
bvsgt	2	bvsge	19	bvshl	3	bvlshr	26
zero_extend	17066

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	17.05690	17.05280
			Boolector SMT17 final boolector	sat ✅	525.40700	525.35900
		CVC4	CVC4-smtcomp2017-main default	sat ✅	6.24251	11.70260
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	17.05010	17.04840
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.50240	1.48224
		Q3B	Q3B default	unknown ❌	600.03800	1201.27000
		STP	stp_st default	sat ✅	372.96300	372.91300
			stp_mt default	unknown ❌	600.07700	2380.16000
		Yices2	Yices2-Main default	sat ✅	0.32191	0.32106
		Z3	z3-4.5.0 default	sat ✅	147.35300	147.31900
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.91046	2.91039
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	5.36540	5.36565
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	18.35060	18.34870
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.36776	3.38530
			Minkeyrink ST_st	sat ✅	1.21025	1.21029
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	503.88200	503.89700
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	226.07900	892.94300
			STP-Riss-st-2018_riss-no-stderr	sat ✅	188.20500	188.20300
		Yices2	Yices 2.6.0_default	sat ✅	0.26935	0.26915
		Z3	z3-4.7.1_default	sat ✅	37.08480	37.08070
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	6.72446	6.72446
			Poolector-wrapped-sq_default	sat ✅	7.57985	29.50070
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	736.36900	736.32300
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	5.97996	5.97935
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	1.62084	3.44540
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.44371	1.44383
		Par4	Par4-wrapped-sq_default	sat ✅	0.25911	0.00615
		STP	STP-2019-wrapped-sq_default	sat ✅	418.25100	418.23500
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	108.25500	108.25500
			stp-minisat-wrapped-sq_default	sat ✅	2018.27000	2018.05000
			stp-mt-wrapped-sq_default	sat ✅	1491.05000	5918.04000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	2027.26000	2589.49000
			stp-riss-wrapped-sq_default	unknown ❌	2.20313	2.20332
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.25392	0.25390
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.31963	0.31962
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	1.58402	1.58389
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.06000	2400.05000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.30971	0.30971
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	208.98800	208.96100
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	13.29680	13.29450
		Boolector	Boolector-wrapped-sq_default	sat ✅	6.55760	6.55705
			Poolector-wrapped-sq_default	sat ✅	7.70030	30.01900
		CVC4	CVC4-sq-final_default	sat ✅	6.26579	6.26617
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.88000
		MathSAT	MathSAT5_default.sh	sat ✅	14.79640	14.79590
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.73779	0.73800
			MinkeyRink Solver 2020.3_default	sat ✅	0.85213	1.16248
		STP	STP_default	sat ✅	1.34582	2.95498
			STP ++ Mergsat v1_default	sat ✅	1.42670	1.42842
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.32896	0.32887
		Z3	z3-4.8.8_default	sat ✅	220.71700	220.62000
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	13.31900	13.31810
		MathSAT	mathsat-5.6.6_default	sat ✅	15.53690	15.53290
		STP	STP 2021.0_default	sat ✅	1.16259	2.29572
		Z3	z3-4.8.11_default	sat ✅	16.22540	16.22440
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.65872	1.65838
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	6.88366	6.87867
		STP	STP 2022.4_default	sat ✅	1.45906	1.45914
			STP 2022.4_default	sat ✅	1.47213	1.47185
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	4.30176	11.16330
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.32012	0.32006
		Z3-Owl	z3-Owl-Final_default	sat ✅	351.53500	351.47100
			z3-Owl-Final_default	sat ✅	427.50400	427.32600
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	0.48805	0.36151
			Bitwuzla-MachBV-base	sat ✅	0.92509	0.80215
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	2.64628	2.52921
		BVDecide	bv_decide	sat ✅	35.97256	35.83188
			bv_decide-nokernel	sat ✅	36.51607	36.36633
		cvc5	cvc5	sat ✅	6.90995	6.78580
		SMTInterpol	SMTInterpol	unknown ❌	96.54613	119.24289
		Yices2	Yices2	sat ✅	0.53022	0.40741
		Z3alpha	Z3-alpha	sat ✅	24.21418	93.18733
		Z3	Z3-alpha-base	sat ✅	980.43177	980.15356
			Z3-Owl-base	unknown ❌	1201.37619	1201.06150
			z3siri-base	sat ✅	968.19672	967.91071
		Z3-Owl	Z3-Owl	sat ✅	319.94710	319.78092