Benchmark

non-incremental/QF_BV/Sage2/bench_8433.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	3007618
Compressed Size	42251
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	3007610
Compressed Size	42240
Max. Term Depth	231
Asserts	1176
Declared Functions	0
Declared Constants	364
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	239	=	272	let	67281
extract	49	bvand	46	bvor	20	bvadd	25378
bvmul	1379	bvult	189	bvule	236	bvugt	37
bvuge	394	bvsle	12	bvsgt	17	bvsge	18
bvshl	17036	bvlshr	356	bvashr	90	zero_extend	22688

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	22.08690	22.08170
			Boolector SMT17 final boolector	sat ✅	235.33500	235.32500
		CVC4	CVC4-smtcomp2017-main default	sat ✅	97.17760	194.27200
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.02100	599.89000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	5.47549	5.54004
		Q3B	Q3B default	unknown ❌	600.03600	1799.61000
		STP	stp_st default	sat ✅	454.30600	454.19500
			stp_mt default	sat ✅	122.59500	477.29200
		Yices2	Yices2-Main default	sat ✅	8.03886	8.03917
		Z3	z3-4.5.0 default	unknown ❌	600.01200	599.89200
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	10.57700	10.57270
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	24.54360	24.53960
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	341.24300	341.16900
		MinkeyRink	Minkeyrink MT_mt	sat ✅	7.44373	25.53900
			Minkeyrink ST_st	sat ✅	5.67169	5.66619
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	138.19400	138.17900
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	89.15270	344.79100
			STP-Riss-st-2018_riss-no-stderr	sat ✅	59.17760	59.17400
		Yices2	Yices 2.6.0_default	sat ✅	1.77299	1.77279
		Z3	z3-4.7.1_default	sat ✅	1173.69000	1173.59000
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	18.09610	18.09590
			Poolector-wrapped-sq_default	sat ✅	22.81270	90.01000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	384.35900	384.34400
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	39.52540	39.50790
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	6.13849	20.65400
			MinkeyRink ST-wrapped-sq_default	sat ✅	5.09293	5.09238
		Par4	Par4-wrapped-sq_default	sat ✅	1.18598	3.44000
		STP	STP-2019-wrapped-sq_default	sat ✅	124.17100	124.11200
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	46.62960	46.61520
			stp-minisat-wrapped-sq_default	sat ✅	15.13380	15.12390
			stp-mt-wrapped-sq_default	sat ✅	101.66700	394.75400
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	130.92600	199.70600
			stp-riss-wrapped-sq_default	unknown ❌	2.65776	2.64443
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	1.13030	1.13034
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	4.57597	4.57587
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	7.78588	7.78516
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.01000	2399.68000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	2.21422	2.21409
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	651.12100	651.03300
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	17.69500	17.69260
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.02000	1199.68000
		STP	STP 2021.0_default	sat ✅	4.13975	13.69400
		Z3	z3-4.8.11_default	sat ✅	143.49700	143.45500
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	18.22560	18.22460
			Bitwuzla-wrapped_default	sat ✅	17.87130	17.86960
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	38.02210	38.02120
		MathSAT	MathSAT-5.6.8_default	sat ✅	941.65000	941.34400
		STP	STP 2022.4_default	sat ✅	3.34999	3.34993
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	4.89635	4.89600
		Z3++BV	z3++bv_0702_default	sat ✅	32.85910	32.85460
		Z3	z3-4.8.17_default	sat ✅	367.07500	366.97800
SMT-COMP 2024	0.33 (4/6)	Bitwuzla	Bitwuzla	sat ✅	11.29661	11.19079
		cvc5	cvc5	sat ✅	56.49685	56.39537
		SMTInterpol	SMTInterpol	unknown ❌	1201.72070	1238.17488
		STP	STP	sat ✅	4.56837	4.46605
		Yices2	Yices2	sat ✅	3.44307	3.34270
		Z3alpha	Z3-alpha	unknown ❌	1201.72644	1201.07181
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	5.55607	5.42994
			Bitwuzla-MachBV-base	sat ✅	6.89317	6.77441
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	6.98451	6.86490
		BVDecide	bv_decide	sat ✅	36.86738	36.72663
			bv_decide-nokernel	sat ✅	36.08546	35.93545
		cvc5	cvc5	sat ✅	50.08503	49.95320
		SMTInterpol	SMTInterpol	unknown ❌	1201.48568	1242.80568
		Yices2	Yices2	sat ✅	3.34080	3.21928
		Z3alpha	Z3-alpha	sat ✅	1131.23257	4492.14339
		Z3	Z3-alpha-base	unknown ❌	1201.32718	1201.07912
			Z3-Owl-base	unknown ❌	1201.36796	1201.09169
			z3siri-base	unknown ❌	1201.32671	1201.02993
		Z3-Owl	Z3-Owl	sat ✅	486.63096	486.41363