Benchmark

non-incremental/QF_BV/Sage2/bench_16393.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	8659620
Compressed Size	36909
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	8659612
Compressed Size	36897
Max. Term Depth	425
Asserts	817
Declared Functions	0
Declared Constants	2492
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	ite	60	not	179
=	212	let	57356	extract	9	bvand	4
bvor	10	bvadd	126840	bvmul	830	bvudiv	136
bvult	180	bvule	157	bvugt	43	bvuge	277
bvsle	2	bvsge	6	bvshl	94566	bvlshr	32
zero_extend	126280

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.50 (4/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	8.08801	8.08576
			Boolector SMT17 final boolector	unknown ❌	600.10400	600.03000
		CVC4	CVC4-smtcomp2017-main default	sat ✅	70.46380	62.35790
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.01800	599.80000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	4.63692	4.65097
		Q3B	Q3B default	unknown ❌	600.03700	1799.47000
		STP	stp_st default	unknown ❌	600.01400	602.04300
			stp_mt default	unknown ❌	600.06100	2380.51000
		Yices2	Yices2-Main default	sat ✅	2.13480	2.13484
		Z3	z3-4.5.0 default	unknown ❌	600.02100	599.84000
SMT-COMP 2018	0.29 (5/7)	Boolector	Boolector_default	sat ✅	5.40329	5.40249
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	31.76230	31.75980
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.06000	1199.90000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	6.86770	19.43420
			Minkeyrink ST_st	sat ✅	4.78137	4.78036
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	1200.02000	1199.88000
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	1200.07000	4761.24000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	578.54700	578.53800
		Yices2	Yices 2.6.0_default	sat ✅	2.14933	2.14891
		Z3	z3-4.7.1_default	unknown ❌	1200.02000	1199.72000
SMT-COMP 2019	0.12 (7/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	12.36870	12.36820
			Poolector-wrapped-sq_default	sat ✅	14.12010	55.41000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	2104.77000	2104.54000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	45.68210	45.67380
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	8.41422	25.83230
			MinkeyRink ST-wrapped-sq_default	sat ✅	6.76308	6.76353
		Par4	Par4-wrapped-sq_default	sat ✅	1.26468	3.71000
		STP	STP-2019-wrapped-sq_default	sat ✅	1656.31000	1656.17000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	1165.58000	1165.53000
			stp-minisat-wrapped-sq_default	unknown ❌	2400.02000	2399.60000
			stp-mt-wrapped-sq_default	sat ✅	2352.00000	9338.42000
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.03000	5486.34000
			stp-riss-wrapped-sq_default	unknown ❌	2.32313	2.32336
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	1.30933	1.30919
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	5.10425	5.10444
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	25.70090	25.70070
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.86000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	2.00836	2.00810
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.02000	2399.33000
SMT-COMP 2022	0.57 (3/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	10.92120	10.92060
			Bitwuzla-wrapped_default	sat ✅	10.91810	10.91600
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unknown ❌	1200.05000	1199.38000
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.02000	1199.68000
		STP	STP 2022.4_default	sat ✅	3.26168	3.17848
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	6.60718	6.60628
		Z3++BV	z3++bv_0702_default	unknown ❌	1200.02000	1199.45000
		Z3	z3-4.8.17_default	unknown ❌	1200.02000	1199.68000
SMT-COMP 2024	0.50 (3/6)	Bitwuzla	Bitwuzla	sat ✅	5.39704	5.29544
		cvc5	cvc5	unknown ❌	1202.21896	1201.67398
		SMTInterpol	SMTInterpol	unknown ❌	160.34724	200.50342
		STP	STP	sat ✅	5.38438	5.28217
		Yices2	Yices2	sat ✅	4.19408	4.09422
		Z3alpha	Z3-alpha	unknown ❌	1201.72790	1201.37809
SMT-COMP 2025	0.56 (4/9)	Bitwuzla	Bitwuzla	sat ✅	2.58579	2.46750
			Bitwuzla-MachBV-base	sat ✅	4.52912	4.40859
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	4.58488	4.46508
		BVDecide	bv_decide	sat ✅	138.12154	137.98455
			bv_decide-nokernel	sat ✅	127.75084	127.62216
		cvc5	cvc5	unknown ❌	1202.28966	1201.59755
		SMTInterpol	SMTInterpol	unknown ❌	127.74286	154.91159
		Yices2	Yices2	sat ✅	4.36611	4.23604
		Z3alpha	Z3-alpha	unknown ❌	1202.27937	4799.89373
		Z3	Z3-alpha-base	unknown ❌	1201.57095	1201.31598
			Z3-Owl-base	unknown ❌	1201.53914	1201.26761
			z3siri-base	unknown ❌	1201.54363	1201.26890
		Z3-Owl	Z3-Owl	unknown ❌	1201.79124	1201.50943