Benchmark

non-incremental/QF_BV/Sage2/bench_16148.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	500658
Compressed Size	12329
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	500650
Compressed Size	12321
Max. Term Depth	142
Asserts	466
Declared Functions	0
Declared Constants	55
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	6	not	69	=	102
let	11829	extract	58	bvand	27	bvadd	5321
bvmul	770	bvult	17	bvule	13	bvugt	11
bvuge	15	bvslt	82	bvsle	56	bvsgt	64
bvsge	111	bvshl	2265	bvashr	305	zero_extend	3008

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	1.16467	1.16425
			Boolector SMT17 final boolector	sat ✅	3.40803	3.40790
		CVC4	CVC4-smtcomp2017-main default	sat ✅	1.46277	2.71135
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	2.21088	2.21060
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.83284	0.80093
		Q3B	Q3B default	unknown ❌	0.47568	1.03415
		STP	stp_st default	sat ✅	112.32000	112.27300
			stp_mt default	sat ✅	62.00090	244.89000
		Yices2	Yices2-Main default	sat ✅	0.19510	0.19382
		Z3	z3-4.5.0 default	sat ✅	109.02300	108.98100
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	1.04365	1.04359
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	2.36979	2.36994
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	4.13988	4.14051
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.47135	0.80800
			Minkeyrink ST_st	sat ✅	0.44311	0.44327
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	1200.02000	1199.99000
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	1014.72000	4036.84000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	345.18600	345.18500
		Yices2	Yices 2.6.0_default	sat ✅	0.16559	0.16549
		Z3	z3-4.7.1_default	unknown ❌	1200.11000	1200.11000
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	1.90506	1.90470
			Poolector-wrapped-sq_default	sat ✅	0.78473	2.58000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	3.15012	3.14989
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	2.83208	2.83212
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.42567	0.78348
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.40264	0.40269
		Par4	Par4-wrapped-sq_default	sat ✅	0.20154	0.00636
		STP	STP-2019-wrapped-sq_default	sat ✅	486.27300	486.26300
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	1895.88000	1895.70000
			stp-minisat-wrapped-sq_default	unknown ❌	2400.01000	2399.84000
			stp-mt-wrapped-sq_default	unknown ❌	2400.06000	9537.80000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	2400.12000	4996.58000
			stp-riss-wrapped-sq_default	unknown ❌	0.43015	0.43018
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.20518	0.20518
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.52326	0.52312
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.44867	0.44866
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.69000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.25195	0.25190
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	1715.86000	1715.78000
SMT-COMP 2020	0.33 (6/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.76767	0.76760
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.77823	0.77823
			Poolector-wrapped-sq_default	sat ✅	0.88189	3.04000
		CVC4	CVC4-sq-final_default	unknown ❌	1200.03000	1199.89000
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.91000
		MathSAT	MathSAT5_default.sh	sat ✅	5.64385	5.64365
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.32077	0.30515
			MinkeyRink Solver 2020.3_default	sat ✅	0.40268	0.68559
		STP	STP_default	sat ✅	0.38719	0.73251
			STP ++ Mergsat v1_default	sat ✅	0.45633	0.45802
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.31521	0.31515
		Z3	z3-4.8.8_default	unknown ❌	1200.02000	1199.97000
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.75184	0.75173
			Bitwuzla-wrapped_default	sat ✅	0.79942	0.79657
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unknown ❌	1200.02000	1199.90000
		MathSAT	MathSAT-5.6.8_default	sat ✅	9.77710	9.77680
		STP	STP 2022.4_default	sat ✅	0.37207	0.37208
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.30979	0.30966
		Z3++BV	z3++bv_0702_default	sat ✅	108.61800	108.60000
		Z3	z3-4.8.17_default	sat ✅	557.94500	557.86500