Benchmark

non-incremental/QF_BV/Sage2/bench_17313.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	153912
Compressed Size	13051
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	153904
Compressed Size	12937
Max. Term Depth	87
Asserts	531
Declared Functions	0
Declared Constants	170
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	12	not	57	=	131
let	2865	extract	67	bvand	17	bvor	83
bvadd	1139	bvmul	540	bvult	130	bvule	153
bvugt	41	bvuge	87	bvshl	103	bvlshr	52
zero_extend	783

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.23041	0.22943
			Boolector SMT17 final boolector	unsat ✅	0.93151	0.93052
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	64.88340	130.09500
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	4.56081	3.00473
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.38961	0.34597
		Q3B	Q3B default	unknown ❌	600.05000	1785.96000
		STP	stp_st default	unsat ✅	32.29420	32.29200
			stp_mt default	unsat ✅	30.08860	118.78600
		Yices2	Yices2-Main default	unsat ✅	0.05874	0.05814
		Z3	z3-4.5.0 default	unsat ✅	5.35534	5.35449
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.22111	0.22106
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	249.06800	249.07400
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	2.36070	2.36169
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.21411	0.30487
			Minkeyrink ST_st	unsat ✅	0.20431	0.20439
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	128.39800	128.39200
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	90.67340	359.87900
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	80.03090	80.00990
		Yices2	Yices 2.6.0_default	unsat ✅	0.06124	0.06114
		Z3	z3-4.7.1_default	unsat ✅	7.09707	7.09598
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.19350	0.19351
			Poolector-wrapped-sq_default	unsat ✅	0.28032	0.43013
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.92345	0.92347
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	161.46000	161.45200
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.22651	0.33248
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.20752	0.20760
		Par4	Par4-wrapped-sq_default	unsat ✅	0.06731	0.00579
		STP	STP-2019-wrapped-sq_default	unsat ✅	47.35490	47.35180
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	92.67350	92.65970
			stp-minisat-wrapped-sq_default	unsat ✅	80.99240	80.98480
			stp-mt-wrapped-sq_default	unsat ✅	41.62310	164.53500
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	94.87560	232.66500
			stp-riss-wrapped-sq_default	unknown ❌	0.27650	0.27673
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.05829	0.05832
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.07863	0.07862
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.08044	0.08047
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.11856	0.11854
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.11918	0.11902
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	1.58371	1.58369
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.32563	0.32554
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.19694	0.19695
			Poolector-wrapped-sq_default	unsat ✅	0.28036	0.23073
		CVC4	CVC4-sq-final_default	unsat ✅	464.52300	464.49400
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.93000
		MathSAT	MathSAT5_default.sh	unsat ✅	2.85329	2.85341
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.18813	0.18838
			MinkeyRink Solver 2020.3_default	unsat ✅	0.22530	0.33150
		STP	STP_default	unsat ✅	0.20666	0.33673
			STP ++ Mergsat v1_default	unsat ✅	0.18511	0.18679
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.06991	0.06987
		Z3	z3-4.8.8_default	unsat ✅	48.56150	48.56150
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.29004	0.28991
		MathSAT	mathsat-5.6.6_default	unsat ✅	2.24530	2.24532
		STP	STP 2021.0_default	unsat ✅	0.19576	0.32175
		Z3	z3-4.8.11_default	unsat ✅	46.32030	46.31930
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.52492	0.52486
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	55.76890	55.76370
		STP	STP 2022.4_default	unsat ✅	0.18289	0.18294
			STP 2022.4_default	unsat ✅	0.18895	0.18657
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1236.40000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.06994	0.06988
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.02000	1199.83000
			z3-Owl-Final_default	unsat ✅	282.93700	282.92800
SMT-COMP 2024	0.33 (4/6)	Bitwuzla	Bitwuzla	unsat ✅	0.38541	0.28550
		cvc5	cvc5	unsat ✅	51.41389	51.31228
		SMTInterpol	SMTInterpol	unknown ❌	1201.71979	1231.12740
		STP	STP	unsat ✅	0.34146	0.24170
		Yices2	Yices2	unsat ✅	0.26063	0.16035
		Z3alpha	Z3-alpha	unknown ❌	1201.71827	1200.66586