Benchmark

non-incremental/QF_BV/Sage2/bench_9110.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	16989
Compressed Size	1512
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	16981
Compressed Size	1504
Max. Term Depth	21
Asserts	58
Declared Functions	0
Declared Constants	6
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	13	=	14	let	367
bvadd	201	bvmul	4	bvult	8	bvule	19
bvugt	2	bvuge	14	bvlshr	6	zero_extend	143

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.05547	0.05418
			Boolector SMT17 final boolector	unsat ✅	0.14907	0.14821
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.44940	0.87625
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.06246	0.06288
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.09546	0.05948
		Q3B	Q3B default	unsat ✅	0.13488	0.13402
		STP	stp_st default	unsat ✅	0.18524	0.18402
			stp_mt default	unsat ✅	0.17535	0.57607
		Yices2	Yices2-Main default	unsat ✅	0.00984	0.00592
		Z3	z3-4.5.0 default	unsat ✅	47.60220	47.60020
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.03780	0.03771
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.11244	0.11265
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.06369	0.06471
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.04547	0.05129
			Minkeyrink ST_st	unsat ✅	0.04297	0.04238
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.38306	0.38326
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.26593	0.93396
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.28377	0.28351
		Yices2	Yices 2.6.0_default	unsat ✅	0.00798	0.00794
		Z3	z3-4.7.1_default	unsat ✅	40.93880	40.94010
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.05961	0.05962
			Poolector-wrapped-sq_default	unsat ✅	0.17861	0.17252
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.09358	0.09356
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.06327	0.06356
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.05733	0.06132
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.05404	0.05413
		Par4	Par4-wrapped-sq_default	unsat ✅	0.01974	0.00578
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.15850	0.15864
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	4.44473	4.44399
			stp-minisat-wrapped-sq_default	unsat ✅	0.15650	0.15673
			stp-mt-wrapped-sq_default	unsat ✅	0.16484	0.51184
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	4.42593	4.66921
			stp-riss-wrapped-sq_default	unknown ❌	0.03904	0.03921
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.00901	0.00815
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.00957	0.00957
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.00947	0.00949
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.82000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.01096	0.01098
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	29.78060	29.77120
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08178	0.08174
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.03729	0.03726
		STP	STP 2021.0_default	unsat ✅	0.02776	0.03211
		Z3	z3-4.8.11_default	unsat ✅	4.86652	4.86565
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08817	0.08814
			Bitwuzla-wrapped_default	unsat ✅	0.09237	0.09231
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.29286	0.29281
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.03620	0.03600
		STP	STP 2022.4_default	unsat ✅	0.02482	0.02490
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.02380	0.00791
		Z3++BV	z3++bv_0702_default	unsat ✅	2.72980	2.72958
		Z3	z3-4.8.17_default	unsat ✅	11.10330	11.10510
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.02415	0.02409
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.34509	0.34565
		STP	STP 2022.4_default	unsat ✅	0.02549	0.02553
			STP 2022.4_default	unsat ✅	0.02632	0.02634
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unsat ✅	4.73008	12.94360
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.01062	0.00644
		Z3-Owl	z3-Owl-Final_default	unsat ✅	2.51695	2.51685
			z3-Owl-Final_default	unsat ✅	2.72606	2.72615
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.27710	0.17736
		cvc5	cvc5	unsat ✅	0.48058	0.38120
		SMTInterpol	SMTInterpol	unsat ✅	0.70654	1.48168
		STP	STP	unsat ✅	0.22558	0.12536
		Yices2	Yices2	unsat ✅	0.21233	0.11253
		Z3alpha	Z3-alpha	unsat ✅	7.72614	7.62624