Benchmark

non-incremental/QF_BV/Sage2/bench_8998.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	16989
Compressed Size	1515
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	16981
Compressed Size	1505
Max. Term Depth	21
Asserts	58
Declared Functions	0
Declared Constants	6
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	13	=	14	let	367
bvadd	201	bvmul	4	bvult	7	bvule	19
bvugt	2	bvuge	15	bvlshr	6	zero_extend	143

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.05906	0.05867
			Boolector SMT17 final boolector	unsat ✅	0.16227	0.16098
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.41137	0.80193
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.06322	0.06298
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.09541	0.05969
		Q3B	Q3B default	unsat ✅	0.12441	0.12351
		STP	stp_st default	unsat ✅	0.19109	0.19063
			stp_mt default	unsat ✅	0.20178	0.66432
		Yices2	Yices2-Main default	unsat ✅	0.00764	0.00556
		Z3	z3-4.5.0 default	unsat ✅	48.59440	48.59050
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.03989	0.03984
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.11247	0.11262
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.06480	0.06584
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.04402	0.04872
			Minkeyrink ST_st	unsat ✅	0.04133	0.04154
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.29037	0.29054
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.26087	0.92361
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.34683	0.34691
		Yices2	Yices 2.6.0_default	unsat ✅	0.00813	0.00805
		Z3	z3-4.7.1_default	unsat ✅	34.06310	34.06140
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.06444	0.06447
			Poolector-wrapped-sq_default	unsat ✅	0.17877	0.17594
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.09410	0.09412
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.06323	0.06349
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.05203	0.05516
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.04894	0.04899
		Par4	Par4-wrapped-sq_default	unsat ✅	0.01787	0.00660
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.24098	0.24102
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	4.03374	4.03395
			stp-minisat-wrapped-sq_default	unsat ✅	0.12785	0.12804
			stp-mt-wrapped-sq_default	unsat ✅	0.25036	0.83860
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	4.08173	4.38664
			stp-riss-wrapped-sq_default	unknown ❌	0.04028	0.04045
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.00888	0.00832
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.01203	0.01042
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.01042	0.00982
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.07000	2400.02000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.01139	0.01134
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	13.92770	13.92190
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08618	0.08616
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.06513	0.06517
			Poolector-wrapped-sq_default	unsat ✅	0.17751	0.26848
		CVC4	CVC4-sq-final_default	unsat ✅	1.31644	1.31654
		LazyBV2Int	LazyBV2Int20200523_default.sh	unsat ✅	0.07358	0.07354
		MathSAT	MathSAT5_default.sh	unsat ✅	0.03466	0.03462
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.04467	0.04498
			MinkeyRink Solver 2020.3_default	unsat ✅	0.04701	0.05022
		STP	STP_default	unsat ✅	0.02761	0.03227
			STP ++ Mergsat v1_default	unsat ✅	0.01916	0.02084
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.01069	0.00793
		Z3	z3-4.8.8_default	unsat ✅	29.77100	29.76910
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08460	0.08457
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.03710	0.03707
		STP	STP 2021.0_default	unsat ✅	0.02783	0.03208
		Z3	z3-4.8.11_default	unsat ✅	5.09042	5.09014
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.09052	0.09048
			Bitwuzla-wrapped_default	unsat ✅	0.08676	0.08673
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.32872	0.32927
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.03557	0.03548
		STP	STP 2022.4_default	unsat ✅	0.02497	0.02500
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.01053	0.00779
		Z3++BV	z3++bv_0702_default	unsat ✅	3.78109	3.78018
		Z3	z3-4.8.17_default	unsat ✅	21.87880	21.88020
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.02387	0.02383
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	0.30519	0.30563
		STP	STP 2022.4_default	unsat ✅	0.02505	0.02510
			STP 2022.4_default	unsat ✅	0.02504	0.02508
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unsat ✅	4.65658	12.31230
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.01017	0.00643
		Z3-Owl	z3-Owl-Final_default	unsat ✅	2.49975	2.49947
			z3-Owl-Final_default	unsat ✅	2.80301	2.80028