Benchmark

non-incremental/QF_BV/Sage2/bench_13855.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1644827
Compressed Size	15987
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	1644819
Compressed Size	15979
Max. Term Depth	1065
Asserts	345
Declared Functions	0
Declared Constants	349
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	123	not	105	=	115
let	37346	extract	3	bvand	18	bvadd	23970
bvmul	299	bvult	170	bvule	47	bvugt	27
bvuge	108	bvlshr	48	zero_extend	12657

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.25 (6/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	3.54981	3.54840
			Boolector SMT17 final boolector	unsat ✅	3.20290	3.20123
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	1.52828	2.36065
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	1.13688	1.13650
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.25046	0.25008
		Q3B	Q3B default	unknown ❌	600.07800	1799.70000
		STP	stp_st default	unsat ✅	0.23022	0.22812
			stp_mt default	unsat ✅	0.23783	0.23839
		Yices2	Yices2-Main default	unsat ✅	0.24515	0.24394
		Z3	z3-4.5.0 default	unknown ❌	600.01100	600.00800
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	unsat ✅	0.42701	0.42492
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	1.84099	1.84119
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	1.06080	1.06181
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.25192	0.25195
			Minkeyrink ST_st	unsat ✅	0.25143	0.25147
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.20728	0.20745
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.20991	0.21080
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.20170	0.20172
		Yices2	Yices 2.6.0_default	unsat ✅	0.25005	0.24998
		Z3	z3-4.7.1_default	unknown ❌	1200.02000	1200.03000
SMT-COMP 2019	0.12 (7/8)	Boolector	Boolector-wrapped-sq_default	unsat ✅	2.96952	2.96945
			Poolector-wrapped-sq_default	unsat ✅	0.88654	3.15000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.66164	0.66162
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	9.26583	18.45410
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.42488	0.42506
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.42281	0.42287
		Par4	Par4-wrapped-sq_default	unsat ✅	0.25930	0.00592
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.43274	0.43280
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.45160	0.45176
			stp-minisat-wrapped-sq_default	unsat ✅	0.43905	0.43924
			stp-mt-wrapped-sq_default	unsat ✅	0.45785	0.53235
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.48390	0.60620
			stp-riss-wrapped-sq_default	unknown ❌	0.43267	0.43286
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.22516	0.22516
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.22425	0.22425
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.22372	0.22372
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	470.91800	470.83400
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.22427	0.22427
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.02000	2399.88000
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	4.31773	4.31747
		Boolector	Boolector-wrapped-sq_default	unsat ✅	4.18085	4.18065
			Poolector-wrapped-sq_default	unsat ✅	3.00126	11.41000
		CVC4	CVC4-sq-final_default	unsat ✅	310.32000	310.24600
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.12000	1199.46000
		MathSAT	MathSAT5_default.sh	unsat ✅	0.70162	0.70139
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unsat ✅	0.35084	0.35091
			MinkeyRink Solver 2020.3_default	unsat ✅	0.37142	0.37150
		STP	STP_default	unsat ✅	0.21328	0.22628
			STP ++ Mergsat v1_default	unsat ✅	0.19939	0.20105
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.26446	0.26438
		Z3	z3-4.8.8_default	unknown ❌	1200.10000	1199.92000
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	4.47530	4.47518
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.66518	0.66504
		STP	STP 2021.0_default	unsat ✅	0.21004	0.22332
		Z3	z3-4.8.11_default	unsat ✅	342.04000	342.02600
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	3.68913	3.68769
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	655.22400	654.93000
		STP	STP 2022.4_default	unsat ✅	0.13699	0.13706
			STP 2022.4_default	unsat ✅	0.13660	0.13659
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unsat ✅	13.19920	35.22040
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.25748	0.25739
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.04000	1199.89000
			z3-Owl-Final_default	unsat ✅	1131.41000	1131.19000