Benchmark

non-incremental/QF_BV/Sage2/bench_11099.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	659342
Compressed Size	37618
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	659334
Compressed Size	37607
Max. Term Depth	374
Asserts	1358
Declared Functions	0
Declared Constants	796
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	3	ite	2	not	202
=	422	let	13002	extract	41	bvand	29
bvor	433	bvadd	7199	bvmul	680	bvult	90
bvule	202	bvugt	61	bvuge	409	bvslt	32
bvsle	26	bvsgt	62	bvsge	58	bvshl	1185
bvlshr	66	zero_extend	3160

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.62 (3/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	62.49320	62.49510
			Boolector SMT17 final boolector	sat ✅	543.71000	543.64100
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.21800	1204.64000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.01400	599.83000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	9.15971	12.56000
		Q3B	Q3B default	unknown ❌	600.07800	1791.07000
		STP	stp_st default	unknown ❌	600.07900	599.93000
			stp_mt default	unknown ❌	600.07600	1897.17000
		Yices2	Yices2-Main default	sat ✅	0.34105	0.32436
		Z3	z3-4.5.0 default	unknown ❌	600.02100	599.85900
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	9.58300	9.58246
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	25.74970	25.74690
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.01000	1199.85000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	4.66563	16.00200
			Minkeyrink ST_st	sat ✅	10.95470	10.95340
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	1200.11000	1199.90000
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	1200.11000	4768.38000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	847.95000	847.85100
		Yices2	Yices 2.6.0_default	sat ✅	0.42496	0.42486
		Z3	z3-4.7.1_default	sat ✅	818.35100	818.21200
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	9.11651	9.11597
			Poolector-wrapped-sq_default	sat ✅	10.30080	40.35000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	387.32500	387.28100
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	18.12630	18.12490
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	4.42858	15.48610
			MinkeyRink ST-wrapped-sq_default	sat ✅	11.23560	11.23420
		Par4	Par4-wrapped-sq_default	sat ✅	0.35567	0.00597
		STP	STP-2019-wrapped-sq_default	unknown ❌	2400.02000	2399.90000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	34.13060	34.12610
			stp-minisat-wrapped-sq_default	sat ✅	70.78920	70.73350
			stp-mt-wrapped-sq_default	unknown ❌	2400.08000	9529.38000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	2400.03000	2517.78000
			stp-riss-wrapped-sq_default	unknown ❌	2.29875	2.29879
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.37556	0.37543
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	3.42156	3.42121
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	4.54653	4.54656
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	5.01127	5.01047
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.58120	0.58115
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	1602.88000	1602.53000
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	5.77874	5.77842
		MathSAT	mathsat-5.6.6_default	sat ✅	52.49880	52.49660
		STP	STP 2021.0_default	sat ✅	25.23270	93.91000
		Z3	z3-4.8.11_default	sat ✅	72.99090	72.99000
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	6.66774	6.66744
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	20.02320	20.02150
		STP	STP 2022.4_default	sat ✅	4.77698	4.77646
			STP 2022.4_default	sat ✅	4.77904	4.77879
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.08000	1261.05000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.32905	0.32902
		Z3-Owl	z3-Owl-Final_default	sat ✅	192.71100	192.71400
			z3-Owl-Final_default	sat ✅	141.53500	141.51300