Benchmark

non-incremental/QF_BV/Sage2/bench_5348.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1701601
Compressed Size	20836
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1701593
Compressed Size	20845
Max. Term Depth	489
Asserts	628
Declared Functions	0
Declared Constants	162
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	9	not	148	=	174
let	40340	extract	12	bvand	37	bvor	6
bvadd	26198	bvmul	227	bvudiv	44	bvult	95
bvule	118	bvugt	47	bvuge	181	bvslt	5
bvsle	3	bvsgt	3	bvsge	10	bvshl	8
bvlshr	69	zero_extend	13573

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.50 (4/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	555.13300	554.96800
			Boolector SMT17 final boolector	unknown ❌	600.01300	599.95900
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.07800	1204.69000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	13.26140	6.96631
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	3.87799	3.92813
		Q3B	Q3B default	unknown ❌	600.02400	1201.74000
		STP	stp_st default	unknown ❌	600.02700	599.96000
			stp_mt default	unknown ❌	600.08700	1568.23000
		Yices2	Yices2-Main default	sat ✅	0.43832	0.43703
		Z3	z3-4.5.0 default	unknown ❌	600.03500	600.01800
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	4.20109	4.20079
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	8.75125	8.75011
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	5.33140	5.33209
		MinkeyRink	Minkeyrink MT_mt	sat ✅	5.05564	18.74490
			Minkeyrink ST_st	sat ✅	4.55899	4.55902
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	857.92300	857.77400
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	377.11700	1490.91000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	270.26800	270.19600
		Yices2	Yices 2.6.0_default	sat ✅	0.30378	0.30367
		Z3	z3-4.7.1_default	sat ✅	1155.41000	1155.32000
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	20.79780	20.78510
			Poolector-wrapped-sq_default	sat ✅	23.23060	91.56060
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	749.14600	749.12400
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	9.37695	9.37607
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.67901	1.52011
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.65173	0.65180
		Par4	Par4-wrapped-sq_default	sat ✅	0.22094	0.00626
		STP	STP-2019-wrapped-sq_default	sat ✅	1346.13000	1346.15000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	346.54200	346.51100
			stp-minisat-wrapped-sq_default	sat ✅	439.09400	439.03200
			stp-mt-wrapped-sq_default	sat ✅	1093.82000	4332.14000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	1418.58000	2339.40000
			stp-riss-wrapped-sq_default	unknown ❌	2.94708	2.94718
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.22295	0.22294
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.63623	0.63620
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.95262	0.95268
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.11000	2399.94000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.27624	0.27623
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	245.76200	245.66800
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	45.22800	45.22440
		Boolector	Boolector-wrapped-sq_default	sat ✅	3.87253	3.87206
			Poolector-wrapped-sq_default	sat ✅	4.69403	18.04000
		CVC4	CVC4-sq-final_default	sat ✅	16.51880	16.51790
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.10000	1199.84000
		MathSAT	MathSAT5_default.sh	sat ✅	6.00962	11.96930
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.36994	0.37018
			MinkeyRink Solver 2020.3_default	sat ✅	0.44391	0.64024
		STP	STP_default	sat ✅	6.96174	25.88900
			STP ++ Mergsat v1_default	sat ✅	16.31410	16.31470
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.48305	0.48292
		Z3	z3-4.8.8_default	sat ✅	14.86810	14.86660
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	12.49450	12.49400
		MathSAT	mathsat-5.6.6_default	sat ✅	4.36658	4.36610
		STP	STP 2021.0_default	sat ✅	20.46010	79.54970
		Z3	z3-4.8.11_default	sat ✅	167.22500	167.18200
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.29830	14.29560
			Bitwuzla-wrapped_default	sat ✅	15.43620	15.43500
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	17.32480	17.32390
		MathSAT	MathSAT-5.6.8_default	sat ✅	3.19877	3.19848
		STP	STP 2022.4_default	sat ✅	2.94843	2.94810
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.52472	0.52465
		Z3++BV	z3++bv_0702_default	sat ✅	54.88010	54.88270
		Z3	z3-4.8.17_default	sat ✅	85.78530	85.77800
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	5.18436	5.18346
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	33.62080	33.61770
		STP	STP 2022.4_default	sat ✅	2.10214	2.10207
			STP 2022.4_default	sat ✅	2.09805	2.09787
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	6.06343	17.85130
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.35309	0.35298
		Z3-Owl	z3-Owl-Final_default	sat ✅	447.55300	447.45300
			z3-Owl-Final_default	sat ✅	350.56100	350.46800
SMT-COMP 2024	0.33 (4/6)	Bitwuzla	Bitwuzla	sat ✅	5.26860	5.16857
		cvc5	cvc5	sat ✅	19.65352	19.55383
		SMTInterpol	SMTInterpol	unknown ❌	424.09189	462.02682
		STP	STP	sat ✅	2.14887	2.04825
		Yices2	Yices2	sat ✅	0.71540	0.61550
		Z3alpha	Z3-alpha	unknown ❌	1201.71397	1201.17633