Benchmark

non-incremental/QF_BV/Sage2/bench_16718.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2723505
Compressed Size	49470
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2723497
Compressed Size	49467
Max. Term Depth	372
Asserts	1566
Declared Functions	0
Declared Constants	769
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	439	=	719	let	58859
extract	247	bvand	141	bvor	466	bvadd	50563
bvmul	5679	bvudiv	19	bvult	100	bvule	44
bvugt	35	bvuge	155	bvslt	94	bvsle	154
bvsgt	94	bvsge	170	bvshl	518	bvlshr	47
zero_extend	740

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	4.73484	4.73422
			Boolector SMT17 final boolector	sat ✅	71.76630	71.76110
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	408.00400	816.75000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	22.89530	22.89520
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	4.37824	4.44439
		Q3B	Q3B default	unknown ❌	600.03500	1799.55000
		STP	stp_st default	unknown ❌	600.96100	548.58000
			stp_mt default	unknown ❌	600.10300	548.10000
		Yices2	Yices2-Main default	sat ✅	0.22301	0.22227
		Z3	z3-4.5.0 default	sat ✅	120.18300	120.15700
SMT-COMP 2018	0.29 (5/7)	Boolector	Boolector_default	sat ✅	3.62632	3.62623
		CVC4	master-2018-06-10-b19c840-competition-default_default	unknown ❌	289.67100	289.64300
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	160.77100	160.75000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	4.25329	13.45430
			Minkeyrink ST_st	sat ✅	3.80658	3.80216
		STP	STP-CMS-st-2018_default-no-stderr	unknown ❌	655.26200	182.64700
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	607.38400	161.31300
			STP-Riss-st-2018_riss-no-stderr	unknown ❌	484.83000	162.75600
		Yices2	Yices 2.6.0_default	sat ✅	0.22011	0.21994
		Z3	z3-4.7.1_default	sat ✅	230.46300	230.45700
SMT-COMP 2019	0.25 (6/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	2.85359	2.85346
			Poolector-wrapped-sq_default	sat ✅	3.22678	12.27000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	73.47760	73.47280
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unknown ❌	15.84250	15.84140
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	4.51017	14.72550
			MinkeyRink ST-wrapped-sq_default	sat ✅	4.02055	4.02087
		Par4	Par4-wrapped-sq_default	sat ✅	0.22908	0.00585
		STP	STP-2019-wrapped-sq_default	unknown ❌	1096.61000	742.61200
			stp-mergesat-fixed-wrapped-sq_default	unknown ❌	1214.14000	743.73600
			stp-minisat-wrapped-sq_default	unknown ❌	1171.54000	738.86800
			stp-mt-wrapped-sq_default	unknown ❌	1050.88000	750.09800
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	1114.04000	742.08300
			stp-riss-wrapped-sq_default	unknown ❌	1025.46000	739.80400
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.22091	0.22091
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.39089	1.39076
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	2.88136	2.88122
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2400.09000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.45626	0.45625
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	267.74900	267.73200
SMT-COMP 2020	0.33 (6/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.63776	2.63739
		Boolector	Boolector-wrapped-sq_default	sat ✅	2.24215	2.24194
			Poolector-wrapped-sq_default	sat ✅	2.58582	9.71000
		CVC4	CVC4-sq-final_default	unknown ❌	265.47300	265.43500
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.09000	1200.00000
		MathSAT	MathSAT5_default.sh	sat ✅	41.14970	41.14430
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	1.69627	1.69651
			MinkeyRink Solver 2020.3_default	sat ✅	3.27906	7.72435
		STP	STP_default	unknown ❌	609.03500	171.35900
			STP ++ Mergsat v1_default	unknown ❌	474.01700	161.68500
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.80046	0.80039
		Z3	z3-4.8.8_default	sat ✅	19.29610	19.29460
SMT-COMP 2023	0.33 (4/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	4.26986	4.26107
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unknown ❌	234.65500	234.64000
		STP	STP 2022.4_default	sat ✅	1.37735	1.37730
			STP 2022.4_default	sat ✅	1.38210	1.38183
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	6.11491	17.44370
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.24816	0.24811
		Z3-Owl	z3-Owl-Final_default	sat ✅	107.04700	106.97900
			z3-Owl-Final_default	sat ✅	113.87100	113.84800
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	2.90322	2.77418
			Bitwuzla-MachBV-base	sat ✅	1.59213	1.47595
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	2.10895	1.99178
		BVDecide	bv_decide	sat ✅	85.43701	85.28587
			bv_decide-nokernel	sat ✅	82.02951	81.89859
		cvc5	cvc5	unknown ❌	97.33172	97.20606
		SMTInterpol	SMTInterpol	unknown ❌	1201.58776	1232.72383
		Yices2	Yices2	sat ✅	1.22518	1.10302
		Z3alpha	Z3-alpha	sat ✅	49.45728	193.28643
		Z3	Z3-alpha-base	sat ✅	17.24555	17.11108
			Z3-Owl-base	sat ✅	96.39677	96.26211
			z3siri-base	sat ✅	17.14592	17.00941
		Z3-Owl	Z3-Owl	sat ✅	45.95662	45.81575