Benchmark

non-incremental/QF_BV/Sage2/bench_1113.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	18676
Compressed Size	1812
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	18668
Compressed Size	1804
Max. Term Depth	60
Asserts	117
Declared Functions	0
Declared Constants	19
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	95	=	97	let	358
bvadd	56	bvmul	56	bvult	19	zero_extend	151

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	51.91610	51.90570
			Boolector SMT17 final boolector	sat ✅	94.72870	94.72020
		CVC4	CVC4-smtcomp2017-main default	sat ✅	14.23110	28.49630
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	72.11460	72.11910
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.61201	0.60573
		Q3B	Q3B default	unknown ❌	600.06200	1786.82000
		STP	stp_st default	sat ✅	14.88550	14.88130
			stp_mt default	sat ✅	4.14589	16.00990
		Yices2	Yices2-Main default	sat ✅	58.35120	58.34550
		Z3	z3-4.5.0 default	sat ✅	433.33900	433.28000
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	62.73410	62.73480
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	28.42980	28.43070
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	5.77644	5.77709
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.72778	6.56118
			Minkeyrink ST_st	sat ✅	6.56216	6.56235
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	4.45834	4.45808
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	1.94056	7.30733
			STP-Riss-st-2018_riss-no-stderr	sat ✅	0.92385	0.92372
		Yices2	Yices 2.6.0_default	sat ✅	59.58130	59.58020
		Z3	z3-4.7.1_default	sat ✅	249.95800	249.92600
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	31.45990	31.45920
			Poolector-wrapped-sq_default	sat ✅	17.06780	67.10000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	16.71270	16.71040
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	82.05100	82.04610
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.84714	3.04073
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.81532	0.81543
		Par4	Par4-wrapped-sq_default	sat ✅	15.20600	45.27000
		STP	STP-2019-wrapped-sq_default	sat ✅	1.32263	1.32301
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	9.94611	9.94583
			stp-minisat-wrapped-sq_default	sat ✅	4.64144	4.64127
			stp-mt-wrapped-sq_default	sat ✅	8.86081	34.75520
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	10.21400	16.05390
			stp-riss-wrapped-sq_default	unknown ❌	0.14189	0.14212
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	43.32070	43.31680
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.37009	1.37016
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	36.81390	36.81370
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.95000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	3.97662	3.97643
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	196.69500	196.69400
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	15.69440	15.68970
		Boolector	Boolector-wrapped-sq_default	sat ✅	3.57697	3.57678
			Poolector-wrapped-sq_default	sat ✅	4.09557	15.74000
		CVC4	CVC4-sq-final_default	sat ✅	14.11290	14.11400
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.12000	1199.91000
		MathSAT	MathSAT5_default.sh	sat ✅	92.39890	92.38220
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.08918	0.08943
			MinkeyRink Solver 2020.3_default	sat ✅	3.88300	15.07470
		STP	STP_default	sat ✅	1.12559	4.22904
			STP ++ Mergsat v1_default	sat ✅	0.38848	0.38992
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	9.69030	9.68843
		Z3	z3-4.8.8_default	sat ✅	658.43900	658.35400
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	16.57090	16.56960
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	582.42700	582.45300
		STP	STP 2022.4_default	sat ✅	13.02000	13.01990
			STP 2022.4_default	sat ✅	12.99980	12.99960
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	213.18400	244.61600
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	4.21735	4.21727
		Z3-Owl	z3-Owl-Final_default	sat ✅	25.65920	25.65970
			z3-Owl-Final_default	sat ✅	40.27720	40.27830
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	5.36988	5.23914
			Bitwuzla-MachBV-base	sat ✅	2.67434	2.55693
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	11.84959	11.73012
		BVDecide	bv_decide	sat ✅	6.02364	5.85405
			bv_decide-nokernel	sat ✅	5.97463	5.83705
		cvc5	cvc5	sat ✅	50.94825	50.81134
		SMTInterpol	SMTInterpol	unknown ❌	1201.36107	1228.76865
		Yices2	Yices2	sat ✅	11.61105	11.49237
		Z3alpha	Z3-alpha	sat ✅	37.18851	147.38787
		Z3	Z3-alpha-base	sat ✅	15.71282	15.58003
			Z3-Owl-base	sat ✅	65.23550	65.10696
			z3siri-base	sat ✅	15.95103	15.82021
		Z3-Owl	Z3-Owl	sat ✅	90.27195	90.13147