Benchmark

non-incremental/QF_BV/Sage2/bench_1027.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	987811
Compressed Size	11558
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	987803
Compressed Size	11548
Max. Term Depth	273
Asserts	353
Declared Functions	0
Declared Constants	154
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	143	=	179	let	22356
bvadd	11042	bvmul	1980	bvult	43	bvule	53
bvuge	57	bvsge	20	bvlshr	10	zero_extend	9181

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	3.36141	3.36081
			Boolector SMT17 final boolector	sat ✅	51.77900	51.77580
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.22322	6.07015
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	5.90848	5.90783
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.69500	0.67046
		Q3B	Q3B default	unknown ❌	600.07400	1799.50000
		STP	stp_st default	sat ✅	37.33370	30.06970
			stp_mt default	sat ✅	41.69580	91.11190
		Yices2	Yices2-Main default	sat ✅	0.33449	0.33281
		Z3	z3-4.5.0 default	sat ✅	16.64290	16.64090
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.63253	0.63249
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	2.41612	2.41635
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	5.24375	5.24454
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.69938	1.76999
			Minkeyrink ST_st	sat ✅	0.66582	0.66597
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	22.28230	22.28040
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	24.17500	92.74280
			STP-Riss-st-2018_riss-no-stderr	sat ✅	6.64569	6.64591
		Yices2	Yices 2.6.0_default	sat ✅	0.26777	0.26767
		Z3	z3-4.7.1_default	sat ✅	22.42900	22.42890
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	1.33813	1.33812
			Poolector-wrapped-sq_default	sat ✅	1.59461	5.90000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	82.38480	82.37740
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	5.83707	5.83688
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.72796	1.92150
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.70155	0.70148
		Par4	Par4-wrapped-sq_default	sat ✅	0.38674	0.00654
		STP	STP-2019-wrapped-sq_default	sat ✅	21.70650	21.69410
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	20.62460	20.62500
			stp-minisat-wrapped-sq_default	sat ✅	6.31141	6.31186
			stp-mt-wrapped-sq_default	sat ✅	21.31480	81.03070
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	23.48620	51.33370
			stp-riss-wrapped-sq_default	unknown ❌	1.08890	1.07993
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.38729	0.38722
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.25725	0.25722
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.39839	0.39838
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.68000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.15416	0.15416
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	121.43400	121.40200
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.48713	1.48698
		MathSAT	mathsat-5.6.6_default	sat ✅	3.13918	3.13851
		STP	STP 2021.0_default	sat ✅	0.46483	1.07380
		Z3	z3-4.8.11_default	sat ✅	33.21120	33.21120
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.49899	1.49491
			Bitwuzla-wrapped_default	sat ✅	0.97682	0.97516
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	10.39180	10.39170
		MathSAT	MathSAT-5.6.8_default	sat ✅	3.83243	7.61215
		STP	STP 2022.4_default	sat ✅	0.23695	0.23694
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.19950	0.19937
		Z3++BV	z3++bv_0702_default	sat ✅	2.56686	2.56674
		Z3	z3-4.8.17_default	sat ✅	16.35400	16.35410
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.58586	0.58577
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	2.30953	2.30965
		STP	STP 2022.4_default	sat ✅	0.23928	0.23915
			STP 2022.4_default	sat ✅	0.24138	0.24140
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	9.87074	29.80280
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.34492	0.34480
		Z3-Owl	z3-Owl-Final_default	sat ✅	128.01300	128.00000
			z3-Owl-Final_default	sat ✅	124.13400	124.11400