Benchmark

non-incremental/QF_BV/Sage2/bench_12906.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2227064
Compressed Size	27036
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	2227056
Compressed Size	27024
Max. Term Depth	548
Asserts	688
Declared Functions	0
Declared Constants	154
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	139	not	152	=	257
let	48123	extract	35	bvand	2	bvor	54
bvadd	34153	bvmul	4198	bvult	217	bvule	140
bvuge	193	bvsle	2	bvsgt	15	bvsge	2
bvshl	54	bvlshr	15	zero_extend	9182

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.42961	0.42880
			Boolector SMT17 final boolector	unsat ✅	0.50226	0.50182
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	4.97609	9.06688
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	12.82080	12.81140
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.46176	0.42065
		Q3B	Q3B default	unknown ❌	600.04000	1235.28000
		STP	stp_st default	unsat ✅	0.47316	0.47201
			stp_mt default	unsat ✅	0.48147	0.68391
		Yices2	Yices2-Main default	unsat ✅	0.12829	0.12750
		Z3	z3-4.5.0 default	unsat ✅	7.54227	7.54138
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.30549	0.30542
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	4.86009	4.85992
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	18.00370	18.00280
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.35655	0.37856
			Minkeyrink ST_st	unsat ✅	0.35224	0.35246
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.39383	0.39408
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.40118	0.42752
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.77106	0.77091
		Yices2	Yices 2.6.0_default	unsat ✅	0.13377	0.13371
		Z3	z3-4.7.1_default	unsat ✅	26.05240	26.05130
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.47883	0.47883
			Poolector-wrapped-sq_default	unsat ✅	0.48320	0.80815
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.29956	0.29951
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	4.39086	4.38234
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.52564	1.12248
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.51443	0.51447
		Par4	Par4-wrapped-sq_default	unsat ✅	0.14064	0.00611
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.40478	0.40508
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.44791	0.44807
			stp-minisat-wrapped-sq_default	unsat ✅	0.41492	0.41507
			stp-mt-wrapped-sq_default	unsat ✅	0.41517	0.43366
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.48026	0.52865
			stp-riss-wrapped-sq_default	unknown ❌	0.39946	0.39963
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.12979	0.12975
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.13609	0.13606
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.13673	0.13672
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	5.21588	5.21237
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.14205	0.14205
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.93574	0.93569
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.45363	0.45357
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.43455	0.43451
			Poolector-wrapped-sq_default	unsat ✅	0.47815	0.80322
		CVC4	CVC4-sq-final_default	unsat ✅	4.46984	4.47015
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.07000	1199.53000
		MathSAT	MathSAT5_default.sh	unsat ✅	78.20100	78.08000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.28399	0.28424
			MinkeyRink Solver 2020.3_default	unsat ✅	0.29391	0.30988
		STP	STP_default	unsat ✅	0.47951	0.52339
			STP ++ Mergsat v1_default	unsat ✅	0.46374	0.46546
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.15354	0.15347
		Z3	z3-4.8.8_default	unsat ✅	0.42542	0.42539
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.43793	0.43771
		MathSAT	mathsat-5.6.6_default	unsat ✅	7.68095	15.29980
		STP	STP 2021.0_default	unsat ✅	0.76097	1.57652
		Z3	z3-4.8.11_default	unsat ✅	0.42089	0.42084
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.75526	0.75517
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	4.87387	4.87393
		STP	STP 2022.4_default	unsat ✅	0.28293	0.28288
			STP 2022.4_default	unsat ✅	0.28558	0.28385
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.04000	1245.96000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.15513	0.15509
		Z3-Owl	z3-Owl-Final_default	unsat ✅	4.22844	4.22824
			z3-Owl-Final_default	unsat ✅	4.27270	4.27292
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.41850	0.31844
		cvc5	cvc5	unsat ✅	6.54842	6.44606
		SMTInterpol	SMTInterpol	unsat ✅	226.28421	259.70945
		STP	STP	unsat ✅	1.02331	0.92269
		Yices2	Yices2	unsat ✅	0.31862	0.21910
		Z3alpha	Z3-alpha	unsat ✅	0.50769	0.40793