Benchmark

non-incremental/QF_BV/Sage2/bench_14706.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	361943
Compressed Size	11417
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	361935
Compressed Size	11408
Max. Term Depth	171
Asserts	302
Declared Functions	0
Declared Constants	216
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	50	=	58
let	7949	extract	4	bvand	2	bvadd	2708
bvmul	202	bvult	38	bvule	61	bvugt	8
bvuge	137	bvshl	2133	bvlshr	2	zero_extend	2847

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.81476	0.81066
			Boolector SMT17 final boolector	sat ✅	3.91569	3.91472
		CVC4	CVC4-smtcomp2017-main default	sat ✅	5.42921	10.71720
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	300.17100	300.11900
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.82506	0.78885
		Q3B	Q3B default	unknown ❌	600.03500	1799.64000
		STP	stp_st default	sat ✅	2.75160	2.75100
			stp_mt default	sat ✅	1.98415	6.70689
		Yices2	Yices2-Main default	sat ✅	0.44717	0.44407
		Z3	z3-4.5.0 default	sat ✅	13.72660	13.72530
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.76606	0.76570
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	9.05575	9.05510
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	1103.24000	1103.17000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.44382	0.95756
			Minkeyrink ST_st	sat ✅	0.43825	0.43822
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.95173	0.95178
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	1.07113	3.25297
			STP-Riss-st-2018_riss-no-stderr	sat ✅	1.51695	1.51694
		Yices2	Yices 2.6.0_default	sat ✅	0.26174	0.26168
		Z3	z3-4.7.1_default	sat ✅	14.34570	14.34590
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	1.24999	1.24996
			Poolector-wrapped-sq_default	sat ✅	0.68305	2.26000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	2.81559	2.81576
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	9.83169	9.83114
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.44653	1.06025
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.54431	0.54436
		Par4	Par4-wrapped-sq_default	sat ✅	0.49043	0.00577
		STP	STP-2019-wrapped-sq_default	sat ✅	1.23090	1.23110
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	7.28709	7.28683
			stp-minisat-wrapped-sq_default	sat ✅	0.96555	0.96584
			stp-mt-wrapped-sq_default	sat ✅	0.88503	2.43684
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	7.53330	9.28446
			stp-riss-wrapped-sq_default	unknown ❌	0.34606	0.34619
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.48523	0.48520
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.53511	0.53508
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.74598	0.74593
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.10000	2399.84000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.30378	0.30375
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	25.45850	25.45570
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.53714	0.53700
		Boolector	Boolector-wrapped-sq_default	sat ✅	1.23630	1.23606
			Poolector-wrapped-sq_default	sat ✅	0.58015	1.87000
		CVC4	CVC4-sq-final_default	sat ✅	17.02860	17.02860
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.11000	1200.03000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.06000	1199.84000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.23269	0.23292
			MinkeyRink Solver 2020.3_default	sat ✅	0.36921	0.76026
		STP	STP_default	sat ✅	0.42293	1.03195
			STP ++ Mergsat v1_default	sat ✅	0.35395	0.35528
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.83815	0.83798
		Z3	z3-4.8.8_default	sat ✅	3.04630	3.04613
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.51284	0.51280
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.02000	1199.75000
		STP	STP 2021.0_default	sat ✅	0.35602	0.76888
		Z3	z3-4.8.11_default	sat ✅	11.21970	11.21910