Benchmark

non-incremental/QF_BV/Sage2/bench_1406.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2494073
Compressed Size	27085
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	2494065
Compressed Size	27073
Max. Term Depth	582
Asserts	646
Declared Functions	0
Declared Constants	157
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	36	not	152	=	260
let	54116	extract	35	bvand	2	bvor	57
bvadd	39969	bvmul	5017	bvult	117	bvule	114
bvugt	4	bvuge	170	bvsgt	16	bvshl	57
bvlshr	17	zero_extend	8738

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.80815	0.80724
			Boolector SMT17 final boolector	unsat ✅	1.10559	1.10482
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	3.22350	5.46176
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	52.84440	52.84130
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.57598	0.54652
		Q3B	Q3B default	unknown ❌	600.04700	1786.30000
		STP	stp_st default	unsat ✅	0.48408	0.48455
			stp_mt default	unsat ✅	0.48397	0.57678
		Yices2	Yices2-Main default	unsat ✅	8.61132	8.61058
		Z3	z3-4.5.0 default	unsat ✅	47.03680	47.03080
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.70995	0.70986
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	51.57520	51.57320
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	33.44490	33.44730
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.42734	0.45834
			Minkeyrink ST_st	unsat ✅	0.41956	0.41973
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.44344	0.44370
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.44910	0.46493
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.52543	0.52541
		Yices2	Yices 2.6.0_default	unsat ✅	5.56892	5.56841
		Z3	z3-4.7.1_default	unsat ✅	13.60980	13.60920
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.98345	0.98343
			Poolector-wrapped-sq_default	unsat ✅	0.90788	2.99000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.64926	0.64924
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	14.53440	14.53400
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.42362	0.45284
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.41237	0.41246
		Par4	Par4-wrapped-sq_default	unsat ✅	0.67534	1.83000
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.49711	0.49739
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.53387	0.53410
			stp-minisat-wrapped-sq_default	unsat ✅	0.51027	0.51048
			stp-mt-wrapped-sq_default	unsat ✅	0.50733	0.53291
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.56082	0.61615
			stp-riss-wrapped-sq_default	unknown ❌	0.49286	0.49301
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	7.98109	7.97913
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	1.46811	1.46811
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	3.68877	3.68834
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.77000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	1.28659	1.28665
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	28.20480	28.20640
SMT-COMP 2020		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.92604	0.92591
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.78182	0.78176
			Poolector-wrapped-sq_default	unsat ✅	0.77892	2.62043
		CVC4	CVC4-sq-final_default	unsat ✅	41.33210	41.33080
		LazyBV2Int	LazyBV2Int20200523_default.sh	unsat ✅	660.39600	660.30800
		MathSAT	MathSAT5_default.sh	unsat ✅	197.66000	197.61100
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.38591	0.38616
			MinkeyRink Solver 2020.3_default	unsat ✅	0.40104	0.43035
		STP	STP_default	unsat ✅	0.79150	0.91660
			STP ++ Mergsat v1_default	unsat ✅	0.74507	0.74672
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	1.16562	1.16534
		Z3	z3-4.8.8_default	unsat ✅	81.09340	81.09240
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.99522	0.99512
		MathSAT	mathsat-5.6.6_default	unsat ✅	256.88700	256.78700
		STP	STP 2021.0_default	unsat ✅	0.39707	0.41056
		Z3	z3-4.8.11_default	unsat ✅	35.15590	35.15370
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.55174	0.45141
		cvc5	cvc5	unsat ✅	7.52279	7.42270
		SMTInterpol	SMTInterpol	unsat ✅	526.77849	564.21751
		STP	STP	unsat ✅	1.30676	1.20651
		Yices2	Yices2	unsat ✅	1.24862	1.14905
		Z3alpha	Z3-alpha	unsat ✅	199.50468	199.35438
SMT-COMP 2025		Bitwuzla	Bitwuzla	unsat ✅	0.80549	0.67948
			Bitwuzla-MachBV-base	unsat ✅	0.51245	0.39101
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	0.63291	0.50814
		BVDecide	bv_decide	unsat ✅	216.81850	216.61265
			bv_decide-nokernel	unsat ✅	48.43880	48.26954
		cvc5	cvc5	unsat ✅	10.00458	9.87710
		SMTInterpol	SMTInterpol	unsat ✅	35.75182	56.21321
		Yices2	Yices2	unsat ✅	1.25706	1.12694
		Z3alpha	Z3-alpha	unsat ✅	12.23578	44.51423
		Z3	Z3-alpha-base	unsat ✅	13.18391	13.05735
			Z3-Owl-base	unsat ✅	58.17807	58.04336
			z3siri-base	unsat ✅	13.19186	13.06852
		Z3-Owl	Z3-Owl	unsat ✅	5.51231	5.38328