Benchmark

non-incremental/QF_BV/Sage2/bench_8934.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1007538
Compressed Size	25156
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1007530
Compressed Size	25167
Max. Term Depth	138
Asserts	786
Declared Functions	0
Declared Constants	314
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	136	=	175
let	21605	extract	17	bvand	14	bvor	28
bvadd	7879	bvmul	532	bvult	144	bvule	157
bvugt	29	bvuge	263	bvsle	6	bvsgt	6
bvsge	6	bvshl	5510	bvlshr	119	bvashr	22
zero_extend	7347

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	3.79466	3.79035
			Boolector SMT17 final boolector	sat ✅	28.40750	28.40550
		CVC4	CVC4-smtcomp2017-main default	sat ✅	6.45414	12.54310
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	265.41500	265.31900
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	5.74998	2.76218
		Q3B	Q3B default	unknown ❌	600.03800	1799.47000
		STP	stp_st default	sat ✅	22.62770	22.62480
			stp_mt default	sat ✅	29.38800	89.68850
		Yices2	Yices2-Main default	sat ✅	0.91649	0.91549
		Z3	z3-4.5.0 default	sat ✅	51.09880	51.09770
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	1.77338	1.77317
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	8.58325	8.58263
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	519.76400	519.68300
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.66857	4.84862
			Minkeyrink ST_st	sat ✅	1.79421	1.78931
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	31.15990	31.15890
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	6.75349	24.27490
			STP-Riss-st-2018_riss-no-stderr	sat ✅	7.33172	7.33095
		Yices2	Yices 2.6.0_default	sat ✅	1.42524	1.42499
		Z3	z3-4.7.1_default	sat ✅	64.20960	64.21020
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	5.37864	5.37833
			Poolector-wrapped-sq_default	sat ✅	5.03010	19.49000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	24.19330	24.19180
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	13.47050	13.46850
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	1.69809	5.09589
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.50464	1.50460
		Par4	Par4-wrapped-sq_default	sat ✅	0.41242	0.00602
		STP	STP-2019-wrapped-sq_default	sat ✅	20.97830	20.96600
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	14.33120	14.30500
			stp-minisat-wrapped-sq_default	sat ✅	5.15500	5.15452
			stp-mt-wrapped-sq_default	sat ✅	21.16190	80.97630
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	22.37950	42.02300
			stp-riss-wrapped-sq_default	unknown ❌	0.95970	0.95987
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.39654	0.39651
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.66390	1.66378
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	2.18968	2.18972
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.09000	2400.01000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.58005	0.58002
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	39.72490	39.71860
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	4.93124	4.93094
		Boolector	Boolector-wrapped-sq_default	sat ✅	5.74119	5.74095
			Poolector-wrapped-sq_default	sat ✅	3.40664	12.99000
		CVC4	CVC4-sq-final_default	sat ✅	21.21050	21.20750
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.01000	1199.93000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.04000	1199.66000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.54133	0.54159
			MinkeyRink Solver 2020.3_default	sat ✅	1.03961	2.51225
		STP	STP_default	sat ✅	0.95711	2.53721
			STP ++ Mergsat v1_default	sat ✅	0.59112	0.59292
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	1.86165	1.86154
		Z3	z3-4.8.8_default	sat ✅	21.54640	21.54570
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	4.63613	4.63604
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.11000	1199.85000
		STP	STP 2021.0_default	sat ✅	1.08784	3.02169
		Z3	z3-4.8.11_default	sat ✅	31.18390	31.17390
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	4.87237	4.87135
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	18.41300	18.41190
		STP	STP 2022.4_default	sat ✅	1.73008	1.73007
			STP 2022.4_default	sat ✅	1.71822	1.71815
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.11000	1248.07000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.28892	0.28886
		Z3-Owl	z3-Owl-Final_default	sat ✅	75.45090	75.44380
			z3-Owl-Final_default	sat ✅	64.10550	64.10530
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	2.85109	2.75194
		cvc5	cvc5	sat ✅	16.05975	15.95981
		SMTInterpol	SMTInterpol	sat ✅	636.22153	675.87078
		STP	STP	sat ✅	1.78513	1.68358
		Yices2	Yices2	sat ✅	1.04391	0.94364
		Z3alpha	Z3-alpha	sat ✅	12.40984	12.30948
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	2.46532	2.34489
			Bitwuzla-MachBV-base	sat ✅	2.49081	2.37351
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	2.51578	2.39560
		BVDecide	bv_decide	sat ✅	13.40986	13.25871
			bv_decide-nokernel	sat ✅	12.86837	12.70849
		cvc5	cvc5	sat ✅	17.90467	17.77620
		SMTInterpol	SMTInterpol	unknown ❌	1201.37492	1231.45134
		Yices2	Yices2	sat ✅	1.46857	1.34143
		Z3alpha	Z3-alpha	sat ✅	13.23431	44.62354
		Z3	Z3-alpha-base	sat ✅	9.83120	9.70062
			Z3-Owl-base	sat ✅	91.27587	91.15408
			z3siri-base	sat ✅	9.77302	9.65251
		Z3-Owl	Z3-Owl	sat ✅	24.70055	24.56513