Benchmark

non-incremental/QF_BV/Sage2/bench_11986.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	620213
Compressed Size	16940
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	620205
Compressed Size	16950
Max. Term Depth	121
Asserts	471
Declared Functions	0
Declared Constants	252
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	80	=	91
let	13339	extract	5	bvand	3	bvor	4
bvadd	4726	bvmul	315	bvult	73	bvule	101
bvugt	15	bvuge	185	bvsle	2	bvsgt	2
bvsge	2	bvshl	3488	bvlshr	56	bvashr	6
zero_extend	4655

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	1.38364	1.38366
			Boolector SMT17 final boolector	sat ✅	6.99207	6.99150
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.09377	5.94334
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	11.70820	23.38270
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.16833	1.14942
		Q3B	Q3B default	unknown ❌	600.02200	1799.50000
		STP	stp_st default	sat ✅	4.07399	4.07215
			stp_mt default	sat ✅	2.85341	9.31042
		Yices2	Yices2-Main default	sat ✅	0.11598	0.11521
		Z3	z3-4.5.0 default	sat ✅	27.08440	26.98850
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	1.23955	1.23946
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	5.31840	5.31817
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	632.97900	632.84100
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.82221	2.03940
			Minkeyrink ST_st	sat ✅	0.86782	0.86667
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	2.54849	2.54784
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	2.63554	8.56805
			STP-Riss-st-2018_riss-no-stderr	sat ✅	3.34112	3.34002
		Yices2	Yices 2.6.0_default	sat ✅	0.10794	0.10786
		Z3	z3-4.7.1_default	sat ✅	25.43790	25.43830
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	2.33084	2.33094
			Poolector-wrapped-sq_default	sat ✅	0.88677	3.10000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	19.88040	19.87900
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	8.47799	8.47749
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.61803	1.35009
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.55154	0.55157
		Par4	Par4-wrapped-sq_default	sat ✅	0.23457	0.00573
		STP	STP-2019-wrapped-sq_default	sat ✅	1.75081	1.75098
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	10.24880	10.24870
			stp-minisat-wrapped-sq_default	sat ✅	1.26766	1.26788
			stp-mt-wrapped-sq_default	sat ✅	1.77489	5.09992
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	10.49990	12.76970
			stp-riss-wrapped-sq_default	unknown ❌	0.63189	0.63203
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.23401	0.23400
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.65573	0.65565
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.75038	0.75036
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.02000	2399.86000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.30708	0.30704
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	19.35620	19.34410
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.38606	2.38559
		Boolector	Boolector-wrapped-sq_default	sat ✅	2.32081	2.32045
			Poolector-wrapped-sq_default	sat ✅	1.08476	3.84854
		CVC4	CVC4-sq-final_default	sat ✅	11.78870	11.78870
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1200.03000
		MathSAT	MathSAT5_default.sh	sat ✅	319.57700	319.51400
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.36714	0.36733
			MinkeyRink Solver 2020.3_default	sat ✅	0.54379	1.07982
		STP	STP_default	sat ✅	0.78736	2.17643
			STP ++ Mergsat v1_default	sat ✅	0.85043	0.85214
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.37300	0.37288
		Z3	z3-4.8.8_default	sat ✅	16.15100	16.14100
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.15209	2.15189
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	12.33040	12.33050
		STP	STP 2022.4_default	sat ✅	1.19873	1.19877
			STP 2022.4_default	sat ✅	1.19637	1.19622
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.02000	1235.22000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.13040	0.13036
		Z3-Owl	z3-Owl-Final_default	sat ✅	32.55350	32.55110
			z3-Owl-Final_default	sat ✅	41.29860	41.29650
SMT-COMP 2024		Bitwuzla	Bitwuzla	sat ✅	2.58711	2.48716
		cvc5	cvc5	sat ✅	6.84970	6.74290
		SMTInterpol	SMTInterpol	sat ✅	22.25776	45.51515
		STP	STP	sat ✅	1.09929	0.99973
		Yices2	Yices2	sat ✅	0.63294	0.53242
		Z3alpha	Z3-alpha	sat ✅	3.89372	3.79315
SMT-COMP 2025		Bitwuzla	Bitwuzla	sat ✅	1.34151	1.22394
			Bitwuzla-MachBV-base	sat ✅	0.91656	0.79126
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.97835	0.84877
		BVDecide	bv_decide	sat ✅	7.37309	7.23714
			bv_decide-nokernel	sat ✅	7.14260	6.96315
		cvc5	cvc5	sat ✅	9.93809	9.80948
		SMTInterpol	SMTInterpol	sat ✅	19.21240	32.96835
		Yices2	Yices2	sat ✅	0.79246	0.67683
		Z3alpha	Z3-alpha	sat ✅	6.91812	22.97418
		Z3	Z3-alpha-base	sat ✅	45.88735	45.76071
			Z3-Owl-base	sat ✅	184.89056	184.75329
			z3siri-base	sat ✅	47.08422	46.95096
		Z3-Owl	Z3-Owl	sat ✅	14.77839	14.64500