Benchmark

non-incremental/QF_BV/Sage2/bench_4326.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	7250065
Compressed Size	53075
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	7250057
Compressed Size	53064
Max. Term Depth	1460
Asserts	1183
Declared Functions	0
Declared Constants	509
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	45	not	193	=	420
let	154993	extract	48	bvand	4	bvor	175
bvadd	112268	bvmul	12941	bvudiv	39	bvult	198
bvule	193	bvugt	45	bvuge	349	bvsle	1
bvsgt	20	bvsge	1	bvshl	175	bvlshr	19
zero_extend	29041

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.62 (3/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unknown ❌	600.04300	599.93200
			Boolector SMT17 final boolector	unknown ❌	600.01700	599.93200
		CVC4	CVC4-smtcomp2017-main default	sat ✅	262.00700	523.34100
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.01900	599.94000
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	29.75000	53.60000
		Q3B	Q3B default	unknown ❌	600.05900	1788.20000
		STP	stp_st default	unknown ❌	600.01100	599.92500
			stp_mt default	unknown ❌	600.07500	2372.66000
		Yices2	Yices2-Main default	sat ✅	0.89399	0.89342
		Z3	z3-4.5.0 default	unknown ❌	600.04100	599.90200
SMT-COMP 2018	0.29 (5/7)	Boolector	Boolector_default	unknown ❌	1200.02000	1199.82000
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	207.29600	207.22700
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.11000	1199.92000
		MinkeyRink	Minkeyrink MT_mt	sat ✅	21.29290	79.67240
			Minkeyrink ST_st	sat ✅	51.36150	51.36270
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	5.12569	5.12539
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	5.41007	7.33613
			STP-Riss-st-2018_riss-no-stderr	unknown ❌	1200.11000	1199.90000
		Yices2	Yices 2.6.0_default	sat ✅	0.77669	0.77656
		Z3	z3-4.7.1_default	sat ✅	702.51600	702.43300
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	49.14680	49.14190
			Poolector-wrapped-sq_default	sat ✅	54.82300	216.34000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	1498.04000	1497.92000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	46.71960	46.71680
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	37.80240	134.15200
			MinkeyRink ST-wrapped-sq_default	sat ✅	53.57040	53.56090
		Par4	Par4-wrapped-sq_default	sat ✅	0.78013	2.27000
		STP	STP-2019-wrapped-sq_default	sat ✅	5.22045	5.21895
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	90.40480	90.36750
			stp-minisat-wrapped-sq_default	unknown ❌	2400.02000	2399.70000
			stp-mt-wrapped-sq_default	sat ✅	5.46057	6.81564
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.07000	2500.23000
			stp-riss-wrapped-sq_default	unknown ❌	5.12937	4.95536
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.82357	0.82358
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	6.03984	6.03967
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	25.35630	25.35480
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	97.82790	97.80060
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	2.16956	2.16953
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	793.71600	793.54300
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	55.77030	55.75860
		Boolector	Boolector-wrapped-sq_default	sat ✅	50.48660	50.47800
			Poolector-wrapped-sq_default	sat ✅	59.00980	233.40000
		CVC4	CVC4-sq-final_default	sat ✅	37.13070	37.11390
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.82000
		MathSAT	MathSAT5_default.sh	sat ✅	189.66300	189.58900
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	1.46192	1.46211
			MinkeyRink Solver 2020.3_default	sat ✅	28.87960	110.21100
		STP	STP_default	sat ✅	327.62900	1289.56000
			STP ++ Mergsat v1_default	unknown ❌	1200.06000	1199.96000
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	5.59754	5.59768
		Z3	z3-4.8.8_default	sat ✅	176.62200	176.56200
SMT-COMP 2024	0.33 (4/6)	Bitwuzla	Bitwuzla	sat ✅	2.97660	2.87539
		cvc5	cvc5	sat ✅	26.93233	26.82709
		SMTInterpol	SMTInterpol	unknown ❌	1201.72498	1241.60619
		STP	STP	sat ✅	7.24068	7.13611
		Yices2	Yices2	sat ✅	4.75062	4.64752
		Z3alpha	Z3-alpha	unknown ❌	1201.71875	1201.19549
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	1.68461	1.55621
			Bitwuzla-MachBV-base	sat ✅	1.97585	1.85034
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	2.11421	1.99356
		BVDecide	bv_decide	unknown ❌	1201.90524	1201.87691
			bv_decide-nokernel	unknown ❌	1201.90106	1201.86665
		cvc5	cvc5	sat ✅	45.37345	45.24581
		SMTInterpol	SMTInterpol	unknown ❌	1201.78795	1230.84700
		Yices2	Yices2	sat ✅	4.95802	4.83430
		Z3alpha	Z3-alpha	sat ✅	932.34304	3722.09546
		Z3	Z3-alpha-base	sat ✅	257.61095	257.42557
			Z3-Owl-base	sat ✅	964.28310	964.02158
			z3siri-base	sat ✅	262.59417	262.42593
		Z3-Owl	Z3-Owl	sat ✅	212.84982	212.66475