Benchmark

non-incremental/QF_BV/Sage2/bench_8620.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	231906
Compressed Size	24052
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	231898
Compressed Size	24030
Max. Term Depth	593
Asserts	517
Declared Functions	0
Declared Constants	859
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	67	not	66	=	248
let	4025	extract	4	bvand	2	bvor	517
bvadd	1511	bvmul	248	bvudiv	149	bvult	129
bvule	120	bvugt	14	bvuge	72	bvshl	555
bvlshr	13	zero_extend	826

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.25 (6/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.18557	0.18493
			Boolector SMT17 final boolector	sat ✅	1.14628	1.11290
		CVC4	CVC4-smtcomp2017-main default	sat ✅	241.85200	485.34900
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	30.72240	24.68170
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	13.57200	15.53000
		Q3B	Q3B default	unknown ❌	600.02900	1799.72000
		STP	stp_st default	unknown ❌	600.06300	599.94800
			stp_mt default	unknown ❌	600.04800	2368.44000
		Yices2	Yices2-Main default	sat ✅	2.00564	2.00498
		Z3	z3-4.5.0 default	sat ✅	0.75094	0.75017
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	14.99050	14.98730
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	119.55100	119.53500
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	22.28150	22.28020
		MinkeyRink	Minkeyrink MT_mt	sat ✅	144.80000	555.00200
			Minkeyrink ST_st	sat ✅	155.95400	155.94000
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	89.66540	89.60250
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	120.64600	460.40200
			STP-Riss-st-2018_riss-no-stderr	sat ✅	496.60000	496.56100
		Yices2	Yices 2.6.0_default	sat ✅	2.21902	2.21889
		Z3	z3-4.7.1_default	sat ✅	0.69112	0.69103
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.18303	0.18302
			Poolector-wrapped-sq_default	sat ✅	0.27765	0.39806
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	103.73400	103.72200
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	22.65380	22.65410
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	136.56500	524.71600
			MinkeyRink ST-wrapped-sq_default	sat ✅	6.53599	6.53521
		Par4	Par4-wrapped-sq_default	sat ✅	1.71615	5.02000
		STP	STP-2019-wrapped-sq_default	sat ✅	143.61700	143.57500
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	20.49060	20.48920
			stp-minisat-wrapped-sq_default	sat ✅	11.91180	11.89210
			stp-mt-wrapped-sq_default	sat ✅	136.58500	522.00000
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	148.15300	171.26400
			stp-riss-wrapped-sq_default	unknown ❌	7.09341	6.46103
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	2.00784	2.00774
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	23.83660	23.83320
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	533.62900	533.54900
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	0.70283	0.70273
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	9.18847	9.18859
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.59812	0.59804
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.32390	14.32100
		MathSAT	mathsat-5.6.6_default	sat ✅	7.58152	7.57369
		STP	STP 2021.0_default	sat ✅	125.47300	479.98600
		Z3	z3-4.8.11_default	sat ✅	0.63962	0.63948
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	18.31940	18.31920
			Bitwuzla-wrapped_default	sat ✅	23.00260	23.00420
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	28.63020	28.62590
		MathSAT	MathSAT-5.6.8_default	sat ✅	10.13170	10.13080
		STP	STP 2022.4_default	sat ✅	8.68143	8.68075
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	96.00260	96.00160
		Z3++BV	z3++bv_0702_default	sat ✅	0.30263	0.30255
		Z3	z3-4.8.17_default	sat ✅	0.95631	0.95785
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	17.72750	17.72610
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	34.79920	34.79360
		STP	STP 2022.4_default	sat ✅	9.20407	9.20248
			STP 2022.4_default	sat ✅	9.23030	9.22868
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	6.94030	20.01830
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	2.26130	2.26084
		Z3-Owl	z3-Owl-Final_default	sat ✅	5.74475	5.74352
			z3-Owl-Final_default	sat ✅	5.91850	5.91778
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	0.36941	0.26998
		cvc5	cvc5	sat ✅	22.46606	22.36548
		SMTInterpol	SMTInterpol	unknown ❌	1201.73909	1241.42151
		STP	STP	sat ✅	7.95832	7.85458
		Yices2	Yices2	sat ✅	5.11761	5.01757
		Z3alpha	Z3-alpha	sat ✅	199.42017	199.27970
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	3.97237	3.84510
			Bitwuzla-MachBV-base	sat ✅	0.35056	0.23217
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.42241	0.30836
		BVDecide	bv_decide	sat ✅	42.45863	42.37435
			bv_decide-nokernel	sat ✅	39.59549	39.51844
		cvc5	cvc5	sat ✅	15.10818	14.98214
		SMTInterpol	SMTInterpol	unknown ❌	1201.76909	1232.83764
		Yices2	Yices2	sat ✅	20.89926	20.76994
		Z3alpha	Z3-alpha	sat ✅	2.01883	4.30203
		Z3	Z3-alpha-base	sat ✅	0.66445	0.53605
			Z3-Owl-base	sat ✅	1.94847	1.81904
			z3siri-base	sat ✅	0.63606	0.51342
		Z3-Owl	Z3-Owl	sat ✅	2.86273	2.74465