Benchmark

non-incremental/QF_BV/Sage2/bench_12939.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	198065
Compressed Size	13925
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	198057
Compressed Size	13804
Max. Term Depth	97
Asserts	551
Declared Functions	0
Declared Constants	177
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	12	not	54	=	134
let	3841	extract	66	bvand	18	bvor	84
bvadd	1637	bvmul	744	bvult	123	bvule	164
bvugt	46	bvuge	95	bvshl	104	bvlshr	50
zero_extend	1060

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.30008	0.29937
			Boolector SMT17 final boolector	unsat ✅	1.92769	1.92655
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	19.09250	38.24390
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	3.05042	3.05094
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.42228	0.39201
		Q3B	Q3B default	unknown ❌	600.06200	1799.48000
		STP	stp_st default	unsat ✅	67.64170	67.63820
			stp_mt default	unsat ✅	45.19430	178.32500
		Yices2	Yices2-Main default	unsat ✅	0.06433	0.06318
		Z3	z3-4.5.0 default	unsat ✅	2.24732	2.24669
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.28144	0.28138
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	59.43360	59.42740
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	2.82076	2.82129
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.24299	0.33461
			Minkeyrink ST_st	unsat ✅	0.23292	0.23312
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	83.53660	83.53480
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	43.51460	171.72600
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	68.97190	68.97360
		Yices2	Yices 2.6.0_default	unsat ✅	0.07180	0.07155
		Z3	z3-4.7.1_default	unsat ✅	14.86950	14.86980
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.35451	0.35451
			Poolector-wrapped-sq_default	unsat ✅	0.27723	0.24242
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	1.24715	1.24721
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	27.76060	27.75560
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.25232	0.36816
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.23388	0.23393
		Par4	Par4-wrapped-sq_default	unsat ✅	0.06593	0.00582
		STP	STP-2019-wrapped-sq_default	unsat ✅	22.55840	22.55700
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	61.17510	61.17120
			stp-minisat-wrapped-sq_default	unsat ✅	29.15150	29.14970
			stp-mt-wrapped-sq_default	unsat ✅	24.58160	95.76450
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	60.51470	115.57900
			stp-riss-wrapped-sq_default	unknown ❌	0.47483	0.47493
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.06345	0.06346
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.12141	0.12140
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.09749	0.09749
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.61460	0.61458
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.14525	0.14524
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	2.26156	2.26138
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.42143	0.41833
		MathSAT	mathsat-5.6.6_default	unsat ✅	2.17536	2.17521
		STP	STP 2021.0_default	unsat ✅	0.23371	0.39827
		Z3	z3-4.8.11_default	unsat ✅	43.46170	86.80950
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.71355	0.71345
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	9.62705	9.62592
		STP	STP 2022.4_default	unsat ✅	0.21960	0.21960
			STP 2022.4_default	unsat ✅	0.22019	0.22019
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1240.29000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	0.06701	0.06698
		Z3-Owl	z3-Owl-Final_default	unsat ✅	217.58300	217.57300
			z3-Owl-Final_default	unsat ✅	43.36110	43.35590
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	0.51929	0.41876
		cvc5	cvc5	unsat ✅	39.59181	39.47476
		SMTInterpol	SMTInterpol	unknown ❌	1201.71961	1233.25142
		STP	STP	unsat ✅	0.38721	0.28742
		Yices2	Yices2	unsat ✅	0.29218	0.19249
		Z3alpha	Z3-alpha	unsat ✅	201.16987	201.06279
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	unsat ✅	0.38031	0.26032
			Bitwuzla-MachBV-base	unsat ✅	0.43144	0.31707
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	0.56852	0.44759
		BVDecide	bv_decide	unsat ✅	9.24611	9.09912
			bv_decide-nokernel	unsat ✅	4.63098	4.48100
		cvc5	cvc5	unsat ✅	6.56952	6.44062
		SMTInterpol	SMTInterpol	unknown ❌	1201.49273	1225.01989
		Yices2	Yices2	unsat ✅	0.38813	0.27024
		Z3alpha	Z3-alpha	unsat ✅	14.18780	52.50117
		Z3	Z3-alpha-base	unknown ❌	1201.26629	1200.94352
			Z3-Owl-base	unknown ❌	1201.26910	1201.01395
			z3siri-base	unknown ❌	1201.29687	1201.02674
		Z3-Owl	Z3-Owl	unsat ✅	759.10840	758.85805