Benchmark

non-incremental/QF_BV/bmc-bv/sudoku.smt2

Generated using using the Low-Level Bounded Model Checker LLBMC.
  C files used in the paper: Florian Merz, Stephan Falke, Carsten Sinz: LLBMC: Bounded Model Checking of C and C++ Programs Using a Compiler IR. VSTTE 2012: 146-161

Benchmark
Size	234912
Compressed Size	20361
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2014-07-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	234904
Compressed Size	20045
Max. Term Depth	5517
Asserts	1
Declared Functions	0
Declared Constants	81
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	2105	not	2	and	82	=	1
distinct	2025	let	5514	bvule	81	bvugt	81
zero_extend	1053

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2014		4Simp	4Simp - 2014 default	sat ✅	0.47479	0.45093
		Abziz	abziz_portfolio_all_features default	sat ✅	0.49607	0.48992
			abziz_portfolio_min_features default	sat ✅	0.49298	0.47893
		Boolector	Boolector boolector	sat ✅	239.18400	239.22500
		CVC4	CVC4 f7118b2 default	sat ✅	1.70668	3.25050
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.42442	0.41594
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.31149	0.30095
		STP	stp-cryptominisat4 default	sat ✅	0.53900	0.52992
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.22803	0.22697
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.29434	0.28696
SMT-COMP 2015		Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	5.32956	5.33019
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	1.01610	1.88571
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	1.65776	3.16752
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.65563	0.65490
		SMT-RAT	SMT-RAT-final default	sat ✅	104.14200	104.18300
		STP	stp-cryptominisat4 default	sat ✅	0.49768	0.49692
			stp-cmsat4-v15 default	sat ✅	3.10852	3.10853
			stp-cmsat4-mt-v15 default	unknown ❌	0.30865	0.30795
			stp-minisat-v15 default	sat ✅	0.37925	0.37794
		Yices2	Yices default	sat ✅	0.13432	0.13298
		Z3	z3 4.4.0 default	sat ✅	0.50751	0.50792
SMT-COMP 2016	0.10 (9/10)	ABC	ABC_default default_abc	sat ✅	0.57606	0.57602
			ABC_glucose glucose	sat ✅	5.27855	10.37600
		Boolector	Boolector boolector	sat ✅	1.38825	1.38899
			Boolector preprop boolector	sat ✅	1.40147	1.40226
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	1.60093	3.05940
		MapleSTP	MapleSTP default	sat ✅	0.33489	0.33569
			MapleSTP-mt default	sat ✅	0.36233	0.62064
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.55279	0.55408
		MinkeyRink	Minkeyrink 2016 default	sat ✅	2.41467	3.56256
		Q3B	Q3B default	unknown ❌	2400.04000	7203.17000
		STP	stp-cms-exp-2016 default	sat ✅	0.73752	0.73791
			stp-cms-mt-2016 default	sat ✅	0.71304	2.03292
			stp-cms-st-2016 default	sat ✅	0.98316	0.98370
			stp-minisat-st-2016 default	sat ✅	1.32487	1.32371
		Yices2	Yices-2.4.2 default	sat ✅	0.24345	0.24376
		Z3	z3-4.4.1 default	sat ✅	0.26432	0.26568
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.37451	0.36132
			Boolector SMT17 final boolector	sat ✅	1.10418	1.10355
		CVC4	CVC4-smtcomp2017-main default	sat ✅	1.83759	3.43305
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.85637	0.62367
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.62013	0.60549
		Q3B	Q3B default	unknown ❌	600.10600	1799.74000
		STP	stp_st default	sat ✅	0.28124	0.27981
			stp_mt default	sat ✅	0.29611	0.67178
		Yices2	Yices2-Main default	sat ✅	0.27617	0.27529
		Z3	z3-4.5.0 default	sat ✅	0.28795	0.28790
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.29069	0.29060
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	1.76882	1.76868
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.54211	0.54319
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.79455	1.99589
			Minkeyrink ST_st	sat ✅	1.87463	1.87451
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	1.80401	1.80357
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.91494	3.16098
			STP-Riss-st-2018_riss-no-stderr	sat ✅	0.34283	0.34288
		Yices2	Yices 2.6.0_default	sat ✅	0.15371	0.15364
		Z3	z3-4.7.1_default	sat ✅	0.48554	0.48547
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.21177	0.21178
			Poolector-wrapped-sq_default	sat ✅	0.38179	0.31595
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	3.00337	3.00337
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	1.05331	1.05354
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.72255	1.89126
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.76981	1.76995
		Par4	Par4-wrapped-sq_default	sat ✅	0.12024	0.00674
		STP	STP-2019-wrapped-sq_default	sat ✅	1.74646	1.74684
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	2.94624	2.94579
			stp-minisat-wrapped-sq_default	sat ✅	0.20137	0.20154
			stp-mt-wrapped-sq_default	sat ✅	0.89850	3.06779
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	3.00918	4.72462
			stp-riss-wrapped-sq_default	unknown ❌	0.16081	0.16099
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.12115	0.12115
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.26321	0.26320
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	3.11856	3.11833
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	0.18834	0.18832
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.14744	0.14743
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.22492	0.22492
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.23872	0.23868
		MathSAT	mathsat-5.6.6_default	sat ✅	0.54219	0.54209
		STP	STP 2021.0_default	sat ✅	0.34950	0.93499
		Z3	z3-4.8.11_default	sat ✅	0.27076	0.27072