Benchmark

non-incremental/QF_LIA/CAV_2009_benchmarks/smt/35-vars/problem__023.smt2

Alberto Griggio

Benchmark
Size	11797
Compressed Size	3005
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	random
First Occurrence	2010-07-15
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	11789
Compressed Size	3026
Max. Term Depth	5
Asserts	1
Declared Functions	0
Declared Constants	35
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

and	1	let	1	+	40	-	53
*	105	<=	40

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.33 (4/6)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	754.97600	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	62.70850	—
			CVC4-SMT-EVAL-2013 default	sat ✅	18.53130	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	1.25225	—
			MathSAT5-SMT-COMP-2010 default	sat ✅	0.92998	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	2.34223	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	2.34746	—
			test_pmathsat-SMT-COMP-2010 default	sat ✅	3.17168	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	sat ✅	20.03680	—
			SMTInterpol-SMT-COMP-2011 default	unknown ❌	—	—
			SMTInterpol-SMT-COMP-2012 default	unknown ❌	—	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	0.04092	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.50825	—
			Z3-SMT-COMP-2011 default	sat ✅	3.77309	—
SMT-COMP 2014	0.33 (4/6)	CVC4	CVC4 f7118b2 default	sat ✅	0.09798	0.08699
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	6.37141	6.36103
		SMTInterpol	smtinterpol-2.1-118-g3dada2f default	unknown ❌	2340.12000	2400.02000
		veriT	veriT-smtcomp2014 default	unknown ❌	0.75530	0.74689
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	4.40192	4.39433
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.81657	0.80888
SMT-COMP 2015	0.14 (6/7)	CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.58808	0.58691
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.58393	0.58191
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	2.19006	2.18967
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	sat ✅	2.62333	7.04493
		SMT-RAT	SMT-RAT-final default	sat ✅	0.37011	0.36894
		veriT	veriT default	unknown ❌	0.26365	0.26296
		Yices2	Yices default	sat ✅	0.05387	0.05299
		Z3	z3 4.4.0 default	sat ✅	0.56504	0.56491
SMT-COMP 2016	0.25 (6/8)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.07852	0.07931
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.09000	0.09105
		ProB	ProB competition	unknown ❌	53.81280	53.84540
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	sat ✅	3.03886	8.72255
		SMT-RAT	SMT-RAT default	sat ✅	0.03699	0.03692
		veriT	veriT-dev default	unknown ❌	0.28299	0.28359
		Yices2	Yices-2.4.2 default	sat ✅	0.21209	0.21216
		Z3	z3-4.4.1 default	sat ✅	0.49319	0.49456
SMT-COMP 2017	0.14 (6/7)	CVC4	CVC4-smtcomp2017-main default	sat ✅	0.31175	0.30950
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.06871	0.06911
		SMTInterpol	SMTInterpol default	sat ✅	0.66130	1.55465
		SMT-RAT	SMTRAT-comp2017_2 default	sat ✅	0.10603	0.10522
		veriT	veriT-2017-06-17 default	unknown ❌	0.27413	0.27390
		Yices2	Yices2-Main default	sat ✅	0.10344	0.09675
		Z3	z3-4.5.0 default	sat ✅	7.61753	7.61725
SMT-COMP 2018	0.12 (7/8)	Ctrl-Ergo	Ctrl-Ergo-SMTComp-2018_default	sat ✅	0.04779	0.04779
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.61095	0.61110
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.07783	0.07886
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	sat ✅	0.61874	1.47208
		SMT-RAT	SMTRAT-Rat-final_default	sat ✅	0.21539	0.21535
		veriT	veriT_default	unknown ❌	0.47268	0.47269
		Yices2	Yices 2.6.0_default	sat ✅	161.93700	161.92600
		Z3	z3-4.7.1_default	sat ✅	0.61572	0.61561
SMT-COMP 2019	0.50 (4/8)	Ctrl-Ergo	Ctrl-Ergo-2019-wrapped-sq_default	sat ✅	0.05506	0.05554
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	0.10659	0.10687
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	sat ✅	108.75500	108.73900
		Par4	Par4-wrapped-sq_default	sat ✅	0.03180	0.00577
		ProB	ProB-wrapped-sq_default	unknown ❌	2400.04000	2399.95000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.03000	2423.23000
		veriT	veriT-wrapped-sq_default	unknown ❌	0.28615	0.28644
		Yices2	Yices 2.6.2-wrapped-sq_default	unknown ❌	2400.04000	2399.97000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.15730	0.15737
SMT-COMP 2025	0.17 (5/6)	cvc5	cvc5	sat ✅	0.67538	0.55945
		OpenSMT	OpenSMT	sat ✅	76.21153	76.08296
		SMTInterpol	SMTInterpol	unknown ❌	1201.38658	1231.52211
		Yices2	Yices2	sat ✅	0.29993	0.17048
		Z3alpha	Z3-alpha	sat ✅	0.61637	0.74778
		Z3	Z3-alpha-base	sat ✅	0.38659	0.26253