Benchmark

non-incremental/QF_LIA/CAV_2009_benchmarks/smt/20-vars/problem__006.smt2

Alberto Griggio

Benchmark
Size	4983
Compressed Size	1331
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	random
First Occurrence	2010-07-15
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	4975
Compressed Size	1339
Max. Term Depth	5
Asserts	1
Declared Functions	0
Declared Constants	20
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

and	1	let	1	+	25	-	26
*	60	<=	25

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.33 (4/6)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	561.68800	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.09113	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.07853	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.03260	—
			MathSAT5-SMT-COMP-2010 default	sat ✅	0.01702	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.02706	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.02648	—
			test_pmathsat-SMT-COMP-2010 default	sat ✅	0.04698	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	sat ✅	0.98285	—
			SMTInterpol-SMT-COMP-2011 default	sat ✅	0.66706	—
			SMTInterpol-SMT-COMP-2012 default	sat ✅	2.01669	—
		veriT	veriT-SMT-EVAL-2013 default	unknown ❌	0.02037	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.04232	—
			Z3-SMT-COMP-2011 default	sat ✅	0.03717	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	sat ✅	0.03134	0.02100
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.03554	0.02700
		SMTInterpol	smtinterpol-2.1-118-g3dada2f default	sat ✅	0.50706	0.87187
		veriT	veriT-smtcomp2014 default	sat ✅	0.10718	0.09799
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.13353	0.13198
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.04989	0.04099
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.02109	0.01900
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.02150	0.01900
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.02997	0.02899
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	sat ✅	0.45583	0.68290
		SMT-RAT	SMT-RAT-final default	sat ✅	0.01502	0.01400
		veriT	veriT default	sat ✅	0.01167	0.01100
		Yices2	Yices default	sat ✅	0.00796	0.00400
		Z3	z3 4.4.0 default	sat ✅	0.03556	0.03599
SMT-COMP 2016	0.12 (7/8)	CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.02456	0.02470
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.03280	0.03367
		ProB	ProB competition	sat ✅	82.41100	82.45450
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	sat ✅	0.41060	0.82857
		SMT-RAT	SMT-RAT default	sat ✅	0.01925	0.01923
		veriT	veriT-dev default	unknown ❌	0.09947	0.09967
		Yices2	Yices-2.4.2 default	sat ✅	0.01132	0.00707
		Z3	z3-4.4.1 default	sat ✅	0.03371	0.03500
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.02519	0.02434
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.02522	0.02532
		SMTInterpol	SMTInterpol default	sat ✅	0.54479	1.29366
		SMT-RAT	SMTRAT-comp2017_2 default	sat ✅	0.02658	0.01969
		veriT	veriT-2017-06-17 default	sat ✅	0.02828	0.02184
		Yices2	Yices2-Main default	sat ✅	1.07534	1.07431
		Z3	z3-4.5.0 default	sat ✅	0.04432	0.03914
SMT-COMP 2018	0.12 (7/8)	Ctrl-Ergo	Ctrl-Ergo-SMTComp-2018_default	sat ✅	0.03483	0.03540
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.02767	0.02781
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.03113	0.03236
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	sat ✅	0.35970	0.61827
		SMT-RAT	SMTRAT-Rat-final_default	sat ✅	0.02039	0.02028
		veriT	veriT_default	unknown ❌	0.09656	0.09749
		Yices2	Yices 2.6.0_default	sat ✅	0.00832	0.00827
		Z3	z3-4.7.1_default	sat ✅	0.04743	0.04740
SMT-COMP 2019	0.25 (6/8)	Ctrl-Ergo	Ctrl-Ergo-2019-wrapped-sq_default	sat ✅	0.03750	0.03774
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	0.03131	0.03158
			CVC4-SymBreak_03_06_2019-wrapped-sq_default	sat ✅	1.05110	1.05334
		Par4	Par4-wrapped-sq_default	sat ✅	0.01832	0.00599
		ProB	ProB-wrapped-sq_default	unknown ❌	1.48667	1.45769
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	sat ✅	0.38619	0.65564
		veriT	veriT-wrapped-sq_default	unknown ❌	0.10953	0.10985
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.00900	0.00894
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.04269	0.04278
SMT-COMP 2020	0.14 (6/7)	CVC4	CVC4-sq-final_default	sat ✅	0.03442	0.03469
		MathSAT	MathSAT5_default.sh	sat ✅	0.02771	0.02767
		Par4	Par4-wrapped-sq_default	sat ✅	0.01916	0.00655
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	sat ✅	0.40337	0.70825
		veriT	veriT_default	unknown ❌	0.11903	0.11923
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.01118	0.00670
		Z3	z3-4.8.8_default	sat ✅	0.04009	0.04011
SMT-COMP 2024		cvc5	cvc5	sat ✅	0.25296	0.15369
		OpenSMT	OpenSMT	sat ✅	0.22428	0.12451
		SMTInterpol	SMTInterpol	sat ✅	0.57063	0.85429
		Yices2	Yices2	sat ✅	0.21740	0.11752
		Z3alpha	Z3-alpha	sat ✅	0.28107	0.18158
SMT-COMP 2025		cvc5	cvc5	sat ✅	0.29641	0.17134
		OpenSMT	OpenSMT	sat ✅	0.33905	0.21370
		SMTInterpol	SMTInterpol	sat ✅	0.58276	0.81638
		Yices2	Yices2	sat ✅	0.37683	0.24996
		Z3alpha	Z3-alpha	sat ✅	0.35827	0.26196
		Z3	Z3-alpha-base	sat ✅	0.30077	0.18154