Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_brn026.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/

Benchmark
Size	23596
Compressed Size	4077
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	23588
Compressed Size	4096
Max. Term Depth	27
Asserts	12
Declared Functions	2
Declared Constants	5
Declared Sorts	2
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	311	or	476	and	381	=	619
let	8

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.04417	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.04162	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.04004	—
		CVC4	CVC4-SMT-COMP-2011 default	unsat ✅	0.02629	—
			CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	—	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.03762	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.02776	—
			MathSAT5-SMT-COMP-2010 default	unsat ✅	0.02295	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.04177	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.02533	—
			test_pmathsat-SMT-COMP-2010 default	unsat ✅	0.03538	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unsat ✅	0.02168	—
			OpenSMT-SMT-COMP-2011 default	unsat ✅	0.01975	—
			OpenSMT-SMT-EVAL-2013 default	unsat ✅	0.04757	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	unknown ❌	—	—
			SMTInterpol-SMT-COMP-2011 default	unsat ✅	0.43090	—
			SMTInterpol-SMT-COMP-2012 default	unsat ✅	0.41185	—
		veriT	veriT-SMT-COMP-2010 default	unsat ✅	0.04346	—
			veriT-SMT-COMP-2011 default	unsat ✅	0.02964	—
			veriT-SMT-EVAL-2013 default	unsat ✅	0.01881	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.01425	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.02508	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	unsat ✅	0.04500	0.03399
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.03140	0.02300
		OpenSMT	opensmt2-2014-06-14c default	unsat ✅	0.03213	0.02300
		SMTInterpol	smtinterpol-2.1-118-g3dada2f default	unsat ✅	0.48877	0.70889
		veriT	veriT-smtcomp2014 default	unsat ✅	0.02678	0.01800
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.01228	0.00400
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.02296	0.01400
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.03916	0.03699
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.03924	0.03699
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.03280	0.03200
		OpenSMT	OpenSMT2 default	unsat ✅	0.03158	0.02999
			OpenSMT2-parallel default	unsat ✅	0.03144	0.02999
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	0.57552	0.91586
		SMT-RAT	SMT-RAT-final default	unsat ✅	0.05686	0.05599
		veriT	veriT default	unsat ✅	0.01524	0.01400
		Yices2	Yices default	unsat ✅	0.00850	0.00400
		Z3	z3 4.4.0 default	unsat ✅	0.03791	0.03799
SMT-COMP 2016	0.12 (7/8)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.04031	0.04078
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.02634	0.02732
		OpenSMT	OpenSMT2-2016-05-12 default	unsat ✅	0.03680	0.03676
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	0.42178	0.89461
		Toysmt	toysmt default	unknown ❌	0.32890	0.32905
		veriT	veriT-dev default	unsat ✅	0.01338	0.01364
		Yices2	Yices-2.4.2 default	unsat ✅	0.01417	0.00517
		Z3	z3-4.4.1 default	unsat ✅	0.03755	0.03881
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.04124	0.04150
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.02880	0.02802
		OpenSMT	opensmt2-2017-06-04 default	unsat ✅	0.03845	0.03765
		SMTInterpol	SMTInterpol default	unsat ✅	0.44385	0.92457
		veriT	veriT-2017-06-17 default	unsat ✅	0.01351	0.01304
		Yices2	Yices2-Main default	unsat ✅	0.03351	0.00594
		Z3	z3-4.5.0 default	unsat ✅	0.04006	0.03890
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.04374	0.04390
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.02636	0.02737
		OpenSMT	opensmt2_default	unsat ✅	0.03812	0.03802
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unsat ✅	0.46126	0.98753
		veriT	veriT_default	unsat ✅	0.01327	0.01341
		Yices2	Yices 2.6.0_default	unsat ✅	0.01065	0.00827
		Z3	z3-4.7.1_default	unsat ✅	0.04285	0.04279