Benchmark

non-incremental/QF_UF/QG-classification/qg7/iso_brn_repgen_sk012.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size59102
Compressed Size7530
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 59094
Compressed Size7555
Max. Term Depth57
Asserts 17
Declared Functions3
Declared Constants11
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not679 or997 and1214 =1836
let41

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default sat ✅ 4.90764
CVC3-SMT-COMP-2011 default sat ✅ 4.74836
CVC3-SMT-COMP-2012 default sat ✅ 4.46569
CVC4 CVC4-SMT-COMP-2011 default sat ✅ 1.63094
CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.24029
CVC4-SMT-EVAL-2013 default sat ✅ 0.31178
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.29790
MathSAT5-SMT-COMP-2010 default sat ✅ 0.67328
MathSAT5-SMT-COMP-2011 default sat ✅ 0.71018
MathSAT5-SMT-COMP-2012 default sat ✅ 0.60349
test_pmathsat-SMT-COMP-2010 default sat ✅ 0.25929
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 0.84176
OpenSMT-SMT-COMP-2011 default sat ✅ 0.89992
OpenSMT-SMT-EVAL-2013 default sat ✅ 10.57460
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 1.68913
SMTInterpol-SMT-COMP-2011 default sat ✅ 1.53042
SMTInterpol-SMT-COMP-2012 default sat ✅ 1.94596
veriT veriT-SMT-COMP-2010 default sat ✅ 1.74787
veriT-SMT-COMP-2011 default sat ✅ 1.13963
veriT-SMT-EVAL-2013 default sat ✅ 0.18466
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.39181
Z3-SMT-COMP-2011 default sat ✅ 0.06389
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 0.77162 0.76188
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.46933 0.46793
OpenSMT opensmt2-2014-06-14c default sat ✅ 11.87700 11.87220
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 2.05601 3.85441
veriT veriT-smtcomp2014 default sat ✅ 0.54854 0.53992
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.13779 0.12898
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.99098 0.98185
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.83484 1.83372
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.83764 1.83572
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.82286 0.82187
OpenSMT OpenSMT2 default sat ✅ 1.53256 1.53177
OpenSMT2-parallel default sat ✅ 1.54263 1.54277
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 2.72156 5.43117
SMT-RAT SMT-RAT-final default sat ✅ 3.57742 3.57746
veriT veriT default sat ✅ 0.29483 0.29395
Yices2 Yices default sat ✅ 0.24714 0.24596
Z3 z3 4.4.0 default sat ✅ 0.12481 0.12498
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.70193 1.70030
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.32149 0.32263
OpenSMT OpenSMT2-2016-05-12 default sat ✅ 0.55771 0.55801
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 1.96880 6.14935
Toysmt toysmt default unknown ❌ 2400.06000 2401.46000
veriT veriT-dev default sat ✅ 0.11066 0.11104
Yices2 Yices-2.4.2 default sat ✅ 8.13626 8.14093
Z3 z3-4.4.1 default sat ✅ 0.71449 0.71650
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 0.48294 0.48209
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.27550 0.27581
OpenSMT opensmt2-2017-06-04 default sat ✅ 0.88970 0.88959
SMTInterpol SMTInterpol default sat ✅ 0.75037 2.07501
veriT veriT-2017-06-17 default sat ✅ 0.21980 0.22030
Yices2 Yices2-Main default sat ✅ 0.14417 0.14344
Z3 z3-4.5.0 default sat ✅ 0.25337 0.25267
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.76905 1.76901
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.95969 0.96071
OpenSMT opensmt2_default sat ✅ 1.09238 1.09086
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 0.81433 2.21215
veriT veriT_default sat ✅ 0.11049 0.11060
Yices2 Yices 2.6.0_default sat ✅ 0.29058 0.29051
Z3 z3-4.7.1_default sat ✅ 0.24145 0.24116
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9534.12000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1.18666 1.18682
OpenSMT OpenSMT-wrapped-sq_default sat ✅ 1.60539 1.60553
Par4 Par4-wrapped-sq_default sat ✅ 0.49593 0.00588
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.95295 2.63342
veriT veriT-wrapped-sq_default sat ✅ 0.18553 0.18579
Yices2 Yices 2.6.0_default sat ✅ 1.45908 1.45899
Yices 2.6.2-wrapped-sq_default sat ✅ 1.43245 1.43231
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.49804 0.49806
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.40512 0.40507
Par4 Par4-wrapped-sq_default sat ✅ 0.04677 0.00647
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 1.20446 3.13159
veriT veriT_default sat ✅ 0.10631 0.10655
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.03255 0.03253
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.03250 0.03248
Z3 z3-4.8.11_default sat ✅ 0.16589 0.16581
z3-4.8.8_default sat ✅ 0.18588 0.18580
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.85139 2.85194
MathSAT MathSAT-5.6.8_default sat ✅ 0.13450 0.13444
veriT veriT_default sat ✅ 0.06191 0.06216
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.16475 0.16470
Z3 z3-4.8.17_default sat ✅ 0.19627 0.19810
z3-4.8.11_default sat ✅ 0.08314 0.08310
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.83746 0.83800
OpenSMT OpenSMT a78dcf01_default sat ✅ 1.44351 1.44333
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 1.31396 3.46750
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.05344 0.05341
Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.05376 0.05372
SMT-COMP 2024 cvc5 cvc5 sat ✅ 0.58815 0.48774
OpenSMT OpenSMT sat ✅ 0.69859 0.59831
plat-smt plat-smt sat ✅ 0.86345 0.76201
SMTInterpol SMTInterpol sat ✅ 2.35629 6.55984
Yices2 Yices2 sat ✅ 0.28216 0.18184
Z3alpha Z3-alpha sat ✅ 0.63978 0.53969