Benchmark

non-incremental/QF_UF/QG-classification/qg7/gensys_icl002.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size811783
Compressed Size35129
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 811775
Compressed Size35113
Max. Term Depth30
Asserts 5049
Declared Functions1
Declared Constants7
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not5362 or1014 and25773 =31486
let6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1200.00000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 17.30000
veriT veriT 201007 unsat ✅ 26.10000
Yices2 Yices 2 proto unsat ✅ 3.30000
SMT-COMP 2011 0.12 (7/8) CVC3 CVC3 v2.4 unknown ❌ 1200.00000
CVC4 CVC4 1.0rc.2026 unsat ✅ 11.80000
MathSAT MathSAT 5 unsat ✅ 6.60000
MathSAT5 unsat ✅ 8.40000
OpenSMT opensmt unsat ✅ 22.10000
SMTInterpol SMTInterpol 2.0pre unsat ✅ 90.40000
veriT veriT unsat ✅ 1.40000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 29.60000
Z3 Z3 unsat ✅ 15.70000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 80.27330
CVC3-SMT-COMP-2011 default unsat ✅ 85.87770
CVC3-SMT-COMP-2012 default unsat ✅ 83.84510
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 1.54466
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.89949
CVC4-SMT-EVAL-2013 default unsat ✅ 1.86316
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 4.76665
MathSAT5-SMT-COMP-2010 default unsat ✅ 5.61335
MathSAT5-SMT-COMP-2011 default unsat ✅ 6.38585
MathSAT5-SMT-COMP-2012 default unsat ✅ 6.14423
test_pmathsat-SMT-COMP-2010 default unsat ✅ 5.31029
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 7.35024
OpenSMT-SMT-COMP-2011 default unsat ✅ 7.21773
OpenSMT-SMT-EVAL-2013 default unsat ✅ 152.54200
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 14.92300
SMTInterpol-SMT-COMP-2011 default unsat ✅ 33.11430
SMTInterpol-SMT-COMP-2012 default unsat ✅ 14.45870
veriT veriT-SMT-COMP-2010 default unsat ✅ 17.32530
veriT-SMT-COMP-2011 default unsat ✅ 0.69869
veriT-SMT-EVAL-2013 default unsat ✅ 0.38423
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.35948
Z3-SMT-COMP-2011 default unsat ✅ 0.39974
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 7.47386 7.46486
MathSAT MathSAT-5.2.12-Main default unsat ✅ 4.52872 4.51831
OpenSMT opensmt2-2014-06-14c default unsat ✅ 49.20380 49.22750
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 15.79760 19.19810
veriT veriT-smtcomp2014 default unsat ✅ 0.51685 0.50792
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.15523 0.14698
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 9.40675 9.40857
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 8.57706 8.57670
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 8.63981 8.63669
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 4.50200 4.50331
OpenSMT OpenSMT2 default unsat ✅ 249.42700 249.49100
OpenSMT2-parallel default unsat ✅ 11.75260 39.00910
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 14.80010 21.06280
SMT-RAT SMT-RAT-final default unsat ✅ 13.03900 13.04300
veriT veriT default unsat ✅ 0.31582 0.31495
Yices2 Yices default unsat ✅ 0.14012 0.13898
Z3 z3 4.4.0 default unsat ✅ 8.96503 8.96964
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 7.72036 7.72516
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 4.79005 4.79371
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 11.32120 11.32710
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 16.45480 29.88680
Toysmt toysmt default unsat ✅ 874.92700 875.34200
veriT veriT-dev default unsat ✅ 0.17163 0.17185
Yices2 Yices-2.4.2 default unsat ✅ 0.13459 0.13462
Z3 z3-4.4.1 default unsat ✅ 8.60213 8.60819
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 7.94817 7.94631
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 4.17187 4.17154
OpenSMT opensmt2-2017-06-04 default unsat ✅ 12.03270 12.03150
SMTInterpol SMTInterpol default unsat ✅ 17.14040 29.91920
veriT veriT-2017-06-17 default unsat ✅ 0.16624 0.16543
Yices2 Yices2-Main default unsat ✅ 0.10912 0.10792
Z3 z3-4.5.0 default unsat ✅ 9.43264 9.43100
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 9.92611 9.92478
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 4.53137 4.53200
OpenSMT opensmt2_default unsat ✅ 10.03290 10.03210
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 20.92580 31.89920
veriT veriT_default unsat ✅ 0.17753 0.17750
Yices2 Yices 2.6.0_default unsat ✅ 0.13826 0.13820
Z3 z3-4.7.1_default unsat ✅ 8.56582 8.56536
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9521.95000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 10.11880 10.11890
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 9.74131 9.74119
Par4 Par4-wrapped-sq_default unsat ✅ 0.14605 0.00575
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 19.13170 32.11530
veriT veriT-wrapped-sq_default unsat ✅ 0.20444 0.20470
Yices2 Yices 2.6.0_default unsat ✅ 0.14143 0.14140
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.13409 0.13404
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 10.37670 10.37340
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 4.32584 4.32595
Par4 Par4-wrapped-sq_default unsat ✅ 0.15412 0.00635
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 27.22830 42.73360
veriT veriT_default unsat ✅ 0.17627 0.17653
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14178 0.14171
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.14171 0.14167
Z3 z3-4.8.11_default unsat ✅ 9.37141 9.37153
z3-4.8.8_default unsat ✅ 9.80029 9.79765
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 9.96771 9.96594
MathSAT MathSAT-5.6.8_default unsat ✅ 4.66150 4.66106
veriT veriT_default unsat ✅ 0.17643 0.17661
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11743 0.11739
Z3 z3-4.8.17_default unsat ✅ 8.04071 8.03561
z3-4.8.11_default unsat ✅ 8.03602 8.03649
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 6.16198 6.06199
OpenSMT OpenSMT unsat ✅ 6.97652 6.87413
plat-smt plat-smt unsat ✅ 54.66579 54.55454
SMTInterpol SMTInterpol unsat ✅ 42.48901 89.09581
Yices2 Yices2 unsat ✅ 0.32772 0.22798
Z3alpha Z3-alpha unsat ✅ 6.97168 6.87127
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 6.67316 6.54098
OpenSMT OpenSMT unsat ✅ 5.73248 5.60940
SMTInterpol SMTInterpol unsat ✅ 36.79935 61.89942
Yices2 Yices2 unsat ✅ 0.33764 0.21985