Benchmark

non-incremental/QF_UF/QG-classification/qg6/gensys_icl_sk006.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size118781
Compressed Size9674
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 118773
Compressed Size9687
Max. Term Depth23
Asserts 731
Declared Functions1
Declared Constants11
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1011 or601 and3249 =4359
let6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Barcelogic Barcelogic 1.3 unsat ✅ 4.40000
CVC3 CVC3-1.5 unsat ✅ 1199.70000
MathSAT MathSAT-4.2 unsat ✅ 5.90000
OpenSMT OpenSMT 0.1 unsat ✅ 789.60000
Yices2 Yices2 (proto c) unsat ✅ 0.90000
Z3 Z3 0.1 unsat ✅ 36.60000
Z3.2 unsat ✅ 1.60000
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1200.00000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 1.40000
veriT veriT 201007 unsat ✅ 192.10000
Yices2 Yices 2 proto unsat ✅ 1.00000
SMT-COMP 2011 0.12 (7/8) CVC3 CVC3 v2.4 unknown ❌ 1200.00000
CVC4 CVC4 1.0rc.2026 unsat ✅ 1.60000
MathSAT MathSAT 5 unsat ✅ 1.60000
MathSAT5 unsat ✅ 2.10000
OpenSMT opensmt unsat ✅ 1.60000
SMTInterpol SMTInterpol 2.0pre unsat ✅ 17.30000
veriT veriT unsat ✅ 3.50000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 20.50000
Z3 Z3 unsat ✅ 1.60000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 212.92100
CVC3-SMT-COMP-2011 default unsat ✅ 191.20200
CVC3-SMT-COMP-2012 default unsat ✅ 182.40200
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 0.27354
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.34790
CVC4-SMT-EVAL-2013 default unsat ✅ 0.40703
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.46592
MathSAT5-SMT-COMP-2010 default unsat ✅ 2.65475
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.28535
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.23351
test_pmathsat-SMT-COMP-2010 default unsat ✅ 1.13033
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 1.13750
OpenSMT-SMT-COMP-2011 default unsat ✅ 1.17912
OpenSMT-SMT-EVAL-2013 default unsat ✅ 10.76610
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 4.72633
SMTInterpol-SMT-COMP-2011 default unsat ✅ 4.61700
SMTInterpol-SMT-COMP-2012 default unsat ✅ 3.45730
veriT veriT-SMT-COMP-2010 default unsat ✅ 135.85300
veriT-SMT-COMP-2011 default unsat ✅ 0.41578
veriT-SMT-EVAL-2013 default unsat ✅ 0.15049
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.11756
Z3-SMT-COMP-2011 default unsat ✅ 0.20675
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 1.46815 1.45778
MathSAT MathSAT-5.2.12-Main default unsat ✅ 1.12461 1.11583
OpenSMT opensmt2-2014-06-14c default unsat ✅ 6.30102 6.29504
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 4.48797 7.22890
veriT veriT-smtcomp2014 default unsat ✅ 0.21457 0.20497
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.13147 0.12298
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.25577 1.24781
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.54298 1.54177
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.54088 1.53877
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.22245 1.22181
OpenSMT OpenSMT2 default unsat ✅ 9.67694 9.68053
OpenSMT2-parallel default unsat ✅ 3.51459 7.70783
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 9.43133 13.82590
SMT-RAT SMT-RAT-final default unsat ✅ 1.82828 1.82772
veriT veriT default unsat ✅ 0.17140 0.16997
Yices2 Yices default unsat ✅ 0.11194 0.11098
Z3 z3 4.4.0 default unsat ✅ 1.23469 1.23481
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.53620 1.53733
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.05159 1.05323
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 1.82606 1.82753
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 4.75083 10.51140
Toysmt toysmt default unsat ✅ 328.73600 328.91900
veriT veriT-dev default unsat ✅ 0.23664 0.23689
Yices2 Yices-2.4.2 default unsat ✅ 0.29023 0.29036
Z3 z3-4.4.1 default unsat ✅ 1.18294 1.18475
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.56212 1.56115
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.93665 0.93020
OpenSMT opensmt2-2017-06-04 default unsat ✅ 1.88852 1.88687
SMTInterpol SMTInterpol default unsat ✅ 9.31435 17.26320
veriT veriT-2017-06-17 default unsat ✅ 0.11265 0.11276
Yices2 Yices2-Main default unsat ✅ 0.07236 0.07154
Z3 z3-4.5.0 default unsat ✅ 1.56176 1.56061
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.71774 1.71781
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.09684 1.09776
OpenSMT opensmt2_default unsat ✅ 1.77381 1.77301
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 6.24641 11.19770
veriT veriT_default unsat ✅ 0.08151 0.08167
Yices2 Yices 2.6.0_default unsat ✅ 0.06182 0.06177
Z3 z3-4.7.1_default unsat ✅ 1.28193 1.28175
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9530.22000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.84227 1.84246
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 1.77004 1.76999
Par4 Par4-wrapped-sq_default unsat ✅ 0.56545 1.10000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 5.85601 11.19830
veriT veriT-wrapped-sq_default unsat ✅ 0.33889 0.33914
Yices2 Yices 2.6.0_default unsat ✅ 0.56005 0.56005
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.55338 0.55340
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.24889 1.24882
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 1.05767 1.05770
Par4 Par4-wrapped-sq_default unsat ✅ 0.06710 0.00657
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 13.67980 25.99460
veriT veriT_default unsat ✅ 0.15814 0.15837
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05636 0.05632
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.05613 0.05607
Z3 z3-4.8.11_default unsat ✅ 1.18089 1.18082
z3-4.8.8_default unsat ✅ 1.23582 1.23570
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.80132 1.80059
MathSAT MathSAT-5.6.8_default unsat ✅ 0.97132 0.97132
veriT veriT_default unsat ✅ 0.20173 0.20193
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.17189 0.17186
Z3 z3-4.8.17_default unsat ✅ 1.28007 1.28186
z3-4.8.11_default unsat ✅ 1.18127 1.18114
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.73515 1.73396
OpenSMT OpenSMT a78dcf01_default unsat ✅ 7.02284 7.02208
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 20.07130 71.14520
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.25427 0.25424
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.25785 0.25779
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 1.76703 1.66681
OpenSMT OpenSMT unsat ✅ 5.92115 5.82123
plat-smt plat-smt unsat ✅ 1.21251 1.11290
SMTInterpol SMTInterpol unsat ✅ 12.27844 28.39893
Yices2 Yices2 unsat ✅ 0.26383 0.16438
Z3alpha Z3-alpha unsat ✅ 1.21610 1.11655