Benchmark

non-incremental/QF_UF/QG-classification/qg6/iso_icl_nogen_sk002.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size653129
Compressed Size35882
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 653121
Compressed Size35889
Max. Term Depth23
Asserts 730
Declared Functions4
Declared Constants8
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not933 or610 and25543 =26667
let7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 61.44570
CVC3-SMT-COMP-2011 default unsat ✅ 61.62820
CVC3-SMT-COMP-2012 default unsat ✅ 61.04950
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 0.78171
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.01595
CVC4-SMT-EVAL-2013 default unsat ✅ 0.85730
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.09178
MathSAT5-SMT-COMP-2010 default unsat ✅ 1.22775
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.41281
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.35577
test_pmathsat-SMT-COMP-2010 default unsat ✅ 1.06724
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 1.55030
OpenSMT-SMT-COMP-2011 default unsat ✅ 1.66239
OpenSMT-SMT-EVAL-2013 default unsat ✅ 62.12660
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 6.74122
SMTInterpol-SMT-COMP-2011 default unsat ✅ 4.25517
SMTInterpol-SMT-COMP-2012 default unsat ✅ 4.10914
veriT veriT-SMT-COMP-2010 default unsat ✅ 63.57040
veriT-SMT-COMP-2011 default unsat ✅ 0.53368
veriT-SMT-EVAL-2013 default unsat ✅ 0.22700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.25013
Z3-SMT-COMP-2011 default unsat ✅ 0.24687
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 1.83512 1.82472
MathSAT MathSAT-5.2.12-Main default unsat ✅ 1.02014 1.01184
OpenSMT opensmt2-2014-06-14c default unsat ✅ 7.71331 7.70783
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 5.09063 8.20075
veriT veriT-smtcomp2014 default unsat ✅ 0.30533 0.29595
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.07833 0.06899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.02644 1.01884
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.14971 2.14867
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.15966 2.15867
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.88867 0.88786
OpenSMT OpenSMT2 default unsat ✅ 33.38470 33.39490
OpenSMT2-parallel default unsat ✅ 3.93605 8.53270
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 5.48984 8.25874
SMT-RAT SMT-RAT-final default unsat ✅ 2.34768 2.34764
veriT veriT default unsat ✅ 0.24084 0.23996
Yices2 Yices default unsat ✅ 0.07691 0.07599
Z3 z3 4.4.0 default unsat ✅ 1.02272 1.02284
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.84621 1.84545
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.90305 0.90508
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 2.32719 2.32859
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 5.96993 19.28560
Toysmt toysmt default unsat ✅ 176.48000 176.57500
veriT veriT-dev default unsat ✅ 0.17968 0.17992
Yices2 Yices-2.4.2 default unsat ✅ 0.09874 0.09878
Z3 z3-4.4.1 default unsat ✅ 1.01771 1.01957
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.06046 2.05992
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.92384 1.82460
OpenSMT opensmt2-2017-06-04 default unsat ✅ 1.81265 1.81023
SMTInterpol SMTInterpol default unsat ✅ 7.41491 18.86170
veriT veriT-2017-06-17 default unsat ✅ 0.16556 0.16496
Yices2 Yices2-Main default unsat ✅ 0.07440 0.07352
Z3 z3-4.5.0 default unsat ✅ 1.03536 1.03402
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.16791 2.16799
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.90837 0.90894
OpenSMT opensmt2_default unsat ✅ 2.39144 2.39138
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 6.02680 14.51960
veriT veriT_default unsat ✅ 0.15412 0.15427
Yices2 Yices 2.6.0_default unsat ✅ 0.09227 0.09218
Z3 z3-4.7.1_default unsat ✅ 1.03569 1.03552
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.08000 9517.95000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.36519 2.36546
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 1.86589 1.86370
Par4 Par4-wrapped-sq_default unsat ✅ 0.07172 0.00592
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 7.56507 19.89100
veriT veriT-wrapped-sq_default unsat ✅ 0.19543 0.19576
Yices2 Yices 2.6.0_default unsat ✅ 0.06483 0.06477
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06193 0.06194
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.20603 1.20603
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.02000 4760.85000
CVC4 CVC4-sq-final_default unsat ✅ 2.92814 2.92744
MathSAT MathSAT5_default.sh unsat ✅ 1.21171 2.38166
OpenSMT OpenSMT_default unsat ✅ 1.71428 1.71427
Par4 Par4-wrapped-sq_default unsat ✅ 0.20002 0.00652
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 8.59562 19.45760
veriT veriT_default unsat ✅ 0.21999 0.21895
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.19073 0.19070
Z3 z3-4.8.8_default unsat ✅ 0.98173 0.98164
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.62169 2.62212
MathSAT MathSAT-5.6.8_default unsat ✅ 0.99734 0.99722
veriT veriT_default unsat ✅ 0.17952 0.17978
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.07327 0.07325
Z3 z3-4.8.17_default unsat ✅ 0.96097 0.96262
z3-4.8.11_default unsat ✅ 0.98588 0.98369
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.98161 1.97979
OpenSMT OpenSMT a78dcf01_default unsat ✅ 4.46116 4.45945
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 12.61840 28.49400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10537 0.10532
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.10478 0.10472
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 1.48978 1.38905
OpenSMT OpenSMT unsat ✅ 5.36052 5.26082
plat-smt plat-smt unsat ✅ 4.67344 4.57311
SMTInterpol SMTInterpol unsat ✅ 13.22793 31.24624
Yices2 Yices2 unsat ✅ 0.29094 0.19122
Z3alpha Z3-alpha unsat ✅ 1.06331 0.96334
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 1.33760 1.21089
OpenSMT OpenSMT unsat ✅ 3.86997 3.74211
SMTInterpol SMTInterpol unsat ✅ 14.58225 28.35122
Yices2 Yices2 unsat ✅ 0.32840 0.19866