Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_icl204.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size25708
Compressed Size4350
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 25700
Compressed Size4371
Max. Term Depth27
Asserts 15
Declared Functions2
Declared Constants5
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not211 or541 and413 =714
let9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.05353
CVC3-SMT-COMP-2011 default unsat ✅ 0.05027
CVC3-SMT-COMP-2012 default unsat ✅ 0.04819
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 0.03401
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.04695
CVC4-SMT-EVAL-2013 default unsat ✅ 0.04354
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.02972
MathSAT5-SMT-COMP-2010 default unsat ✅ 0.02666
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.03710
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.02788
test_pmathsat-SMT-COMP-2010 default unsat ✅ 0.03768
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 0.02507
OpenSMT-SMT-COMP-2011 default unsat ✅ 0.02781
OpenSMT-SMT-EVAL-2013 default unsat ✅ 0.07428
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 0.53067
SMTInterpol-SMT-COMP-2011 default unsat ✅ 0.42856
SMTInterpol-SMT-COMP-2012 default unsat ✅ 0.44412
veriT veriT-SMT-COMP-2010 default unsat ✅ 0.03949
veriT-SMT-COMP-2011 default unsat ✅ 0.03271
veriT-SMT-EVAL-2013 default unsat ✅ 0.02204
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01406
Z3-SMT-COMP-2011 default unsat ✅ 0.02546
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.04525 0.04299
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.04500 0.04199
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.03402 0.03299
OpenSMT OpenSMT2 default unsat ✅ 0.04137 0.03999
OpenSMT2-parallel default unsat ✅ 0.04185 0.04099
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 0.59502 0.91686
SMT-RAT SMT-RAT-final default unsat ✅ 0.06632 0.06499
veriT veriT default unsat ✅ 0.01587 0.01500
Yices2 Yices default unsat ✅ 0.00815 0.00400
Z3 z3 4.4.0 default unsat ✅ 0.03843 0.03799
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.04573 0.04585
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.02852 0.02947
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 0.06822 0.06818
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 0.43598 0.94943
Toysmt toysmt default unsat ✅ 1.75043 1.74825
veriT veriT-dev default unsat ✅ 0.01327 0.01393
Yices2 Yices-2.4.2 default unsat ✅ 0.01370 0.00543
Z3 z3-4.4.1 default unsat ✅ 0.03764 0.03891
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04596 0.04540
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.03204 0.03235
OpenSMT opensmt2-2017-06-04 default unsat ✅ 0.04042 0.03947
SMTInterpol SMTInterpol default unsat ✅ 0.44914 0.99518
veriT veriT-2017-06-17 default unsat ✅ 0.01424 0.01355
Yices2 Yices2-Main default unsat ✅ 0.00784 0.00552
Z3 z3-4.5.0 default unsat ✅ 0.04041 0.03971
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04918 0.04935
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.02892 0.02991
OpenSMT opensmt2_default unsat ✅ 0.03061 0.03051
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 0.46995 1.04235
veriT veriT_default unsat ✅ 0.01420 0.01430
Yices2 Yices 2.6.0_default unsat ✅ 0.00806 0.00801
Z3 z3-4.7.1_default unsat ✅ 0.04440 0.04430
SMT-COMP 2019 Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 6.54546 25.85000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.05439 0.05468
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 0.03342 0.03342
Par4 Par4-wrapped-sq_default unsat ✅ 0.01557 0.00588
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 0.48354 1.06350
veriT veriT-wrapped-sq_default unsat ✅ 0.02001 0.01879
Yices2 Yices 2.6.0_default unsat ✅ 0.00945 0.00888
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00902 0.00873
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04682 0.04680
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.05821 0.05879
MathSAT MathSAT-5.6.8_default unsat ✅ 0.03092 0.03086
veriT veriT_default unsat ✅ 0.02692 0.01749
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01172 0.00613
Z3 z3-4.8.17_default unsat ✅ 0.02915 0.02944
z3-4.8.11_default unsat ✅ 0.02729 0.02725
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04713 0.04767
OpenSMT OpenSMT a78dcf01_default unsat ✅ 0.02175 0.02173
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.72178 1.79713
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01018 0.00663
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01012 0.00660
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.24494 0.14530
OpenSMT OpenSMT unsat ✅ 0.22381 0.12377
plat-smt plat-smt unsat ✅ 0.21524 0.11591
SMTInterpol SMTInterpol unsat ✅ 0.76855 1.70051
Yices2 Yices2 unsat ✅ 0.21651 0.11606
Z3alpha Z3-alpha unsat ✅ 0.30027 0.20035