Benchmark

non-incremental/QF_UF/QG-classification/qg6/iso_icl_nogen011.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size661391
Compressed Size39653
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 661383
Compressed Size39640
Max. Term Depth23
Asserts 731
Declared Functions2
Declared Constants6
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1065 or636 and25696 =26841
let9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 186.86600
CVC3-SMT-COMP-2011 default unsat ✅ 163.89200
CVC3-SMT-COMP-2012 default unsat ✅ 165.97900
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 10.36470
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 13.71580
CVC4-SMT-EVAL-2013 default unsat ✅ 6.83530
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 26.66170
MathSAT5-SMT-COMP-2010 default unsat ✅ 25.72830
MathSAT5-SMT-COMP-2011 default unsat ✅ 29.11640
MathSAT5-SMT-COMP-2012 default unsat ✅ 26.75450
test_pmathsat-SMT-COMP-2010 default unsat ✅ 18.18710
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 8.55772
OpenSMT-SMT-COMP-2011 default unsat ✅ 9.84273
OpenSMT-SMT-EVAL-2013 default unsat ✅ 351.81700
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 115.79900
SMTInterpol-SMT-COMP-2011 default unsat ✅ 536.65300
SMTInterpol-SMT-COMP-2012 default unsat ✅ 82.26410
veriT veriT-SMT-COMP-2010 default unsat ✅ 261.30100
veriT-SMT-COMP-2011 default unsat ✅ 6.42350
veriT-SMT-EVAL-2013 default unsat ✅ 1.04940
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 7.08835
Z3-SMT-COMP-2011 default unsat ✅ 5.05378
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 36.97260 36.96740
MathSAT MathSAT-5.2.12-Main default unsat ✅ 19.98440 19.97400
OpenSMT opensmt2-2014-06-14c default unsat ✅ 67.87200 67.89670
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 102.57000 106.82700
veriT veriT-smtcomp2014 default unsat ✅ 1.05962 1.04884
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 2.27118 2.26366
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 37.22150 37.22830
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 22.04560 22.05460
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 22.25600 22.26260
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 17.65750 17.66330
OpenSMT OpenSMT2 default unsat ✅ 181.33700 181.38000
OpenSMT2-parallel default unsat ✅ 20.29580 73.67580
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 100.30500 105.16300
SMT-RAT SMT-RAT-final default unsat ✅ 18.09650 18.10320
veriT veriT default unsat ✅ 0.96140 0.96085
Yices2 Yices default unsat ✅ 2.34143 2.34164
Z3 z3 4.4.0 default unsat ✅ 30.54200 30.55440
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 42.08050 42.10240
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 21.96880 21.98220
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 44.54720 44.57320
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 107.16600 120.10300
Toysmt toysmt default unknown ❌ 4.59569 4.59824
veriT veriT-dev default unsat ✅ 0.74473 0.74544
Yices2 Yices-2.4.2 default unsat ✅ 2.55402 2.55544
Z3 z3-4.4.1 default unsat ✅ 34.49350 34.51770
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 22.53730 22.53570
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 25.75440 25.75540
OpenSMT opensmt2-2017-06-04 default unsat ✅ 24.35610 24.35400
SMTInterpol SMTInterpol default unsat ✅ 113.19300 127.35500
veriT veriT-2017-06-17 default unsat ✅ 0.88446 0.88323
Yices2 Yices2-Main default unsat ✅ 1.98231 1.98121
Z3 z3-4.5.0 default unsat ✅ 34.51080 34.51170
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 42.68320 42.67800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 16.64450 16.63750
OpenSMT opensmt2_default unsat ✅ 25.52230 25.52310
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 296.06000 307.03900
veriT veriT_default unsat ✅ 0.71288 0.71299
Yices2 Yices 2.6.0_default unsat ✅ 1.77265 1.77250
Z3 z3-4.7.1_default unsat ✅ 27.27500 27.27090
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9530.39000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 31.23330 31.23400
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 23.79340 23.79240
Par4 Par4-wrapped-sq_default unsat ✅ 1.34706 2.57000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 95.83980 111.82900
veriT veriT-wrapped-sq_default unsat ✅ 0.67687 0.67712
Yices2 Yices 2.6.0_default unsat ✅ 1.35281 1.35270
Yices 2.6.2-wrapped-sq_default unsat ✅ 1.25791 1.25796
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 34.80320 34.79930
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 24.95690 24.95700
Par4 Par4-wrapped-sq_default unsat ✅ 1.88560 3.69000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 181.21000 241.52000
veriT veriT_default unsat ✅ 0.63146 0.63170
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.83428 1.83431
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 1.82534 1.82498
Z3 z3-4.8.11_default unsat ✅ 26.18000 26.17940
z3-4.8.8_default unsat ✅ 25.26320 25.26040
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 41.52560 41.51240
OpenSMT OpenSMT a78dcf01_default unsat ✅ 39.57490 39.56240
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 949.21300 1855.62000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 2.37067 2.36309
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 2.30947 2.30925
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 22.46956 22.36859
OpenSMT OpenSMT unsat ✅ 25.04914 24.94825
plat-smt plat-smt unsat ✅ 91.80270 91.69952
SMTInterpol SMTInterpol unsat ✅ 904.29614 2219.36253
Yices2 Yices2 unsat ✅ 1.21431 1.11319
Z3alpha Z3-alpha unsat ✅ 24.90956 24.79731