Benchmark

non-incremental/QF_UF/QG-classification/qg7/iso_brn_nogen_sk018.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size6013159
Compressed Size286810
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6013151
Compressed Size286814
Max. Term Depth30
Asserts 5051
Declared Functions5
Declared Constants11
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not5383 or1032 and242489 =248229
let6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Barcelogic Barcelogic 1.2 sat ✅ 9.70000
CVC3 CVC3 1.2 sat ✅ 29.00000
MathSAT MathSAT 4.0 sat ✅ 14.60000
Yices Yices 1.0 sat ✅ 4.80000
Yices 1.0.10 sat ✅ 3.20000
Z3 Z3 0.1 sat ✅ 3.10000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default sat ✅ 14.37950
CVC3-SMT-COMP-2011 default sat ✅ 13.98950
CVC3-SMT-COMP-2012 default sat ✅ 13.08530
CVC4 CVC4-SMT-COMP-2011 default sat ✅ 6.79091
CVC4-SMT-COMP-2012-Resubmission default sat ✅ 9.13943
CVC4-SMT-EVAL-2013 default sat ✅ 6.51268
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 2.27177
MathSAT5-SMT-COMP-2010 default sat ✅ 3.31291
MathSAT5-SMT-COMP-2011 default sat ✅ 3.08071
MathSAT5-SMT-COMP-2012 default sat ✅ 3.03161
test_pmathsat-SMT-COMP-2010 default sat ✅ 2.11195
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 2.80529
OpenSMT-SMT-COMP-2011 default sat ✅ 3.59763
OpenSMT-SMT-EVAL-2013 default sat ✅ 259.01200
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 7.48527
SMTInterpol-SMT-COMP-2011 default sat ✅ 8.61930
SMTInterpol-SMT-COMP-2012 default sat ✅ 6.86890
veriT veriT-SMT-COMP-2010 default sat ✅ 38.20040
veriT-SMT-COMP-2011 default sat ✅ 4.29739
veriT-SMT-EVAL-2013 default sat ✅ 2.44187
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 1.66651
Z3-SMT-COMP-2011 default sat ✅ 2.12449
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 6.35250 6.34503
MathSAT MathSAT-5.2.12-Main default sat ✅ 2.27556 2.25766
OpenSMT opensmt2-2014-06-14c default sat ✅ 4.74081 4.73228
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 7.88508 12.27910
veriT veriT-smtcomp2014 default sat ✅ 2.32337 2.31565
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.62259 0.61391
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.37232 1.36479
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 6.90599 6.90695
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 6.84667 6.84696
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.54650 1.54576
OpenSMT OpenSMT2 default sat ✅ 101.21000 101.24300
OpenSMT2-parallel default sat ✅ 11.66490 28.50470
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 7.13896 10.42840
SMT-RAT SMT-RAT-final default sat ✅ 13.12270 13.12500
veriT veriT default sat ✅ 2.38037 2.37964
Yices2 Yices default sat ✅ 0.62113 0.61991
Z3 z3 4.4.0 default sat ✅ 1.26424 1.26481
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 7.08945 7.09382
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.25551 1.25717
OpenSMT OpenSMT2-2016-05-12 default sat ✅ 4.30816 4.31054
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 7.32344 15.44380
Toysmt toysmt default sat ✅ 120.20000 120.27000
veriT veriT-dev default sat ✅ 1.12441 1.12519
Yices2 Yices-2.4.2 default sat ✅ 0.62190 0.62263
Z3 z3-4.4.1 default sat ✅ 1.39059 1.39310
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 7.49322 7.49141
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.31714 1.31766
OpenSMT opensmt2-2017-06-04 default sat ✅ 4.17809 4.17742
SMTInterpol SMTInterpol default sat ✅ 7.25521 18.31270
veriT veriT-2017-06-17 default sat ✅ 1.16931 1.16869
Yices2 Yices2-Main default sat ✅ 0.57813 0.57803
Z3 z3-4.5.0 default sat ✅ 1.38975 1.38868
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.81591 7.81554
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.42212 1.42302
OpenSMT opensmt2_default sat ✅ 11.18740 11.18720
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 9.31522 16.36890
veriT veriT_default sat ✅ 1.04263 1.04244
Yices2 Yices 2.6.0_default sat ✅ 0.94279 0.94269
Z3 z3-4.7.1_default sat ✅ 1.70290 1.70264
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1006.18000 3343.29000
CVC4 CVC4-sq-final_default sat ✅ 13.62370 13.62240
MathSAT MathSAT5_default.sh sat ✅ 1.42229 1.42222
OpenSMT OpenSMT_default sat ✅ 3.21615 3.21270
Par4 Par4-wrapped-sq_default sat ✅ 0.65628 1.24000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 8.88795 16.40690
veriT veriT_default sat ✅ 1.03733 1.03752
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.64730 0.64719
Z3 z3-4.8.8_default sat ✅ 1.44393 1.44373
SMT-COMP 2024 cvc5 cvc5 sat ✅ 2.74641 2.64687
OpenSMT OpenSMT sat ✅ 2.82666 2.72655
plat-smt plat-smt sat ✅ 1.96014 1.86012
SMTInterpol SMTInterpol sat ✅ 9.48493 18.83706
Yices2 Yices2 sat ✅ 0.70882 0.60827
Z3alpha Z3-alpha sat ✅ 1.84655 1.74678