Benchmark

non-incremental/QF_UF/PEQ/PEQ011_size8.smt2

CADE ATP System competition. See http://www.cs.miami.edu/~tptp/CASC
 for more information. 

This benchmark was obtained by trying to find a finite model of a first-order 
formula (Albert Oliveras).
Benchmark
Size67782
Compressed Size9363
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2005-07-12
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 67774
Compressed Size9439
Max. Term Depth31
Asserts 1
Declared Functions1
Declared Constants10
Declared Sorts 1
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not961 or1082 and1 =2129
distinct1 let24

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2006 0.86 (1/7) ARIO Ario 1.2 timeout ✅ 1207.90000
Barcelogic Barcelogic 1.1 timeout ✅ 1209.00000
Barcelogic 1.0 (2005 winner) timeout ✅ 1208.70000
CVC CVC timeout ✅ 1207.90000
CVC3 CVC3 unknown ❌ 315.70000
HTP HTP timeout ✅ 1208.00000
HTP patched (hors-concours) timeout ✅ 1208.70000
MathSAT MathSAT 3.4 timeout ✅ 1208.10000
Yices Yices 1.0 unsat ✅ 673.00000
SMT-COMP 2008 0.50 (3/6) Barcelogic Barcelogic 1.3 unsat ✅ 838.40000
CVC3 CVC3-1.5 unknown ❌ 1800.90000
MathSAT MathSAT-4.2 unknown ❌ 1801.00000
OpenSMT OpenSMT 0.1 unknown ❌ 1800.80000
Yices2 Yices2 (proto c) unsat ✅ 176.70000
Z3 Z3 0.1 unknown ❌ 1801.00000
Z3.2 unsat ✅ 1071.10000
SMT-COMP 2009 0.60 (2/5) CVC3 CVC3 2.0 unknown ❌ 900.00000
MathSAT MathSAT 4.3 unsat ✅ 839.30000
OpenSMT OpenSMT 0.2 unknown ❌ 900.00000
veriT veriT 200907 unknown ❌ 900.00000
Yices2 Yices 2 proto unsat ✅ 146.70000
Yices2 (proto c) unsat ✅ 178.10000
SMT-COMP 2010 0.75 (1/4) CVC3 CVC3 2.3 unknown ❌ 1200.10000
OpenSMT OpenSMT-1.0-alpha unknown ❌ 1200.00000
veriT veriT 201007 unknown ❌ 1200.00000
Yices2 Yices 2 proto unsat ✅ 167.00000
SMT-COMP 2011 0.38 (5/8) CVC3 CVC3 v2.4 unknown ❌ 1200.10000
CVC4 CVC4 1.0rc.2026 unsat ✅ 59.70000
MathSAT MathSAT 5 unsat ✅ 348.00000
MathSAT5 unsat ✅ 344.00000
OpenSMT opensmt unsat ✅ 380.20000
SMTInterpol SMTInterpol 2.0pre unknown ❌ 1200.10000
veriT veriT unknown ❌ 1200.00000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 523.70000
Z3 Z3 unsat ✅ 430.10000
SMT Evaluation 2013 0.14 (6/7) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 1.64572
CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 226.11400
MathSAT5-SMT-COMP-2010 default unsat ✅ 358.13200
MathSAT5-SMT-COMP-2011 default unsat ✅ 329.51200
MathSAT5-SMT-COMP-2012 default unsat ✅ 236.27000
test_pmathsat-SMT-COMP-2010 default unsat ✅ 374.97800
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 236.02700
OpenSMT-SMT-COMP-2011 default unsat ✅ 356.02000
OpenSMT-SMT-EVAL-2013 default unknown ❌
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 217.86300
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default unsat ✅ 225.71400
veriT veriT-SMT-COMP-2010 default unknown ❌
veriT-SMT-COMP-2011 default unsat ✅ 30.93670
veriT-SMT-EVAL-2013 default unsat ✅ 3.19556
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.13453
Z3-SMT-COMP-2011 default unsat ✅ 0.21119
SMT-COMP 2014 0.14 (6/7) CVC4 CVC4 f7118b2 default unknown ❌ 2399.02000 2400.01000
MathSAT MathSAT-5.2.12-Main default unsat ✅ 252.53800 252.61800
OpenSMT opensmt2-2014-06-14c default unsat ✅ 1113.21000 1113.65000
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 221.49300 226.22700
veriT veriT-smtcomp2014 default unsat ✅ 3.81404 3.80342
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.15038 0.13698
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 369.61100 369.69300
SMT-COMP 2015 0.25 (6/8) CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2401.21000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2401.03000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 232.16900 232.24900
OpenSMT OpenSMT2 default unsat ✅ 313.88200 313.94500
OpenSMT2-parallel default unsat ✅ 260.29300 1032.42000
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 206.14500 211.37500
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.83000
veriT veriT default unsat ✅ 0.41420 0.41294
Yices2 Yices default unsat ✅ 0.10890 0.10798
Z3 z3 4.4.0 default unsat ✅ 405.73100 405.91900
SMT-COMP 2016 0.25 (6/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.04000 2401.22000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 292.50500 292.65900
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 235.46400 235.59200
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 202.58300 211.16200
Toysmt toysmt default unknown ❌ 2400.06000 2401.44000
veriT veriT-dev default unsat ✅ 0.18867 0.18859
Yices2 Yices-2.4.2 default unsat ✅ 0.94273 0.94318
Z3 z3-4.4.1 default unsat ✅ 326.38500 326.55300
SMT-COMP 2017 0.14 (6/7) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03900 600.00800
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 258.89500 258.86100
OpenSMT opensmt2-2017-06-04 default unsat ✅ 270.44300 270.45200
SMTInterpol SMTInterpol default unsat ✅ 225.42200 233.16800
veriT veriT-2017-06-17 default unsat ✅ 0.54913 0.54611
Yices2 Yices2-Main default unsat ✅ 0.24897 0.24913
Z3 z3-4.5.0 default unsat ✅ 382.52200 382.49700
SMT-COMP 2018 0.14 (6/7) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.04000 1199.98000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 251.69000 251.66600
OpenSMT opensmt2_default unsat ✅ 262.23700 262.16500
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 216.16300 222.15200
veriT veriT_default unsat ✅ 1.41635 1.41651
Yices2 Yices 2.6.0_default unsat ✅ 0.11852 0.11843
Z3 z3-4.7.1_default unsat ✅ 399.22600 399.16500
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4756.09000
CVC4 CVC4-sq-final_default unsat ✅ 934.02900 933.93400
MathSAT MathSAT5_default.sh unsat ✅ 253.34500 253.33200
OpenSMT OpenSMT_default unsat ✅ 191.52400 191.50800
Par4 Par4-wrapped-sq_default unsat ✅ 0.12453 0.00660
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 270.95000 276.61600
veriT veriT_default unsat ✅ 1.20244 1.20234
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.11719 0.11710
Z3 z3-4.8.8_default unsat ✅ 395.78300 395.70500
SMT-COMP 2021 0.17 (5/6) MathSAT mathsat-5.6.6_default unsat ✅ 231.09600 231.07700
Par4 Par4-wrapped-sq_default unsat ✅ 0.10651 0.00684
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.11000 1843.00000
veriT veriT_default unsat ✅ 0.15413 0.15438
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.09670 0.09665
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.09758 0.09750
Z3 z3-4.8.11_default unsat ✅ 384.96800 384.90100
z3-4.8.8_default unsat ✅ 432.49700 432.50500
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 24.14940 24.14400
MathSAT MathSAT-5.6.8_default unsat ✅ 286.21400 286.16000
veriT veriT_default unsat ✅ 0.57764 0.57783
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11582 0.11575
Z3 z3-4.8.17_default unsat ✅ 362.34400 362.29400
z3-4.8.11_default unsat ✅ 383.44400 383.40300