Benchmark

non-incremental/QF_LIA/nec-smt/large/checkpass_pwd/prp-58-50.smt2

http://www.nec-labs.com/~fsoft/bench.html 
 The following changes have been made: 
 The logic is changed to QF_LIA. 
 The category is set as industrial. 
 The status (except 'large' cases) is assigned according to the 'outfile' on http://www.nec-labs.com/~fsoft/bench.html.
Benchmark
Size395071
Compressed Size83343
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 395063
Compressed Size83334
Max. Term Depth1970
Asserts 1
Declared Functions0
Declared Constants122
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10189 not2305 and4
=5023 let1768 +1288 -355
*107 <=503

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (4/6) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 54.19470
CVC4-SMT-EVAL-2013 default unsat ✅ 56.28260
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 5.86217
MathSAT5-SMT-COMP-2010 default unsat ✅ 9.23892
MathSAT5-SMT-COMP-2011 default unsat ✅ 21.08310
MathSAT5-SMT-COMP-2012 default unsat ✅ 5.98105
test_pmathsat-SMT-COMP-2010 default unsat ✅ 9.95588
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 25.85540
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default unknown ❌
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 72.08090
Z3-SMT-COMP-2011 default unsat ✅ 64.60820
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default unsat ✅ 20.67550 20.67390
MathSAT MathSAT-5.2.12-Main default unsat ✅ 5.95791 5.95110
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 45.89180 57.91820
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.01000
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 9.66859 9.66353
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 70.38090 70.39430
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 21.69710 21.70370
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 21.76490 21.77170
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 5.97989 5.98109
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 43.66290 59.22600
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
veriT veriT default unknown ❌ 2400.01000 2401.06000
Yices2 Yices default unsat ✅ 7.27151 7.27289
Z3 z3 4.4.0 default unsat ✅ 53.47550 53.49690
SMT-COMP 2016 0.38 (5/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 21.35650 21.37080
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 5.58909 5.59336
ProB ProB competition unknown ❌ 2400.11000 2401.35000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 30.46310 48.95620
SMT-RAT SMT-RAT default unknown ❌ 2400.04000 2401.46000
veriT veriT-dev default unknown ❌ 2400.04000 2401.40000
Yices2 Yices-2.4.2 default unsat ✅ 10.21170 10.21860
Z3 z3-4.4.1 default unsat ✅ 52.08380 52.11510
SMT-COMP 2017 0.29 (5/7) CVC4 CVC4-smtcomp2017-main default unsat ✅ 23.22200 23.22030
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 15.35010 15.34960
SMTInterpol SMTInterpol default unsat ✅ 29.93390 54.66280
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.03000 599.93900
veriT veriT-2017-06-17 default unknown ❌ 600.05300 599.96400
Yices2 Yices2-Main default unsat ✅ 6.92765 6.92604
Z3 z3-4.5.0 default unsat ✅ 85.97980 85.96990
SMT-COMP 2018 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unsat ✅ 98.69710 392.15000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 25.48110 25.47950
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 150.15500 150.15500
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 30.93270 47.30230
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.05000 1200.02000
veriT veriT_default unknown ❌ 1200.02000 1200.01000
Yices2 Yices 2.6.0_default unsat ✅ 9.32230 9.32200
Z3 z3-4.7.1_default unsat ✅ 105.18500 105.18700
SMT-COMP 2020 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 25.46050 25.45980
MathSAT MathSAT5_default.sh unsat ✅ 292.17300 292.10000
Par4 Par4-wrapped-sq_default unsat ✅ 8.55181 25.53000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 83.83760 104.76000
veriT veriT_default unknown ❌ 1200.06000 1199.84000
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 8.13084 8.13074
Z3 z3-4.8.8_default unsat ✅ 150.29600 150.29200
SMT-COMP 2021 0.29 (5/7) cvc5 cvc5-fixed_default unsat ✅ 281.03100 280.98800
MathSAT mathsat-5.6.6_default unsat ✅ 267.95500 267.91600
OpenSMT OpenSMT-fixed_default unsat ✅ 769.50300 769.50500
Par4 Par4-wrapped-sq_default unsat ✅ 8.98957 26.56000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 123.40000 155.78100
veriT veriT_default unknown ❌ 1200.03000 1199.87000
Z3 z3-4.8.11_default unknown ❌ 1200.10000 1199.89000
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 326.21700 326.16600
OpenSMT OpenSMT a78dcf01_default unsat ✅ 671.47900 671.40400
Par4 Par4-wrapped-sq_default unsat ✅ 8.13556 24.29000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 130.89800 197.72600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 7.39413 7.39372
Z3++ Z3++_sq_0526_default unsat ✅ 60.72930 60.72530
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 197.34541 197.24216
OpenSMT OpenSMT unsat ✅ 607.14787 606.80459
SMTInterpol SMTInterpol unsat ✅ 127.40663 190.47989
Yices2 Yices2 unsat ✅ 7.72309 7.61702
Z3alpha Z3-alpha unsat ✅ 200.61679 200.51101