Saturday, April 5, 2014

Upgrade from CDH5 beta2 to CDH5 GA


Trouble shooting by upgrading from CDH5 b2 to CDH 5.0.0 GA


if HDFS service can not be started, error message in Cloudera Manager looks like:

java.io.IOException:

File system image contains an old layout version -51.

An upgrade to version -55 is required.

Please restart NameNode with the "-rollingUpgrade started" option if a rolling upgraded is already started; or restart NameNode with the "UPGRADE" to start a new upgrade.

try to upgrade namenode manually with this command:

sudo -u hdfs hdfs --config /var/run/cloudera-scm-agent/process/XXX-hdfs-NAMENODE namenode -upgrade

(the "XXX" in XXX-hdfs-NAMENODE is the process_id, try to find yours in folder /var/run/cloudera-scm-agent/process/)


if there is warning shows that the upgrade is not finalized, try:

sudo -u hdfs hdfs dfsadmin -finalizeUpgrade

2 comments:

  1. For My Case, upgrading to CDH 5.2.0, resolve the issue from Cloudera Manager as below:
    - CM > HDFS > Action > Stop
    - CM > HDFS > Action > Upgrade HDFS Metadata

    ReplyDelete
  2. @obaid you are right, it worked also for me

    ReplyDelete

© Chutium / Teng Qiu @ ABC Netz Group