Cloudera CDH/CDP 및 Hadoop EcoSystem, Semantic IoT등의 개발/운영 기술을 정리합니다. gooper@gooper.com로 문의 주세요.

Hadoop ./hadoop-daemon.sh start namenode로 namenode기동시 EditLog의 custerId, namespaceId가 달라서 발생하는 오류 해결방법

총관리자 2016.09.24 11:28 조회 수 : 1285

./hadoop-daemon.sh start namenode로 namenode기동시 EditLog의 custerId, namespaceId가 달라서 오류가 발생하면

"bin/hadoop namenode -recover"를 실행하면 문제를 해결해준다.

recover를 실행하면 아래의 짊문을 하는데 s를 선택한다.

Enter 'c' to continue, skipping the bad section in the log

Enter 's' to stop reading the edit log here, abandoning any later edits

Enter 'q' to quit without saving

Enter 'a' to always select the first choice in the future without prompting. (c/s/q/a)

-------------------------오류내용-----------------

16/09/24 10:57:03 INFO namenode.FSImageFormatPBINode: Loading 1 INodes.

16/09/24 10:57:03 INFO namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.

16/09/24 10:57:03 INFO namenode.FSImage: Loaded image for txid 0 from /engine/bigdata/hadoop/dfs/namenode/current/fsimage_ 0000000000000000000

16/09/24 10:57:03 INFO namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@830730 f8 expecting start txid #1

16/09/24 10:57:03 INFO namenode.FSImage: Start loading edits file http://IUDGTMP03:8480/getJournal?jid=mycluster&segmentTx Id=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35, http://IUDGTMP04:8480/getJournal?jid=myc luster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35

16/09/24 10:57:03 INFO namenode.EditLogInputStream: Fast-forwarding stream 'http://IUDGTMP03:8480/getJournal?jid=mycluster &segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35, http://IUDGTMP04:8480/getJourn al?jid=mycluster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35' to transaction ID 1

16/09/24 10:57:03 ERROR namenode.EditLogInputStream: caught exception initializing http://IUDGTMP03:8480/getJournal?jid=my cluster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35

org.apache.hadoop.hdfs.server.namenode.TransferFsImage$HttpGetFailedException: Fetch of http://IUDGTMP03:8480/getJournal?j id=mycluster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35 failed with status code 403

Response message:

This node has namespaceId '671989181 and clusterId 'CID-8395f825-0009-4668-862b-3a9e8d184b54' but the requesting node expe cted '1812369513' and 'CID-732a108d-6a42-44e4-9b2a-313750cc4c35'

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream$URLLog$1.run(EditLogFileInputStream.java:468)

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream$URLLog$1.run(EditLogFileInputStream.java:456)

at java.security.AccessController.doPrivileged(AccessController.java:377)

at javax.security.auth.Subject.doAs(Subject.java:572)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)

at org.apache.hadoop.security.SecurityUtil.doAsUser(SecurityUtil.java:448)

at org.apache.hadoop.security.SecurityUtil.doAsCurrentUser(SecurityUtil.java:442)

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream$URLLog.getInputStream(EditLogFileInputStream.java :455)

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.init(EditLogFileInputStream.java:141)

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.nextOpImpl(EditLogFileInputStream.java:192)

at org.apache.hadoop.hdfs.server.namenode.EditLogFileInputStream.nextOp(EditLogFileInputStream.java:250)

at org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.readOp(EditLogInputStream.java:85)

at org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.skipUntil(EditLogInputStream.java:151)

at org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream.nextOp(RedundantEditLogInputStream.java:178)

at org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.readOp(EditLogInputStream.java:85)

at org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.skipUntil(EditLogInputStream.java:151)

at org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream.nextOp(RedundantEditLogInputStream.java:178)

at org.apache.hadoop.hdfs.server.namenode.EditLogInputStream.readOp(EditLogInputStream.java:85)

at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.loadEditRecords(FSEditLogLoader.java:190)

at org.apache.hadoop.hdfs.server.namenode.FSEditLogLoader.loadFSEdits(FSEditLogLoader.java:143)

at org.apache.hadoop.hdfs.server.namenode.FSImage.loadEdits(FSImage.java:837)

at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:692)

at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:294)

at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:975)

at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:681)

at org.apache.hadoop.hdfs.server.namenode.NameNode.doRecovery(NameNode.java:1382)

at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1472)

at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)

16/09/24 10:57:03 ERROR namenode.EditLogInputStream: Got error reading edit log input stream http://IUDGTMP03:8480/getJour nal?jid=mycluster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6a42-44e4-9b2a-313750cc4c35; failing over to edit log http://IUDGTMP04:8480/getJournal?jid=mycluster&segmentTxId=1&storageInfo=-63%3A1812369513%3A0%3ACID-732a108d-6 a42-44e4-9b2a-313750cc4c35

org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream$PrematureEOFException: got premature end-of-file at txi d 0; expected file to go up to 2

at org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream.nextOp(RedundantEditLogInputStream.java:194)