博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
Hadoop TaskTracker无法启动
阅读量:5368 次
发布时间:2019-06-15

本文共 3307 字,大约阅读时间需要 11 分钟。

      今天启动hadoop机器,但是其中一个节点的TaskTracker始终启动不起来。中里面提到NameNode与DataNode的namespaceID 不同,于是我查看了两者的namespaceID,发现相同。我仔细看了一下如下日志:

2012-11-14 20:37:43,461 INFO org.apache.hadoop.mapred.TaskTracker: Resending 'status' to 'master' with reponseId '772012-11-14 20:37:44,463 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 0 time(s).2012-11-14 20:37:45,467 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 1 time(s).2012-11-14 20:37:46,471 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 2 time(s).2012-11-14 20:37:47,475 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 3 time(s).2012-11-14 20:37:48,480 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 4 time(s).2012-11-14 20:37:49,484 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 5 time(s).2012-11-14 20:37:50,488 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 6 time(s).2012-11-14 20:37:51,492 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 7 time(s).2012-11-14 20:37:52,496 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 8 time(s).2012-11-14 20:37:53,500 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: master/172.21.7.137:9001. Already tried 9 time(s).2012-11-14 20:37:53,501 ERROR org.apache.hadoop.mapred.TaskTracker: Caught exception: java.net.ConnectException: Call to master/172.21.7.137:9001 failed on connection exception: java.net.ConnectException: Connection refused    at org.apache.hadoop.ipc.Client.wrapException(Client.java:767)    at org.apache.hadoop.ipc.Client.call(Client.java:743)    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)    at org.apache.hadoop.mapred.$Proxy4.heartbeat(Unknown Source)    at org.apache.hadoop.mapred.TaskTracker.transmitHeartBeat(TaskTracker.java:1215)    at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1037)    at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1720)    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:2833)Caused by: java.net.ConnectException: Connection refused    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)    at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)    at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:304)    at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)    at org.apache.hadoop.ipc.Client.getConnection(Client.java:860)    at org.apache.hadoop.ipc.Client.call(Client.java:720)    ... 6 more

 发现TaskTracker一直Call to master/172.21.7.137:9001,说明TaskTracker一直尝试连接master节点。猜想可能:关闭Hadoop系统异常,TaskTracker未正常关闭。于是通过命令:ps -ef | grep java ,发现TaskTracker进程依然存在,于是通过命令:kill -9 TaskTracker的processId。重新启动Hadoop,TaskTracker启动成功。

转载于:https://www.cnblogs.com/clouder/archive/2012/11/14/2770574.html

你可能感兴趣的文章
adb
查看>>
如何让一个div的大小,从某一个特定值开始,随内容的增加而自动变化?
查看>>
P1977 出租车拼车(DP)
查看>>
iOS开发--完整项目
查看>>
我的博客园皮肤模板
查看>>
正则表达式
查看>>
java基础:不同进制的表现形式
查看>>
Base64转换为blob对象
查看>>
gulp自动化压缩合并、加版本号解决方案
查看>>
windows下面安装Python和pip教程
查看>>
Java 动态向 JTable 中添加数据
查看>>
平安科技移动开发二队技术周报(第九期)
查看>>
JS window.open()属性
查看>>
Oracle【二维表管理:约束】
查看>>
2017-2018-1 20155307 《信息安全系统设计基础》第5周学习总结
查看>>
微软职位内部推荐-Principal Dev Manager for Windows Phone Apps
查看>>
jquery改变元素属性值(转)
查看>>
《额尔古纳河右岸》读书笔记
查看>>
C#Virtual和Override的几种组合
查看>>
JavaScript总结之DOM基本操作(三)
查看>>