eclipse提交mr(操作hbase)出错
通过eclipse 远程提交mr(处理文件到hbase)到hadoop集群报错：
错误信息如下：
2015-04-19
11:31:46,800 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to
load native-hadoop library for your platform... using builtin-java
classes where applicable
2015-04-19 11:31:47,753 INFO
org.apache.hadoop.conf.Configuration.deprecation - session.id is
deprecated. Instead, use dfs.metrics.session-id
2015-04-19
11:31:47,753 INFO org.apache.hadoop.metrics.jvm.JvmMetrics -
Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-04-19
11:31:47,821 INFO org.apache.hadoop.conf.Configuration.deprecation -
mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-04-19
11:31:47,824 INFO org.apache.hadoop.conf.Configuration.deprecation -
mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
2015-04-19
11:31:47,824 INFO org.apache.hadoop.conf.Configuration.deprecation -
mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-04-19
11:31:47,824 INFO org.apache.hadoop.conf.Configuration.deprecation -
mapred.input.dir is deprecated. Instead, use
mapreduce.input.fileinputformat.inputdir
2015-04-19 11:31:47,824
INFO org.apache.hadoop.conf.Configuration.deprecation -
mapreduce.outputformat.class is deprecated. Instead, use
mapreduce.job.outputformat.class
2015-04-19 11:31:47,824 INFO
org.apache.hadoop.conf.Configuration.deprecation - mapred.map.tasks is
deprecated. Instead, use mapreduce.job.maps
2015-04-19 11:31:47,929
INFO org.apache.zookeeper.ZooKeeper - Client
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52
GMT
2015-04-19 11:31:47,929 INFO org.apache.zookeeper.ZooKeeper - Client environment:host.name=lyq
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.6.0_45
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Sun Microsystems Inc.
2015-04-19
11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client
environment:java.home=D:\Program Files\Java\jdk1.6.0_45\jre
2015-04-19
11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client
environment:java.class.path=E:\Work\workspace\.metadata\.plugins\org.apache.hadoop.eclipse\hadoop-conf-401984830001496437;E:\Work\workspace\hadoop_study\bin;E:\Work\workspace\hadoop_study\lib\activation-1.1.jar;E:\Work\workspace\hadoop_study\lib\aopalliance-1.0.jar;E:\Work\workspace\hadoop_study\lib\asm-3.2.jar;E:\Work\workspace\hadoop_study\lib\avro-1.7.4.jar;E:\Work\workspace\hadoop_study\lib\commons-beanutils-1.7.0.jar;E:\Work\workspace\hadoop_study\lib\commons-beanutils-core-1.8.0.jar;E:\Work\workspace\hadoop_study\lib\commons-cli-1.2.jar;E:\Work\workspace\hadoop_study\lib\commons-codec-1.4.jar;E:\Work\workspace\hadoop_study\lib\commons-collections-3.2.1.jar;E:\Work\workspace\hadoop_study\lib\commons-compress-1.4.1.jar;E:\Work\workspace\hadoop_study\lib\commons-configuration-1.6.jar;E:\Work\workspace\hadoop_study\lib\commons-daemon-1.0.13.jar;E:\Work\workspace\hadoop_study\lib\commons-digester-1.8.jar;E:\Work\workspace\hadoop_study\lib\commons-el-1.0.jar;E:\Work\workspace\hadoop_study\lib\commons-httpclient-3.1.jar;E:\Work\workspace\hadoop_study\lib\commons-io-2.1.jar;E:\Work\workspace\hadoop_study\lib\commons-lang-2.5.jar;E:\Work\workspace\hadoop_study\lib\commons-logging-1.1.1.jar;E:\Work\workspace\hadoop_study\lib\commons-math-2.1.jar;E:\Work\workspace\hadoop_study\lib\commons-net-3.1.jar;E:\Work\workspace\hadoop_study\lib\guava-11.0.2.jar;E:\Work\workspace\hadoop_study\lib\guice-3.0.jar;E:\Work\workspace\hadoop_study\lib\guice-servlet-3.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-annotations-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-archives-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-auth-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-common-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-datajoin-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-distcp-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-extras-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-gridmix-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-hdfs-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-hdfs-nfs-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-app-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-common-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-core-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-hs-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-hs-plugins-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-jobclient-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-client-shuffle-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-mapreduce-examples-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-nfs-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-rumen-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-streaming-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-api-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-applications-distributedshell-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-client-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-common-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-server-common-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-server-nodemanager-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-server-resourcemanager-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-server-web-proxy-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hadoop-yarn-site-2.2.0.jar;E:\Work\workspace\hadoop_study\lib\hamcrest-core-1.1.jar;E:\Work\workspace\hadoop_study\lib\jackson-core-asl-1.8.8.jar;E:\Work\workspace\hadoop_study\lib\jackson-jaxrs-1.8.8.jar;E:\Work\workspace\hadoop_study\lib\jackson-mapper-asl-1.8.8.jar;E:\Work\workspace\hadoop_study\lib\jackson-xc-1.8.8.jar;E:\Work\workspace\hadoop_study\lib\jasper-compiler-5.5.23.jar;E:\Work\workspace\hadoop_study\lib\jasper-runtime-5.5.23.jar;E:\Work\workspace\hadoop_study\lib\javax.inject-1.jar;E:\Work\workspace\hadoop_study\lib\jaxb-api-2.2.2.jar;E:\Work\workspace\hadoop_study\lib\jaxb-impl-2.2.3-1.jar;E:\Work\workspace\hadoop_study\lib\jersey-core-1.9.jar;E:\Work\workspace\hadoop_study\lib\jersey-guice-1.9.jar;E:\Work\workspace\hadoop_study\lib\jersey-json-1.9.jar;E:\Work\workspace\hadoop_study\lib\jersey-server-1.9.jar;E:\Work\workspace\hadoop_study\lib\jets3t-0.6.1.jar;E:\Work\workspace\hadoop_study\lib\jettison-1.1.jar;E:\Work\workspace\hadoop_study\lib\jetty-6.1.26.jar;E:\Work\workspace\hadoop_study\lib\jetty-util-6.1.26.jar;E:\Work\workspace\hadoop_study\lib\jsch-0.1.42.jar;E:\Work\workspace\hadoop_study\lib\jsp-api-2.1.jar;E:\Work\workspace\hadoop_study\lib\jsr305-1.3.9.jar;E:\Work\workspace\hadoop_study\lib\junit-4.10.jar;E:\Work\workspace\hadoop_study\lib\log4j-1.2.17.jar;E:\Work\workspace\hadoop_study\lib\mockito-all-1.8.5.jar;E:\Work\workspace\hadoop_study\lib\netty-3.6.2.Final.jar;E:\Work\workspace\hadoop_study\lib\paranamer-2.3.jar;E:\Work\workspace\hadoop_study\lib\protobuf-java-2.5.0.jar;E:\Work\workspace\hadoop_study\lib\servlet-api-2.5.jar;E:\Work\workspace\hadoop_study\lib\slf4j-api-1.7.5.jar;E:\Work\workspace\hadoop_study\lib\slf4j-log4j12-1.7.5.jar;E:\Work\workspace\hadoop_study\lib\snappy-java-1.0.4.1.jar;E:\Work\workspace\hadoop_study\lib\stax-api-1.0.1.jar;E:\Work\workspace\hadoop_study\lib\xmlenc-0.52.jar;E:\Work\workspace\hadoop_study\lib\xz-1.0.jar;E:\Work\workspace\hadoop_study\lib\zookeeper-3.4.5.jar;E:\Work\workspace\hadoop_study\lib\hbase-client-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-common-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-examples-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-hadoop-compat-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-hadoop2-compat-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-it-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-prefix-tree-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-protocol-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-server-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-shell-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-testing-util-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\hbase-thrift-0.96.2-hadoop2.jar;E:\Work\workspace\hadoop_study\lib\findbugs-annotations-1.3.9-1.jar;E:\Work\workspace\hadoop_study\lib\htrace-core-2.04.jar
2015-04-19
11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client
environment:java.library.path=D:\Program
Files\Java\jdk1.6.0_45\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:/Program
Files/Java/jdk1.6.0_45/bin/../jre/bin/server;D:/Program
Files/Java/jdk1.6.0_45/bin/../jre/bin;D:/Program
Files/Java/jdk1.6.0_45/bin/../jre/lib/amd64;D:\Program
Files\Java\jdk1.6.0_45\bin;C:\Program Files (x86)\NVIDIA
Corporation\PhysX\Common;C:\Program Files (x86)\Intel\iCLS
Client\;C:\Program Files\Intel\iCLS
Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program
Files\Intel\Intel(R) Management Engine Components\DAL;C:\Program
Files\Intel\Intel(R) Management Engine Components\IPT;C:\Program Files
(x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files
(x86)\Intel\Intel(R) Management Engine
Components\IPT;D:\App\hadoop-2.2.0\bin;D:\App\hadoop-2.2.0\sbin;D:\Program
Files\SSH\;.;;D:\App\eclipse;;.
2015-04-19 11:31:47,931 INFO
org.apache.zookeeper.ZooKeeper - Client
environment:java.io.tmpdir=C:\Users\liuyq\AppData\Local\Temp\
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=<NA>
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:os.name=Windows 7
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
//世爵平台www.shijueint.com
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:os.version=6.1
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:user.name=liuyq
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:user.home=C:\Users\liuyq
2015-04-19 11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Client environment:user.dir=E:\Work\workspace\hadoop_study
2015-04-19
11:31:47,931 INFO org.apache.zookeeper.ZooKeeper - Initiating client
connection, connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-0x6a510e39, quorum=localhost:2181, baseZNode=/hbase
2015-04-19
11:31:47,956 INFO
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Process
identifier=hconnection-0x6a510e39 connecting to ZooKeeper
ensemble=localhost:2181
2015-04-19 11:31:48,111 INFO
org.apache.zookeeper.ClientCnxn - Opening socket connection to server
0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate
using SASL (无法定位登录配置)
2015-04-19 11:31:48,114 ERROR
org.apache.zookeeper.ClientCnxnSocketNIO - Unable to open socket to
0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181
2015-04-19 11:31:48,149 WARN
org.apache.zookeeper.ClientCnxn - Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
at sun.nio.ch.Net.connect(Native Method)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:266)
at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:276)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:958)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
2015-04-19
11:31:48,559 INFO org.apache.zookeeper.ClientCnxn - Opening socket
connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to
authenticate using SASL (无法定位登录配置)
2015-04-19 11:31:48,564 WARN
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly
transient ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-04-19 11:31:48,564 INFO org.apache.hadoop.hbase.util.RetryCounter - Sleeping 1000ms before retry #0...
2015-04-19
11:31:49,561 WARN org.apache.zookeeper.ClientCnxn - Session 0x0 for
server null, unexpected error, closing socket connection and attempting
reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2015-04-19
11:31:49,662 WARN
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly
transient ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-04-19 11:31:49,662 INFO org.apache.hadoop.hbase.util.RetryCounter - Sleeping 2000ms before retry #1...
2015-04-19
11:31:50,665 INFO org.apache.zookeeper.ClientCnxn - Opening socket
connection to server 0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181. Will not
attempt to authenticate using SASL (无法定位登录配置)
2015-04-19 11:31:50,665
ERROR org.apache.zookeeper.ClientCnxnSocketNIO - Unable to open socket
to 0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181
2015-04-19 11:31:50,665 WARN
org.apache.zookeeper.ClientCnxn - Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
at sun.nio.ch.Net.connect(Native Method)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:266)
at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:276)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:958)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
2015-04-19
11:31:50,768 INFO org.apache.zookeeper.ClientCnxn - Opening socket
connection to server 127.0.0.1/127.0.0.1:2181. Will not attempt to
authenticate using SASL (无法定位登录配置)
2015-04-19 11:31:51,773 WARN
org.apache.zookeeper.ClientCnxn - Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2015-04-19
11:31:51,874 WARN
org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper - Possibly
transient ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
2015-04-19 11:31:51,874 INFO org.apache.hadoop.hbase.util.RetryCounter - Sleeping 4000ms before retry #2...
2015-04-19
11:31:52,874 INFO org.apache.zookeeper.ClientCnxn - Opening socket
connection to server 0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181. Will not
attempt to authenticate using SASL (无法定位登录配置)
2015-04-19 11:31:52,874
ERROR org.apache.zookeeper.ClientCnxnSocketNIO - Unable to open socket
to 0:0:0:0:0:0:0:1/0:0:0:0:0:0:0:1:2181
2015-04-19 11:31:52,874 WARN
org.apache.zookeeper.ClientCnxn - Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.SocketException: Address family not supported by protocol family: connect
at sun.nio.ch.Net.connect(Native Method)
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:532)
at org.apache.zookeeper.ClientCnxnSocketNIO.registerAndConnect(ClientCnxnSocketNIO.java:266)
at org.apache.zookeeper.ClientCnxnSocketNIO.connect(ClientCnxnSocketNIO.java:276)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:958)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
原因：linux集群 etc/hosts 首行没有配置 127.0.0.1 localhost
解决方法：配置etc/hosts， 重启hadoop、hbase集群即可。
1、java程序设计基础篇 复习笔记 第五单元
2、BZOJ-3237: [Ahoi2013]连通图
3、linux上设置环境变量每次需要source /etc/profile问题处理
4、Two Tables in ScrollView
5、抖音很火的存钱计划，让python告诉你总共可以存到多少钱！