RegionServer 由于 ZooKeeper session expired 而退出,头疼了很久,总结可能的原因:
1、网络不好
2、GC时间过长,程序暂停导致租约过期
3、CPU忙,维护zookeeper的线程不能及时得到执行机会(调度)
解决方案:
- RS配置zookeeper.session.timeout时间长点,我配置的180000
- RS配置hbase.regionserver.restart.on.zk.expire设置为true
参考下源代码
/**
* We register ourselves as a watcher on the master address ZNode. This is
* called by ZooKeeper when we get an event on that ZNode. When this method
* is called it means either our master has died, or a new one has come up.
* Either way we need to update our knowledge of the master.
* @param event WatchedEvent from ZooKeeper.
*/
public void process(WatchedEvent event) {
EventType type = event.getType();
KeeperState state = event.getState();
LOG.info("Got ZooKeeper event, state: " + state + ", type: " +
type + ", path: " + event.getPath());
// Ignore events if we're shutting down.
if (stopRequested.get()) {
LOG.debug("Ignoring ZooKeeper event while shutting down");
return;
}
if (state == KeeperState.Expired) {
LOG.error("ZooKeeper session expired");
boolean restart =
this.conf.getBoolean("hbase.regionserver.restart.on.zk.expire", false);
if (restart) {
restart();
} else {
abort();
}
} else if (type == EventType.NodeDeleted) {
watchMasterAddress();
} else if (type == EventType.NodeCreated) {
getMaster();
// ZooKeeper watches are one time only, so we need to re-register our watch.
watchMasterAddress();
}
}
可以看出来 hbase.regionserver.restart.on.zk.expire设置为true的话,会restart否则会abort,这样可以防止RS自杀。不过我看官方文档没有给出
hbase.regionserver.restart.on.zk.expire配置。
分享到:
相关推荐
hbase配置内置的zookeeper;hbase配置内置的zookeeper;
hadoop集群配置流程以及用到的配置文件,hadoop2.8.4、hbase2.1.0、zookeeper3.4.12
hadoop-2.7.5,hbase1.2.6.zookeeper.3.3.6完全分布式安装教程 hadoop-2.7.5,hbase1.2.6.zookeeper.3.3.6完全分布式安装教程 hadoop-2.7.5,hbase1.2.6.zookeeper.3.3.6完全分布式安装教程
hadoop2.7.1+hbase2.1.4+zookeeper3.6.2集合
Hadoop2.7.3+HBase1.2.5+ZooKeeper3.4.6 搭建分布式集群环境详解。 详细介绍了如何搭建分布式集群环境。
徐老师大数据培训Hadoop+HBase+ZooKeeper+Spark+Kafka+Scala+Ambari
本文档详细介绍了如何用ZooKeeper和Hadoop、HBase搭建分布式大数据分析平台。
HBase即Hadoop Database,是一个高可靠性、高性能、面向列、可伸缩的分布式存储系统,利用HBase技术可在普通的PC Server上搭建起大规模结构化...Google Bigtable利用 Chubby作为协同服务,HBase利用Zookeeper作为对应。
hadoop,hbase,zookeeper安装笔记hadoop,hbase,zookeeper安装笔记hadoop,hbase,zookeeper安装笔记
hbase和zookeeper的详细配置
Hadoop、HBase、Zookeeper安装部署
在Linux虚拟机下的Hadoop集群上配置和安装hbase和zookeeper,
hadoop、hbase、hive、zookeeper版本对应关系续(最新版)
是在我使用hadoop ,hbase ,hive以及zookeeper的过程中所遇到的一些相关问题和解决方法,希望能帮助到大家
分享一下Hadoop、HBase、Hive、Pig、Zookeeper相关资料。
NULL 博文链接:https://cctype.iteye.com/blog/2035320
数据仓库hadoop+zookeeper+hbase集群安装方法记录,自己搭建纯手写的记录。相关软件请自行下载
尚硅谷版本的视频笔记资源,留着自己备份 怕丢
Docker(Hadoop_3.3.1+HBase_2.4.16+Zookeeper_3.7.1+Hive_3.1.3 )配置文件 搭建集群环境
HBase配置