【HBase】HBase系列之HBase HA集群搭建

你的名字 2023-10-05 11:52 35阅读 0赞

上一篇：[HBase系列之HBase高级篇——协处理器ObServer及EndPoint开发][HBase_HBase_ObServer_EndPoint]

--------------------

#### 指路牌 ####

*   *  Hbase 架构 & HA
     *   *  架构
         *   *  宏观架构
             *  Table 和 Region
             *  RegionServer和Region
         *  HA构建
         *   *  主机和服务启动映射表
             *  主机信息
             *  集群搭建

### Hbase 架构 & HA ###

#### 架构 ####

##### 宏观架构 #####

![\[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-02GGnz33-1602991414866)(assets/image-20201012164840286.png)\]][img-02GGnz33-1602991414866_assets_image-20201012164840286.png]

##### Table 和 Region #####

![\[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-C3sB8YR9-1602991414867)(assets/image-20201012164113434.png)\]][img-C3sB8YR9-1602991414867_assets_image-20201012164113434.png]

##### RegionServer和Region #####

![\[外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-ZDIIIVyg-1602991414868)(assets/image-20201012163736273.png)\]][img-ZDIIIVyg-1602991414868_assets_image-20201012163736273.png]

推荐阅读：[http://www.blogjava.net/DLevin/archive/2015/08/22/426877.html][http_www.blogjava.net_DLevin_archive_2015_08_22_426877.html]

#### HA构建 ####

以下HBase 集群构建基础环境基于之前的Hadoop 集群之上构建，`CentOSX`代表所有主机同时执行相同命令

> 链接：[Hadoop生态系列之搭建HadoopHA集群][Hadoop_HadoopHA]

##### 主机和服务启动映射表 #####

<table> 
 <thead> 
  <tr> 
   <th>主机</th> 
   <th>服务</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>CentOSA</td> 
   <td>NameNode、zkfc、DataNode、JournalNode、Zookeeper、NodeManager</td> 
  </tr> 
  <tr> 
   <td>CentOSB</td> 
   <td>NameNode、zkfc、DataNode、JournalNode、Zookeeper、NodeManager、ResourceManager</td> 
  </tr> 
  <tr> 
   <td>CentOSC</td> 
   <td>DataNode、JournalNode、Zookeeper、NodeManager、ResourceManager</td> 
  </tr> 
 </tbody> 
</table>

##### 主机信息 #####

<table> 
 <thead> 
  <tr> 
   <th>主机名</th> 
   <th>IP信息</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>CentOSA</td> 
   <td>192.168.70.142</td> 
  </tr> 
  <tr> 
   <td>CentOSB</td> 
   <td>192.168.70.143</td> 
  </tr> 
  <tr> 
   <td>CentOSC</td> 
   <td>192.168.70.144</td> 
  </tr> 
 </tbody> 
</table>

##### 集群搭建 #####

1.  保证所有物理主机的系统时钟同步，否则集群构建容易失败

[root@CentOSX ~]# yum install -y ntp
    [root@CentOSX ~]# ntpdate time.apple.com
    [root@CentOSX ~]# clock -w

1.  确保HDFS正常运行，先启动ZK、然后启动HDFS

# 启动Zookeeper服务
    [root@CentOSX ~]# /usr/zookeeper-3.4.6/bin/zkServer.sh start zoo.cfg
    # 查看Zookeeper状态
    [root@CentOSX ~]# /usr/zookeeper-3.4.6/bin/zkServer.sh status zoo.cfg
    JMX enabled by default
    Using config: /usr/zookeeper-3.4.6/bin/../conf/zoo.cfg
    Mode: `follower|leader`
    # 查看Java进程
    [root@CentOSX ~]# jps
    5879 `QuorumPeerMain`
    7423 Jps
    # 启动HDFS服务
    [root@CentOSA|B|C ~]# start-dfs.sh

1.  搭建HBase集群

①解压`hbase-1.2.4-bin.tar.gz`至`/usr`目录下并配置`HBASE_HOME`环境变量

[root@CentOSX ~]# tar -zxf hbase-1.2.4-bin.tar.gz -C /usr/
    [root@CentOSX ~]# vi .bashrc
    HADOOP_HOME=/usr/hadoop-2.9.2
    HBASE_HOME=/usr/hbase-1.2.4
    JAVA_HOME=/usr/java/latest
    PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$HBASE_HOME/bin
    CLASSPATH=.
    export JAVA_HOME
    export CLASSPATH
    export PATH
    export HADOOP_HOME
    export HBASE_HOME
    
    # 使配置文件立即生效
    [root@CentOSX ~]# source .bashrc

②配置`hbase-site.xml`

[root@CentOSX ~]# vi /usr/hbase-1.2.4/conf/hbase-site.xml

<?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
    
    <configuration>
        <property>
            <name>hbase.rootdir</name>
            <value>hdfs://mycluster/hbase</value>
        </property>
        <property>
            <name>hbase.cluster.distributed</name>
            <value>true</value>
        </property>
        <property>
            <name>hbase.zookeeper.quorum</name>
            <value>CentOSA,CentOSB,CentOSC</value>
        </property>
        <property>
            <name>hbase.zookeeper.property.clientPort</name>
            <value>2181</value>
        </property>
    </configuration>

③ 修改`regionservers`

[root@CentOSX ~]# vi /usr/hbase-1.2.4/conf/regionservers

CentOSA
    CentOSB
    CentOSC

④修改`hbase-env.sh`将`# export HBASE_MANAGES_ZK=true`去除注释，改成`false`

⑤启动HBase集群

[root@CentOSB hbase-1.2.4]# ./bin/hbase-daemon.sh start master
    [root@CentOSC hbase-1.2.4]# ./bin/hbase-daemon.sh start master
    [root@CentOSX hbase-1.2.4]# ./bin/hbase-daemon.sh start regionserver

--------------------

下一篇：[HBase系列之HBase集成Phoenix及简单使用][HBase_HBase_Phoenix]

[HBase_HBase_ObServer_EndPoint]: https://blog.csdn.net/qq_44664231/article/details/109142882
[img-02GGnz33-1602991414866_assets_image-20201012164840286.png]: https://img-blog.csdnimg.cn/20201018113752329.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ0NjY0MjMx,size_16,color_FFFFFF,t_70#pic_center
[img-C3sB8YR9-1602991414867_assets_image-20201012164113434.png]: https://img-blog.csdnimg.cn/20201018113831300.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ0NjY0MjMx,size_16,color_FFFFFF,t_70#pic_center
[img-ZDIIIVyg-1602991414868_assets_image-20201012163736273.png]: https://img-blog.csdnimg.cn/20201018113902247.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3FxXzQ0NjY0MjMx,size_16,color_FFFFFF,t_70#pic_center
[http_www.blogjava.net_DLevin_archive_2015_08_22_426877.html]: http://www.blogjava.net/DLevin/archive/2015/08/22/426877.html
[Hadoop_HadoopHA]: https://blog.csdn.net/qq_44664231/article/details/108983379
[HBase_HBase_Phoenix]: https://blog.csdn.net/qq_44664231/article/details/109143347