博客中的一些配置

心已赠人 2022-02-25 08:22 317阅读 0赞

公司电脑配置较低，使用伪集群模式，只用一台虚拟机hadoop101  
自己的的电脑还好，使用集群模式，使用hadoop102，hadoop103,hadoop104,hadoop105

## Hadoop集群配置 ##

![集群配置][5ca3370ce4b035b243bfa481.png_1554200595719]

<table> 
 <thead> 
  <tr> 
   <th></th> 
   <th>hadoop101 <br>单节点测试</th> 
   <th>hadoop102</th> 
   <th>hadoop103</th> 
   <th>hadoop104</th> 
   <th>hadoop105</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>HDFS</td> 
   <td>NameNode <br>DataNode</td> 
   <td>NameNode <br>DataNode</td> 
   <td>DataNode</td> 
   <td>SecondaryNameNode<br> DataNode</td> 
   <td>DataNode</td> 
  </tr> 
  <tr> 
   <td>YARN</td> 
   <td>ResourceManager<br>NodeManager</td> 
   <td>NodeManager</td> 
   <td>ResourceManager<br> NodeManager</td> 
   <td>NodeManager</td> 
   <td>NodeManager</td> 
  </tr> 
 </tbody> 
</table>

ip地址如下

192.168.1.100    hadoop100  ##模板
    192.168.1.101    hadoop101  ##单节点测试
    192.168.1.102    hadoop102  ##集群 
    192.168.1.103    hadoop103  ##集群 
    192.168.1.104    hadoop104  ##集群 
    192.168.1.105    hadoop105  ##集群

## 软件版本 ##

<table> 
 <thead> 
  <tr> 
   <th>软件</th> 
   <th>版本</th> 
   <th>路径</th> 
  </tr> 
 </thead> 
 <tbody> 
  <tr> 
   <td>java</td> 
   <td>1.8.0_144</td> 
   <td>/opt/module/jdk1.8.0_144</td> 
  </tr> 
  <tr> 
   <td>hadoop</td> 
   <td>2.7.2</td> 
   <td>/opt/module/hadoop-2.7.2</td> 
  </tr> 
  <tr> 
   <td>hive</td> 
   <td>1.2.1</td> 
   <td>/opt/module/hive-1.2.1</td> 
  </tr> 
  <tr> 
   <td>zookeeper</td> 
   <td>3.4.0</td> 
   <td>/opt/module/zookeeper-3.4.10</td> 
  </tr> 
 </tbody> 
</table>

[core-default.xml][]  
[hdfs-default.xml][]  
[mapred-default.xml][]  
[yarn-default.xml][]

[5ca3370ce4b035b243bfa481.png_1554200595719]: /images/20220225/ca06f0268013421a92c6a33387a267c8.png
[core-default.xml]: https://pan.yljphp.com/index.php?share/file&sid=gusvFmU3&user=1&path=/core-default.xml#
[hdfs-default.xml]: https://pan.yljphp.com/index.php?share/file&sid=gusvFmU3&user=1&path=/hdfs-default.xml#
[mapred-default.xml]: https://pan.yljphp.com/index.php?share/file&sid=gusvFmU3&user=1&path=/mapred-default.xml#
[yarn-default.xml]: https://pan.yljphp.com/index.php?share/file&sid=gusvFmU3&user=1&path=/yarn-default.xml#