Hadoop概述

叁歲伎倆 2023-10-08 15:18 27阅读 0赞

### Hadoop组成（面试重点） ###

![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center]

### HDFS架构概述 ###

> Hadoop Distributed File System, 简称HDFS, 是一个分布式文件系统。  
> ![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 1]  
> ![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 2]

### YARN架构概述 ###

> Yet Another Resource Negotiator, 简称YARN, 另一种资源协调者， 是Hadoop的资源管理器。  
> ![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 3]

### MapReduce架构概述 ###

> MapReduce将计算过程分为两个阶段：Map和Reduce  
> 1)Map阶段并行处理输入数据  
> 2)Reduce阶段对Map结果进行汇总

![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 4]

### 关系 ###

![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 5]

![在这里插入图片描述][watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 6]

[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center]: https://img-blog.csdnimg.cn/2a2874b7db624fb2bb10bdc3ccf5e1a5.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 1]: https://img-blog.csdnimg.cn/370a865298af4f4c8f6768f2fd810d09.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 2]: https://img-blog.csdnimg.cn/d4e8194b92b54b26a035663ab6cc03a9.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 3]: https://img-blog.csdnimg.cn/9c24342a663c4b29b40c8bb2aa71902a.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 4]: https://img-blog.csdnimg.cn/25550d9a7ef74d70bb4dccf10a584ad4.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 5]: https://img-blog.csdnimg.cn/09db3d6d898f4bc6b736357a04d52260.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center
[watermark_type_d3F5LXplbmhlaQ_shadow_50_text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA_size_20_color_FFFFFF_t_70_g_se_x_16_pic_center 6]: https://img-blog.csdnimg.cn/8e7aebb6d87d464c963f8a190de38c29.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5peg6IGK5aSn5L6gaGVsbG8gd29yZA==,size_20,color_FFFFFF,t_70,g_se,x_16#pic_center