Hadoop Yarn配置多队列的容量调度器案例

野性酷女 2023-10-03 04:21 29阅读 0赞

### 1）在 capacity-scheduler.xml 中配置如下： ###

*  （1）修改如下配置

<property>
     <name>yarn.scheduler.capacity.root.queues</name>
     <value>default,hive</value>
     <description>
     The queues at the this level (root is the root queue).
     </description>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.default.capacity</name>
     <value>40</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.default.maximum-capacity</name>
     <value>60</value>
    </property>

*  （2）为新加队列添加必要属性：

<property>
     <name>yarn.scheduler.capacity.root.hive.capacity</name>
     <value>60</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.user-limit-factor</name>
     <value>1</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.maximum-capacity</name>
     <value>80</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.state</name>
     <value>RUNNING</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.acl_submit_applications</name>
     <value>*</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.acl_administer_queue</name>
     <value>*</value>
    </property>
    
    <property>
     
    <name>yarn.scheduler.capacity.root.hive.acl_application_max_priority</nam
    e>
     <value>*</value>
    </property>
     
    <property>
     <name>yarn.scheduler.capacity.root.hive.maximum-applicationlifetime</name>
     <value>-1</value>
    </property>
    
    <property>
     <name>yarn.scheduler.capacity.root.hive.default-applicationlifetime</name>
     <value>-1</value>
    </property>

### 2）分发配置文件 ###

### 3）重启 Yarn 或者执行 yarn rmadmin -refreshQueues 刷新队列，就可以看到两条队列： ###

[zxl@hadoop102 hadoop-3.1.3]$ yarn rmadmin -refreshQueues

![在这里插入图片描述][watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70]

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk_size_16_color_FFFFFF_t_70]: https://img-blog.csdnimg.cn/454dcc89b967464baafefdb053df1362.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2E3NzIzMDQ0MTk=,size_16,color_FFFFFF,t_70