ITPub博客

首页 > 大数据 > Hadoop > CCAH-CCA-500-5题:How will the Fair Scheduler handle these two jobs?

CCAH-CCA-500-5题:How will the Fair Scheduler handle these two jobs?

原创 Hadoop 作者:hackeruncle 时间:2016-05-09 19:57:03 0 删除 编辑

5.How will the Fair Scheduler handle these two jobs?

You have a cluster running with the fair Scheduler enabled.
There are currently no jobs running on the cluster, and you submit a job A,
so that only job A is running on the cluster. A while later, you submit Job B.
Now Job A and Job B are running on the cluster at the same time. How will the Fair
Scheduler handle these two jobs?

A.When Job B gets submitted, it will get assigned tasks, while job A continues to run with fewer tasks.
B.When Job B gets submitted, Job A has to finish first, before job B can gets scheduled.
C.When Job A gets submitted, it doesn’t consumes all the task slots.
D.When Job A gets submitted, it consumes all the task slots.


问题:
       公平调度器对这两个jobs怎样处理?

解析: AD
       当只有一个job A在运行,这个job A会使用整个集群的 任务solts;
当另外一个job B被提交,那么任务solts会被释放分配给新的job B,
然而job A则会继续使用少些的任务solts,运行着。

 

详解Hadoop Slots的含义

http://www.07net01.com/2014/09/157715.html
http://net.pku.edu.cn/~course/cs402/2010/resource/2009/hadoop-0.20.0/docs/fair_scheduler.html

 

来自 “ ITPUB博客 ” ,链接:https://blog.itpub.net/30089851/viewspace-2096652/ ,如需转载,请注明出处,否则将追究法律责任。

请登录后发表评论 登录
全部评论
主要从事大数据平台产品的技术工作; 负责基于Spark、Flink生产开发及性能调优; 负责对公司的集群的部署、监控、调优和运营; 主导我司的数据平台0到1及实时中间件项目开发; 此外,精通Java、Shell、Python编程; 且荣获2016年IBM的Spark大赛全球第四名,中国区域第一名。

注册时间:2015-01-03

  • 博文量
    187
  • 访问量
    396942