Hadoop: Job vs Application vs Task vs Task attempt

最新推荐文章于 2025-02-09 21:43:35 发布

ManBeCool

最新推荐文章于 2025-02-09 21:43:35 发布

阅读量1.1k

点赞数 2

文章标签： Hadoop

本文详细介绍了在Hadoop生态系统中,YARN如何管理和调度MapReduce任务。文章解释了应用程序、作业、任务及任务尝试之间的关系，并阐述了当任务失败时YARN如何重新启动任务以确保任务最终成功完成。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

In terms of YARN, the programs that are being run on a cluster are called applications. In terms of MapReduce they are called jobs. So, if you are running MapReduce on YARN, job and application are the same thing (if you take a close look, job ids and application ids are the same).

MapReduce job consists of several tasks (they could be either map or reduce tasks). If a task fails, it is launched again on another node. Those are task attempts.

Ref:Difference between job, application, task, task attempt logs in Hadoop, Oozie