Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-540

Streaming should send keep-alive signals to Reporter

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None

    Description

      The goal is to avoid the 10-minutes Task timeout with certain usages of hadoopStreaming.

      This proposal does not introduce an artificial keep-alive heartbeat:
      it still requires the external Application to have activity.

      Streaming should set Reporter status in more places:

      1. output to side-effect files should (periodically) set reporter status.

      2. Application's stderr data should (periodically) set reporter status.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            michel_tourn Michel Tourn
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment