Get M/R Job info from Job History Server

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Get M/R Job info from Job History Server

Mihir Monani
Hi,

How do i access MR Job Info (like total num of Map/Reduce, Avg Map/Reduce Time, Shuffle time etc) from Job History Server with JAVA Program ?

I was trying to use HistoryViewer.AnalyzedJob and HistoryViewer.SummarizedJob classes but HisotryViewer is marked as InterfaceAudience.Private. 

Is there any other way to get this info from Job History Server ?


--
Thanks
Mihir Monani
Reply | Threaded
Open this post in threaded view
|

Re: Get M/R Job info from Job History Server

Or Raz

If you are trying to use the Job History Server then I would suggest you follow the next two links on how to activate and enter the UI.
https://stackoverflow.com/questions/42884289/job-history-server-in-hadoop-2-7-1-is-not-working

https://stackoverflow.com/questions/50200130/hadoop-cant-access-tracking-url

 

On 2018/09/19 10:43:05, Mihir Monani <[hidden email]> wrote:

> Hi,>

>

> How do i access MR Job Info (like total num of Map/Reduce, Avg Map/Reduce>

> Time, Shuffle time etc) from Job History Server with JAVA Program ?>

>

> I was trying to use HistoryViewer.AnalyzedJob and HistoryViewer.SummarizedJob>

> classes but HisotryViewer is marked as InterfaceAudience.Private.>

>

> Is there any other way to get this info from Job History Server ?>

>

>

> -- >

> Thanks>

> Mihir Monani>

>

Sent from Mail for Windows 10