How Useful YARN Placement Constraint for MapReduce Jobs

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

How Useful YARN Placement Constraint for MapReduce Jobs

Prabhu Josephraj
Hi,

      Was thinking on supporting YARN Placement Constraint for MapReduce Applications, but want to check with you on how useful it will be?. Mappers usually runs on Data Local machine and so won't need but Reducers can gain by distributing the reducers to different machine using Anti Affinity. And also by having Affinity to say HRegionServer Machine in case of writing output to Hbase.

Thanks,
Prabhu Joseph