GARBAGE COLLECTOR

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

GARBAGE COLLECTOR

Sidharth Kumar
Hi Team,

How feasible will it be, if I configure CMS Garbage collector for Hadoop daemons and configure G1 for Map Reduce jobs which run for hours?

Thanks for your help ...!

--
Regards
Sidharth Kumar | Mob: +91 8197 555 599 | LinkedIn  
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: GARBAGE COLLECTOR

Harsh J-2
You can certainly configure it this way without any ill effects, but note that MR job tasks are typically short lived and GC isn't really a big issue for most of what it does.

On Mon, 19 Jun 2017 at 14:20 Sidharth Kumar <[hidden email]> wrote:
Hi Team,

How feasible will it be, if I configure CMS Garbage collector for Hadoop daemons and configure G1 for Map Reduce jobs which run for hours?

Thanks for your help ...!


--
Regards
Sidharth Kumar | Mob: <a href="tel:081975%2055599" value="+918197555599" target="_blank">+91 8197 555 599 | LinkedIn  
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: GARBAGE COLLECTOR

Sidharth Kumar
I am running a Map reduce job which run fine(without Out of Memory) with 8GB map and reduce memory but do have long GC pauses. Currently i am using default JVM. And as G1 is recommended when JVM size grow more than 4GB. I want to know if this will resolve the issue without impacting any other services or Non - Map reduce applications

On Mon, Jun 19, 2017 at 6:04 PM, Harsh J <[hidden email]> wrote:
You can certainly configure it this way without any ill effects, but note that MR job tasks are typically short lived and GC isn't really a big issue for most of what it does.

On Mon, 19 Jun 2017 at 14:20 Sidharth Kumar <[hidden email]> wrote:
Hi Team,

How feasible will it be, if I configure CMS Garbage collector for Hadoop daemons and configure G1 for Map Reduce jobs which run for hours?

Thanks for your help ...!


--
Regards
Sidharth Kumar | Mob: <a href="tel:081975%2055599" value="+918197555599" target="_blank">+91 8197 555 599 | LinkedIn  



--
Regards
Sidharth Kumar | Mob: +91 8197 555 599 | LinkedIn  
Loading...