YARN SLS improving ideas

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

YARN SLS improving ideas

Sichen Zhao
Hi,
I am a developer from AliBaBa China, i recently used SLS for scheduling simulation, SLS currently supports multidimensional resource input(CPU, mem , other resources: disk). But SLS can't take scheduling request, which is currently widely used in YARN, as input, so Placement Constraints and attributes are not supported.

So what i wanna improve the SLS: Add scheduling emulation for scheduling request resource format.

The specific work is as follows:
1. Add input support for the scheduling request format.
2. Add support for scheduling request resource format in NMSim.
3. Adding scheduling request support for the Capacity Scheduler(maybe it is already done in current version).

What do you think about my ideas?


Best Regards
Sichen Zhao

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: YARN SLS improving ideas

Wangda Tan
+1, I think you should go ahead, file JIRA and work on that if you have interests :) 

Thanks,
Wangda

On Thu, Aug 9, 2018 at 6:22 AM Sichen Zhao <[hidden email]> wrote:
Hi,
I am a developer from AliBaBa China, i recently used SLS for scheduling simulation, SLS currently supports multidimensional resource input(CPU, mem , other resources: disk). But SLS can't take scheduling request, which is currently widely used in YARN, as input, so Placement Constraints and attributes are not supported.

So what i wanna improve the SLS: Add scheduling emulation for scheduling request resource format.

The specific work is as follows:
1. Add input support for the scheduling request format.
2. Add support for scheduling request resource format in NMSim.
3. Adding scheduling request support for the Capacity Scheduler(maybe it is already done in current version).

What do you think about my ideas?


Best Regards
Sichen Zhao

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]