This is part of coursework 687( RL) at UMass Amherst
This is the part of coursework. Here I have designed many MDPs, RL learning algorithms without using existing libraries.