The discontinuous reception mechanism is modeled as a single Markov decision process. The MDP is solved using value iteration and a method is proposed to deploy the optimal DRX timer in a heterogeneous network.