Network simulator (ns-3) is a reputed simulation platform for performance evaluation of cellular networks. In this work, we explore use of ns-3 for tracking of successful handovers (HO) and handover failures and consequent impact on 4G LTE network throughput. As cell sizes in networks scale down with each new generation, the increasing number of handovers and handover failures have significant impact. We begin by reviewing analytical models in the literature that aim to predict number of HO and HO failures in terms of HO control and network parameters. We initially conduct a suite of exhaustive validation studies of such analytical models, based on the simulation execution manager (SEM) for ns-3 for parallelization. Via this, we discover new causal relations relating HO failures and choice of HO control parameters on network throughput. Based on these initial results, we next evaluate the application of Gaussian process regression for prediction of instantaneous network throughput and bandit algorithms as an effective mechanism to optimize throughput over time.