Anomaly detection is a common and critical data mining task, it seeks to identify observations that differ significantly from others. Anomalies may indicate rare but significant events that require action. Market manipulation is an activity that undermines stock markets worldwide. This paper shares five large real-world, labelled data sets of anomalous stock market data where market manipulation is alleged to have occurred. Cutting edge deep learning techniques are then shown to successfully detect the anomalous periods. An LSTM based method with dynamic thresholding is particularly promising in this domain as it was able to identify contextual local anomalies in the data quickly, taking seconds to score two years of trading data for each stock, which can often be a challenge for deep learning approaches.