Focusing on GaN-based light-emitting diode (LED) design optimization, this paper evaluates simulation-based machine learning approaches from a device physics point of view. Strategies are suggested for achieving more realistic results.