We design an output-feedback optimal tracking controller for a class of nonlinear systems that possess full relative degree. The design procedure follows the standard LQT method using an approximate linear model of the system obtained by following the Koopman operator theory. We further identify the observables used for the Koopman method relying on output measurements only, leading to minimal data collection costs. We achieved this latter objective by realizing that output derivatives can be a good choice as observables, and hence, using high-gain observer to provide estimates of these derivatives. Overall, the proposed approach allows for solving the problem of optimal control of the considered class of nonlinear systems without the need for a prior knowledge of the system model. That is, this problem is solved and the controller is driven solely based on output measurement. We demonstrate the efficacy of the closed-loop system in controlling a power system with an infinite bus.