With the vigorous development of the electric vehicle (EV) industry, the demand for charging has surged. However, the relative lag in the construction of charging infrastructure has led to a series of problems for drivers, such as difficulty in finding available charging stations and long waiting times for charging. To address this, this paper proposes an EV charging guidance framework based on an Informer network and Multi-Agent Reinforcement Learning (MARL), aiming at achieving efficient EV charging guidance. Firstly, this paper regards charging stations as independent agents, integrating information from vehicles, charging stations, and traffic, transforming the multi-objective optimization problem of EV charging guidance into a multi-agent reinforcement learning task. Then, an Actor-Critic algorithm combined with the Informer is designed, utilizing the Informer in the Critic network to model the interactions between different charging stations, thereby reducing the complexity of policy learning and enhancing coordination among agents. Subsequently, after calculating the advantage function for the agents, the Actor network is updated to improve learning efficiency. The proposed algorithm was simulated and validated in two different EV charging scenarios. The simulation results show that compared with several state-of-the-art methods, our algorithm achieved the best results in multi-objective optimization, demonstrating its superiority and practicality of our proposed algorithm.