Cloud-Edge Computing Continuum (CEC) system, where edge and cloud nodes are seamlessly connected, is dedicated to handle substantial computational loads offloaded by end-users. These tasks can suffer from delays or be dropped entirely when deadlines are missed, particularly under fluctuating network conditions and resource limitations. The CEC is coupled with the need for hybrid task offloading, where the task placement decisions concern whether the tasks are processed locally, offloaded vertically to the cloud, or horizontally to interconnected edge servers. In this paper, we present a distributed hybrid task offloading scheme (HOODIE) designed to jointly optimize the tasks latency and drop rate, under dynamic CEC traffic. HOODIE employs a model-free deep reinforcement learning (DRL) framework, where distributed DRL agents at each edge server autonomously determine offloading decisions without global task distribution awareness. To further enhance the system pro-activity and learning stability, we incorporate techniques such as Long Short-term Memory (LSTM), Dueling deep Q-networks (DQN), and double-DQN. Extensive simulation results demonstrate that HOODIE effectively reduces task drop rates and average task processing delays, outperforming several baseline methods under changing CEC settings and dynamic conditions.

Current and upcoming data-intensive Mission Critical (MC) applications rely on high Quality of Service (QoS) requirements related to connectivity, latency and network reliability. Beyond 5G networks shall accommodate MC services that enable voice, data and video transfer in extreme circumstances, for instance in occurrence of network overloads or infrastructure failures. In this work, we describe the specifications of the architectural framework that enables the roll-out of MC services over 5G networks and beyond, considering recent technological advancements of cloud-native functionalities, network slicing and edge deployments. The network architecture and the deployment process is described in three practical scenarios, including a capacity increase in the service load that necessitates the scaling of the computational resources, the deployment of a dedicated network slice for accommodating the stringent requirement of a MC application and a service migration scenario at the edge to cope with critical failures and QoS degradation. Furthermore, we illustrate the implementation of a Machine Learning (ML) algorithm that is used for overload prediction, validating its ability to predict the capacity increase and notify the components responsible to trigger the appropriate actions, based on a real dataset. To this end, we mathematically define the overload detection problem, as well as generalized prediction tasks in emergency situations and examine the key parameters (proactiveness ability, loockback window, etc.) of the ML model, also comparing its predictions abilities (∼ 93% accuracy in overload detection) against multiple baseline classifiers. Finally, we demonstrate the flexibility of the ML model to achieve reliable predictions in scenarios with diverse requirements.

The energy consumed by buildings is expected to significantly rise in the upcoming years, necessitating intelligent Home Energy Management Systems (HEMS) that create comfortable conditions for their inhabitants, while also offering sustainable and cost-effective solutions. The building environment, however, includes multiple time-varying parameters that cannot be controlled, such as the output of renewable energy sources, the market-dependent electricity prices, the outdoor temperature, as well as the occupants' energy habits. To overcome these barriers, we propose a hybrid Machine Learning (ML) algorithm for smart HEMS control, leveraging the properties of a decision-making deep deterministic policy gradient model, enhanced by the predictive capabilities of long short-term memory networks. Hence, the proposed algorithm aims to achieve an optimal balance between energy cost and occupant comfort by continuously adjusting the energy provided to the heating, ventilation, and air conditioning system, as well as controlling the energy storage system of the smart home. The proposed hybrid method is validated with simulations using real-world data and compared against baseline approaches, showcasing its effectiveness to achieve an optimal trade-off between the indoor temperature deviation and the average energy cost.

In this study, we focus on an MCN where the direct links towards a shore BS are not available, due to excessive fading conditions. For this case, we use a UAV swarm to provide improved wireless connectivity, adopting non-orthogonal multiple access (NOMA) for high resource efficiency. In downlink communication, UAVs take into consideration the desired service rate and the channel quality of their links towards the maritime nodes. In the uplink, UAVs employ dynamic decoding ordering to enhance the performance of successive interference cancellation, avoiding fixed ordering of the maritime nodesâ\euro™ signals. Moreover, to ensure highly flexible UAV selection, UAVs have buffers to store data. Performance comparisons show that the UAV swarm-aided MCN enjoys increased average sum-rate by relying on multi-criteria-based interference cancellation and buffer-aided UAVs, over other benchmark schemes in the downlink and uplink.

Maritime transportation is vital for economic growth, since it is responsible for the vast majority of global trade. However, optimizing maritime transportation, focusing on certain performance metrics may lead to non-convex problems due to the large number and heterogeneity of network nodes and vessels. Furthermore, the harsh propagation environment, and the long propagation distances might be prohibitive for the implementation of conventional optimization. Machine learning (ML) represents a viable way towards complexity minimization but still, it might not be feasible to fully exploit its potential, since error-free feedback channels are usually assumed while the overall centralized processing delay from numerous distributed sources might render real-time deployment infeasible, due to stringent latency requirements. Meanwhile, security and privacy concerns constitute key driving factors for decentralized ML solutions, since data locality is vital to protect sensitive information. Taking into consideration all the above, this paper discusses feasibility issues, regarding the deployment of federated learning (FL) solutions in maritime environments, via the presentation and analysis of various use cases. Moreover, experimental results using datasets from an enterprise specializing in the maritime industry are provided, showing the superiority of FL over traditional ML approaches, in terms of accuracy and complexity. Finally, open issues that must be addressed to pave the way for the wide adoption of FL in maritime applications are discussed.