In this paper, we discuss a general framework, namely Opportunistic Distributed Learning (ODL), which allows any node in the network to initiate a learning task while opportunistically leveraging local, unused distributed resources to collaboratively execute this task.