AUTHOREA
Log in
Sign Up
Browse Preprints
LOG IN
SIGN UP
Essential Site Maintenance
: Authorea-powered sites will be updated circa 15:00-17:00 Eastern on Tuesday 5 November.
There should be no interruption to normal services, but please contact us at
[email protected]
in case you face any issues.
Rollin Omari
Researcher at DSTG
Australia
Member of:
Australian National University
Public Documents
2
Relational and Analogical Reasoning with Spiking Neural Networks
Rollin Omari
and 3 more
June 12, 2024
Raven's Progressive Matrices (RPMs) have been widely used for measuring abstract reasoning and intelligence in humans. However for artificial learning systems, abstract reasoning remains a challenging problem. This paper investigates the potential of biologically inspired spiking neural networks in addressing this challenge. We focus on unsupervised learning since in most domains where human-competitive conceptual learning is important, unlabelled data is plentiful and the autonomous discovery and understanding of underlying patterns without explicit guidance is paramount. Our experiments show that the overall accuracy of our unsupervised networks significantly outperform some supervised methods. Our results also demonstrate that, unlike their non-spiking counterparts, spiking neural networks are able to extract and encode relational features without any explicit instruction, do not rely on labelled training data, and are able to simulate the human ability of navigating and deciphering complex data landscapes. Our results exhibit state-of-the-art performance for unsupervised learning on the RAVEN (67.0%) and I-RAVEN (40.3%) datasets, indicating that that spiking neural networks are well suited to unsupervised conceptual learning.
A Critical Analysis of Unsupervised Learning in the Context of Raven's Progressive Ma...
Rollin Omari
and 3 more
April 01, 2024
This paper undertakes a critical examination of unsupervised learning within the context of Raven's Progressive Matrices (RPMs). We trace the historical trajectory of computational models for RPMs, from early rule-based approaches to modern neural networks, and we focus on the innovative work of Zhuo et al. in introducing semi-supervised learning to RPMs. Our discussion highlights the nuances of unsupervised learning, emphasising the role of noisy labels as a form of guidance, albeit with a trade-off in precision compared to traditional supervised learning. In this paper, we recognise the challenge in formalising the distinction between supervised and unsupervised learning, but we underscore the importance of precision in communication and nomenclature, especially in regards to facilitating knowledge transfer and directing future research. We hope that this contribution enhances the discourse on unsupervised learning and offers valuable insights towards the challenges and opportunities in attaining human-level reasoning capabilities in machine learning and artificial intelligence.