Skip to main content

Hybrid SOM based cross-modal retrieval exploiting Hebbian learning.

Kaur, P., Malhi, A. and Pannu, H.S., 2022. Hybrid SOM based cross-modal retrieval exploiting Hebbian learning. Knowledge-Based Systems, 239 (March), 108014.

Full text available as:

PhD Knowledge (1).pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.


DOI: 10.1016/j.knosys.2021.108014


Lately, cross-modal retrieval has attained plenty of attention due to enormous multi-modal data generation every day in the form of audio, video, image, and text. One vital requirement of cross-modal retrieval is to reduce the heterogeneity gap among various modalities so that one modality's results can be efficiently retrieved from the other. So, a novel unsupervised cross-modal retrieval framework based on associative learning has been proposed in this paper where two traditional SOMs are trained separately for images and collateral text and then they are associated together using the Hebbian learning network to facilitate the cross-modal retrieval process. Experimental outcomes on a popular Wikipedia dataset demonstrate that the presented technique outshines various existing state-of-the-art approaches.

Item Type:Article
Uncontrolled Keywords:Self organizing maps; Cross-modal retrieval; Hebbian learning; Zernike moments; Machine learning
Group:Faculty of Science & Technology
ID Code:36518
Deposited By: Symplectic RT2
Deposited On:17 Jan 2022 15:10
Last Modified:24 Dec 2022 01:08


Downloads per month over past year

More statistics for this item...
Repository Staff Only -