Skip to main content

Scaling up stochastic gradient descent for non-convex optimisation.

Mohamad, S., Alamri, H and Bouchachia, A, 2022. Scaling up stochastic gradient descent for non-convex optimisation. Machine Learning. (In Press)

Full text available as:

s10994-022-06243-3.pdf - Published Version
Available under License Creative Commons Attribution.


DOI: 10.1007/s10994-022-06243-3


Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions and large datasets. We address the bottleneck problem arising when using both shared and distributed memory. Typically, the former is bounded by limited computation resources and bandwidth whereas the latter suffers from communication overheads. We propose a unified distributed and parallel implementation of SGD (named DPSGD) that relies on both asynchronous distribution and lock-free parallelism. By combining two strategies into a unified framework, DPSGD is able to strike a better trade-off between local computation and communication. The convergence properties of DPSGD are studied for non-convex problems such as those arising in statistical modelling and machine learning. Our theoretical analysis shows that DPSGD leads to speed-up with respect to the number of cores and number of workers while guaranteeing an asymptotic convergence rate of O(1/T) given that the number of cores is bounded by T1 / 4 and the number of workers is bounded by T1 / 2 where T is the number of iterations. The potential gains that can be achieved by DPSGD are demonstrated empirically on a stochastic variational inference problem (Latent Dirichlet Allocation) and on a deep reinforcement learning (DRL) problem (advantage actor critic - A2C) resulting in two algorithms: DPSVI and HSA2C. Empirical results validate our theoretical findings. Comparative studies are conducted to show the performance of the proposed DPSGD against the state-of-the-art DRL algorithms.

Item Type:Article
Uncontrolled Keywords:Stochastic gradient descent; Large scale non-convex optimisation; Distributed and parallel computation; Variational inference; Deep reinforcement learning
Group:Faculty of Science & Technology
ID Code:37680
Deposited By: Symplectic RT2
Deposited On:19 Oct 2022 14:07
Last Modified:19 Oct 2022 14:07


Downloads per month over past year

More statistics for this item...
Repository Staff Only -