In particular, we can recover the convergence results in the unbiased stochastic gradient setting when the biased gradient gap is zero. Lastly, we provide empirical support for our theoretical ...