Overcomplete Dictionary Learning with Jacobi Atom Updates
Department of Automatic Control and Computers, University Politehnica of Bucharest, 313 Spl. Independentei, 060042 Bucharest, Romania
arXiv:1509.05054 [cs.CV], (16 Sep 2015)
@article{irofti2015overcomplete,
title={Overcomplete Dictionary Learning with Jacobi Atom Updates},
author={Irofti, Paul and Dumitrescu, Bogdan},
year={2015},
month={sep},
archivePrefix={"arXiv"},
primaryClass={cs.CV}
}
Dictionary learning for sparse representations is traditionally approached with sequential atom updates, in which an optimized atom is used immediately for the optimization of the next atoms. We propose instead a Jacobi version, in which groups of atoms are updated independently, in parallel. Extensive numerical evidence for sparse image representation shows that the parallel algorithms, especially when all atoms are updated simultaneously, give better dictionaries than their sequential counterparts.
September 24, 2015 by hgpu