Tuning Manifold Harmonics Filters
Department of Matematics, Pontifficia Universidade Catolica, Rio de Janeiro, Brazil
23rd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), 2010
@inproceedings{lewiner2010tuning,
title={Tuning manifold harmonics filters},
author={Lewiner, T. and Vieira, T. and Bordignon, A. and Cabral, A. and Marques, C. and Paix{~a}o, J. and Cust{‘o}dio, L. and Lage, M. and Andrade, M. and Nascimento, R. and others},
booktitle={Graphics, Patterns and Images (SIBGRAPI), 2010 23rd SIBGRAPI Conference on},
pages={110–117},
year={2010},
organization={IEEE}
}
There are several techniques for automatic music visualization, which are included with virtually any media player. The basic ingredient of those techniques is spectral analysis of the sound, used to automatically generate parameters for procedural image generation. However, only a few music visualizations rely on 3D models. This paper proposes to use spectral mesh processing techniques, namely manifold harmonics, to produce 3D music visualization. The images are generated from 3D models by deforming an initial shape, mapping the sound frequencies to the mesh harmonics. A concise representation of such frequency mapping is proposed to permit for an animated gallery interface with genetic reproduction. Such galleries allow the user to quickly navigate between visual effects. Rendering such animated galleries in real-time is a challenging task, since it requires computing and rendering the deformed shapes at a very high rate. This paper introduces a direct GPU implementation of manifold harmonics filters, which allows to display animated gallery.
June 7, 2011 by hgpu
