Efficient data structures for piecewise-smooth video processing