- We consider the problem of taking a video that is comprised of multiple periods of repetitive motion, and reordering the frames of the video into a single period, producing a detailed, single cycle video of motion. This problem is challenging, as such videos often contain noise, drift due to camera motion and from cycle to cycle, and irrelevant background motion/occlusions, and these factors can confound the relevant periodic motion we seek in the video. To address these issues in a simple and efficient manner, we introduce a tracking free Eulerian approach for synthesizing a single cycle of motion. Our approach is geometric: we treat each frame as a point in high-dimensional Euclidean space, and analyze the sliding window embedding formed by this sequence of points, which yields samples along a topological loop regardless of the type of periodic motion. We combine tools from topological data analysis and spectral geometric analysis to estimate the phase of each window, and we exploit the sliding window structure to robustly reorder frames. We show quantitative results that highlight the robustness of our technique to camera shake, noise, and occlusions, and qualitative results of single-cycle motion synthesis across a variety of scenarios.
- May 17 2018 cs.GR arXiv:1805.06019v1We present a new hierarchical based compression scheme for encoding light field images (LFI) suitable for interactive rendering. Our method (RLFC) exploits redundancies in the light field representation by constructing a hierarchical tree structure. The top-level (root) of the tree captures the common high-level details across the LFI, and other levels (children) of the tree capture specific low-level details of LFI. Our decompressing algorithm corresponds to a tree traversal operation, which gathers the values stored at different levels of the tree. Our approach provides random access with one level of indirection, parallel decoding, and enables fast interactive rendering. We have implemented our method for 4D two plane parameterized light fields. The compression rates vary from 0.1 - 3 bits per pixel (bpp), resulting in compression ratios of around 200:1 to 10:1 for PSNR quality of 35 to 50 dB. As compared to prior random access schemes, we observe 5-10X improvement in compression rate for similar PSNR quality. The decompression times for decoding the required blocks of LFI are approximately 2 - 5 microseconds and average time to compute a pixel in the new rendered view is 15 - 20 microseconds . Our overall scheme is simple to implement and involves memory operations, bit manipulations, and arithmetic operations.