Computer Graphics Forum.
Volume 40 (2021), Number 2, Proceedings of Eurographics 2021, Vienna, Austria.

M.Sc. Thesis of Rafael Lucena Germano.

Contents

We present a technique for real-time adjustment of spatial frequencies in images and videos. Our method allows for both decreasing and increasing of frequencies, and is orthogonal to image resizing. Thus, it can be used to automatically adjust spatial frequencies to preserve the appearance of structured patterns during image downscaling and upscaling. By pre-computing the image's space-frequency decomposition and its unwrapped phases, these operations can be performed in real time, thanks to our novel mathematical perspective on frequency manipulation of digital images: interpreting the problem through the theory of instantaneous frequencies and phase unwrapping. To make this possible, we introduce an algorithm for the simultaneous phase unwrapping of several unordered frequency components, which also deals with the frequency-sign ambiguity of real signals. As such, our method provides theoretical and practical improvements to the concept of spectral remapping, enabling real-time performance and improved color handling. We demonstrate its effectiveness on a large number of images subject to frequency adjustment. By providing real-time control over the spatial frequencies associated with structured patterns, our technique expands the range of creative and technical possibilities for image and video processing.

Paper

Full paper (58 MB, 15 pages)

M.Sc. Thesis of Rafael Lucena Germano

Source Code

https://github.com/rafaellg79/FrequencyAdjustment.jl

Citation

Rafael L. Germano, Manuel M. Oliveira and Eduardo S. L. Gastal. "Real-Time Frequency Adjustment of Images and Videos". Computer Graphics Forum. Volume 40 (2021), Number 2, Proceedings of Eurographics 2021, Vienna, Austria.

BibTeX

@article{GermanoOliveiraGastal2021,
author   = {Rafael L. Germano and Manuel M. Oliveira and Eduardo S. L. Gastal},
title    = {Real-Time Frequency Adjustment of Images and Videos},
journal  = {Computer Graphics Forum},
volume   = {40},
number   = {2},
pages    = {23-37},
doi      = {https://doi.org/10.1111/cgf.142612},
url      = {https://www.inf.ufrgs.br/~eslgastal/RealTimeFrequencyAdjustment/},
eprint   = {https://diglib.eg.org/handle/10.1111/cgf142612},
year     = {2021}
}
  

Keywords

Frequency Adjustment, Spectral Remapping, Image Downscaling, Antialiasing, Resampling, Signal Processing, Gabor Transform, Fourier Transform.

This work was sponsored by CNPq-Brazil (fellowships and grants 131731/2019-0, 436932/2018-0, 131102/2018-4, 312975/2018-0, 423673/2016-5), and financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.

Last updated: March 2022.