What is video frame interpolation (video frame Interpolation)?

Asked

Viewed 1,146 times

1

Reading some news I came across this: Transforming Standard Video Into Slow Motion with AI or NVIDIA AI creates slow motion videos without "recording more frames", where Nvidia used an algorithm that turns a normal video into slow motion, but smoothes the movements in the video by creating/predicting more frames (frames) with interpolation and artificial intelligence.

A videos of the results can be viewed on Youtube.

Then a doubt arose, which is the interpolation of video frames (video frame Interpolation)?

  • 1

    Face to thick and short way they take what would be 1 frame and turns into 2 or 3 or 30. The human eye can capture around 30 images per second, so most videos are recorded in 30fps, now imagine that you want to take a video that has 1 second, or 30 frames, and put in slow motion resulting in 2 seconds of video for example. Ai you have to take an original video of only 30fps and increase to 60fps, but without losing the transition fluidity of frames to not look like a "stop motion". Basically between one frame and another this algorithm should create other N frames

1 answer

3


In the context of the question, video frame Interpolation refers to the practice of generating intermediate frames between two frames reference.

Consider the animation below:

inserir a descrição da imagem aqui

It is composed of 3 frames, where the location of the black pixel creates an illusion of movement. However the effect is of low quality - you notice the 'leap' between positions.

The animation below has the same black pixels, but other frames are added containing pixels located in the interpolated positions of reference frames:

inserir a descrição da imagem aqui

The technique used by Nvidia in this case is an extremely sophisticated version of this practice - data two frames differences are analyzed and interpolated content is generated.

Browser other questions tagged

You are not signed in. Login or sign up in order to post.