Vint: Realtime Video Interpolation and CRT Emulation is now Available. What are your feature requests?

[William Sokol Erhard]

Do you have a screenshot you can repost here?

I'm afraid not, I just took notes of what the top voted features were. I didn't expect the old votes would get wiped but it seems obvious, in retrospect, that they would be.

[Chief Blur Buster]

Do you have a screenshot you can repost here?

I'm afraid not, I just took notes of what the top voted features were. I didn't expect the old votes would get wiped but it seems obvious, in retrospect, that they would be.

Apologies!
I have to admit I didn't know that editing a poll wipes out old votes.
It's not a forum feature I tend to be familiar with as I haven't used the polling feature often.

[William Sokol Erhard]

Sorry for missing these posts and not responding before. I somehow didn't see them until I went back to read.

Do you have any idea of the level of performance we can expect compare to nvidia ? I am only using Linux so i didn't buy your software until there is a Linux version, but it sounds very interesting.
I am asking myself if a 9070xt can do 4k 24->72hz.
Right now i am playing my video in 24hz and i use the smooth motion of my lg cx48. I fine tune the settings to have the best motion i can get without artifact, but what bother me is that 24hz playback in wayland is broken (random stuttering). The problem is known but no one care to correct this, most people just play their video are 60hz with interpolation...
So having a solution to run rife at 72hz + crt beam shader could be a good solution.

Hi atohmdiy,

I am afraid I can't really give you a good estimate of performance on a Radeon 9070xt because I don't have comparable test hardware. I will say that you should expect significantly worse performance for convolutional neural network acceleration like Vint's RIFE interpolation when compared to a similar level Nvidia GPU like a 5070 Ti.

Interpolation performance in Vint scales very linearly with resolution pixel count. I have scaling options that should allow you to get decent performance on almost any hardware if you scale down the processing resolution enough. I will say that 4k interpolation on a 9070xt isn't likely to go well but 1080p should probably be viable.

3x interpolation works great but you also have the option to interpolate 2.5x to a clean 60fps is you prefer or it works better connecting to your display though the LG OLEDs have perfectly adequate VRR so it shouldn't matter. The performance between 2.5x and 3x will be about the same.

I do not currently support simultaneous interpolation and BFI yet but there does seem to be a bit of interest and I don't expect it to be too difficult to implement so I will be working on it.

I hope this gives you a bit of a better idea of what to expect. Also, Steam of course offers a generous refund policy so you can try it and see if you like the performance.

Congrats on the release!

Thank you!

[atohmdiy]

Sorry for missing these posts and not responding before. I somehow didn't see them until I went back to read.

Do you have any idea of the level of performance we can expect compare to nvidia ? I am only using Linux so i didn't buy your software until there is a Linux version, but it sounds very interesting.
I am asking myself if a 9070xt can do 4k 24->72hz.
Right now i am playing my video in 24hz and i use the smooth motion of my lg cx48. I fine tune the settings to have the best motion i can get without artifact, but what bother me is that 24hz playback in wayland is broken (random stuttering). The problem is known but no one care to correct this, most people just play their video are 60hz with interpolation...
So having a solution to run rife at 72hz + crt beam shader could be a good solution.

Hi atohmdiy,

I am afraid I can't really give you a good estimate of performance on a Radeon 9070xt because I don't have comparable test hardware. I will say that you should expect significantly worse performance for convolutional neural network acceleration like Vint's RIFE interpolation when compared to a similar level Nvidia GPU like a 5070 Ti.

Interpolation performance in Vint scales very linearly with resolution pixel count. I have scaling options that should allow you to get decent performance on almost any hardware if you scale down the processing resolution enough. I will say that 4k interpolation on a 9070xt isn't likely to go well but 1080p should probably be viable.

3x interpolation works great but you also have the option to interpolate 2.5x to a clean 60fps is you prefer or it works better connecting to your display though the LG OLEDs have perfectly adequate VRR so it shouldn't matter. The performance between 2.5x and 3x will be about the same.

I do not currently support simultaneous interpolation and BFI yet but there does seem to be a bit of interest and I don't expect it to be too difficult to implement so I will be working on it.

I hope this gives you a bit of a better idea of what to expect. Also, Steam of course offers a generous refund policy so you can try it and see if you like the performance.

Congrats on the release!

Thank you!

I guess i'll have to wait a little a bit as the software and hardware stack seems to not be ready yet for what i want to do. On the hardware side AMD promesse new card with better AI performance, probably for the end of the year, hope the'll finally catch up with nvidia. But with this memory crisis i fear we'll get another period of extreme price...

In the software side i'll wait for a linux version. If you port your soft to linux i would suggest to make it easily usable with command line, i mostly use MPV that is called by kodi (external player function). I know people that use MPV use command line a lot in linux.

For the interpolation i understand you can use non integer value. But my understanding of the crt beam shader is that you basically simulated a CRT at a certain refresh frequency. For a 60fps video it's logical to simulated a 60hz crt with a 120hz+ display.
But like a 60hz crt, i saw some flicker, that seems to be even more visible than a real crt in my LG oled. So increase the simulated refresh to 72hz would probably be better.
It would mean 2 extra generated frame per original frame for RIFE, i doubt i'll ever need more than that really.

Also i don't try RIFE in real time but even if it's higher quality than my LG CX48 smooth motion, i assume it's the same issue a sin all AI generated extra frame. More you create additional image and more likely the risk to create artifact. I don't know if RIFE is good enough to not create artifact with a lot of extra frame, as some can run 4k@120 fps with it.

[mango87]

How clear is moving text when enabling interpolation? Does the text in this video, for example, maintain clarity in an individual frame: https://www.youtube.com/watch?v=vigX3H7WX5Q

[William Sokol Erhard]

How clear is moving text when enabling interpolation? Does the text in this video, for example, maintain clarity in an individual frame: https://www.youtube.com/watch?v=vigX3H7WX5Q

Hi mango 87,

I tried out this video you linked and interpolated to 120 and 240FPS to test.
Compared to the source 60FPS, the interpolated result had exponentially less blur and because the test pattern is quite simple, there were no interpolation artifacts to interfere with the clarity.

Especially with translation movement like this, the large moving text and the newspaper print was nearly identically clear between source and interpolated frames.

If you're interested in getting a better sense of interpolation clarity, I have a couple test videos posted or you can purchase Vint on Steam and see if it fits your standards. Steam has a generous refund policy.

Please let me know if that works for you.

[Chief Blur Buster]

I am being interviewed by a gaming magazine, and will be mentioning multiple indie software including "Vint CRT Emulation" or "Vint on Steam" in addition to other software available such as RetroArch and ShaderBeam. ShaderBeam got released quickly because I informed author of my upcoming magazine interview!

I've been trying to figure out a good google search for your app, so I've settled on those phrases.

If you have a new version pending, the interview will occur after CES, so if you publish by mid-January, I'll be able to talk it up a bit more.

[William Sokol Erhard]

I'm curious how Vint's interpolation would interact with an Nvidia pulsar monitor.

It seems like interpolation/framegen would combine really well with a VRR strobing system on a display.

I still think OLEDs and other emissive displays would be a far better overall experience over the LCDs of the pulsar displays but I want to see it in person.

[William Sokol Erhard]

I recently had an interview with Bob from RetroRGB about Vint, 24 FPS video, and display temporals.

phpBB [video]

Edit: fixed video embed.

[radeko]

I wonder how Vint with the Rife model would handle interpolation of this video to 120fps. This footage features screens with a large number of point-like LEDs. And LSFG interpolates them poorly. There are a lot of artifacts and little detail on these elements.

phpBB [video]