Arbybear wrote: ↑03 Nov 2022, 00:55
I tried the demo out, it's very impressive. Theoretically could NVIDIA or AMD implement this in their graphics drivers right now to work in any current game? Or would a new API be required?
The game developer typically has to be involved.
So classically it would have to be either:
(A) Reprojection built into the game;
OR
(B) Reprojection APIs built into the OS/driver and the game using the API.
However...
Here's where a small amount of AI can be used to monitor the game initially and autoconfigure middle-layer reprojection unbeknowst to the game engine. In theory, a little bit of AI can automatically recognize the game content + mouse movements + keyboard movements, and auto-train the reprojection parameters:
1. Automatic recognition of game sensitivity
2. Automatic recognition of mouse sensitivity
3. Automatic recognition of the rotational origin of the GPU render (X,Y,Z coordinates that mouselook spins around).
4. Automatically program the reprojector
5. Recognition of Zbuffer/HUDs and avoiding reprojection artifacts on those.
It would only be initial training (e.g. first 5 seconds of game playing) to automatically program the reprojector for that specific game for that specific mouse settings for that specific GPU for that specific game, but it would make it work in existing games.
The problem is there would be no overscan-rendering, unless creative tricks are done that potentially games. Like expanding the game's FOV slightly (works best if supersampled-rendering), and reprojector will crop the FOV, and use only the boundaries as reprojection fill for edges whenever necessary. Many games lets you expand your FOV, and then the reprojection filter can decrease the FOV at the filter-injection stage.
So in theory a 3rd party filter-injection reprojection is theoretically possible. VorpX/ReShade/SweetFX/SpecialK could add reprojection, if it has a little bit of auto-train AI for the first few seconds of gameplay to sync everything up. There would be more artifacts than native game support, but this could be a great way to begin.