Upscale and interpolate 4K UHD 50FPS with AI

[LazyPooky]

I decided to create a part of the episode with a new AI model, upscaling to 4K UHD and true 50 fps, although you can watch in 1080p50 too.

It feels like it has more depth with this framerate.

[chuft]

I don't own a 4K device, but the 1080p looks quite nice.

[boredjedi]

I decided to create a part of the episode with a new AI model, upscaling to 4K UHD and true 50 fps, although you can watch in 1080p50 too.

It feels like it has more depth with this framerate.

Looks very crisp at 1080p50. Will try it on the 4k tv. Steph's vocal sync is a bit off at 0:35

[LazyPooky]

Looks very crisp at 1080p50. Will try it on the 4k tv. Steph's vocal sync is a bit off at 0:35

It did a good thing upscaling with the new IRIS (Proteus-4) model. The interpolation - extra scenes between the original - went well too, except during the scene changes. The work around is now to delete the two frames in each scene change and replace those with the frames from the original or from the simple 50fps converted file (recommend). For an episode, that's a lot of work, knowing how many scene changes there are.

[chuft]

What do you mean

The interpolation - extra scenes between the original

What extra scenes? I thought you just upscaled it.

[LazyPooky]

What do you mean



What extra scenes? I thought you just upscaled it.

I did both upscale and interpolation. Now I found a way to process the 'interpolation bug' automatically (saves me so much manual time) so I take care of that first, and then upscale.

Interpolation automated work around:
I convert to fake-50fps with ffmpeg (causing a lot of double frames), split that video in sections with scenedetect and interpolate/fix the double frames of the sections with AI to true 50fps. I create TIFF frames (pictures) of the original 50fps and then the interpolated 50fps, with ffmpeg overwriting, so that I have always the correct number of TIFF frames. Then TIFF to video and it's done.

Each manual step takes a few seconds/minutes.

[LazyPooky]

The interpolation worked quite well with the work-around steps, although I need to add some additional (minor) manual steps that I haven't thought of before. Some scenes don't look so well done. What I also noticed is that the quick-blurry scene transitions are weirdly sharpen. [video later].

[LazyPooky]

I have a link to the first true 50 fps try of the first full episode.

https://www.mediafire.com/folder/zrr.../lazytown50fps

boredjedi It should work now. The episode-file was probably flagged for copyright. It's now packed in a rar-file , encrypted with pass: bingbang

[boredjedi]

Downloading now. Weird that it wanted you to log in for copyright flag.

[boredjedi]

Looks good thanks!