CMOS Rolling shutter "Jello" effect problem

Martin68

Newbie Location: UK Joined: Mar 31, 2012 08:50 Messages: 46 Offline

Solved by

Jul 10, 2014 15:42

I have a Samsung Galaxy S5 smart phone which can shoot 4k video, but with no image stabilization.
With PD12 I have applied image Stabilization and although the shaky hand held footage is a lot more stable, It is still suffering from the bendy/stretchy wobble, the "jello" effect of cmos rolling shutter.

I know there are programs that can eliminate the Jello effect,(i think Sony Vegus has a plug in) but i'm wondering if PD 12 also has a rolling shutter elimination option?

If not, can someone please point me in the right direction to download a good video stabilizer with Jello correction for a low price or even free software if available?

BarryTheCrab

Senior Contributor Location: USA Joined: Nov 06, 2008 22:18 Messages: 6240 Offline

Jul 10, 2014 20:25

See PM HP Envy Phoenix/4thGen i7-4770(4@3.4GHz~turbo>3.9)
Nvidia GTX 960(4GB)/16GB DDR3/
Canon Vixia HV30/HF-M40/HF-M41/HF-G20/Olympus E-PL5.
Tape capture using 6 VCR, TBC-1000, Elite BVP4+, Sony D8 camcorder with TBC.
https://www.facebook.com/BarryAFTT

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 10, 2014 23:17

Martin68, if Barry's suggestion doesn't work out for any reason, there's a NewBlueFX plug-in called "Rolling Shutter" that does exactly what you're looking for.

It comes included in PD12 if you bought the Ultimate or above version. If not, NewBlue seems to put all their FX on sale in August - with a different effect or bundle on sale each day - and you might be able to pick that up for as little as $5 next month!

BarryTheCrab

Senior Contributor Location: USA Joined: Nov 06, 2008 22:18 Messages: 6240 Offline

Jul 11, 2014 06:17

My note to Martin just indicated I was hopeful one of my favorite vendors, Prodad, might be included in PD13, and they have such a plug-in related to their stabilizer. HP Envy Phoenix/4thGen i7-4770(4@3.4GHz~turbo>3.9)
Nvidia GTX 960(4GB)/16GB DDR3/
Canon Vixia HV30/HF-M40/HF-M41/HF-G20/Olympus E-PL5.
Tape capture using 6 VCR, TBC-1000, Elite BVP4+, Sony D8 camcorder with TBC.
https://www.facebook.com/BarryAFTT

Martin68

Newbie Location: UK Joined: Mar 31, 2012 08:50 Messages: 46 Offline

Jul 12, 2014 16:14

thanks Optodata for making me aware of the Newblue rolling shutter plugin, I have indeed got it as I have PD12 Ultra.

However

if anything, it makes the rolling shutter effect even worse!

no matter which way i slide the settings sliders, it's still wobbly as hell.
I also applied IS but even though my clip is less shaky, it's still suffering severely from skew wobble, so much so that you can see the frame edges go black if i leave the setting to "source"

Am i doing something wrong?

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 12, 2014 16:33

Could you attach the clip you're having trouble with?

If it's too large, maybe you could shoot a new clip that's just a couple seconds long while you're moving/panning the camera, then post that so other people can see what that looks like before and after IS and the rolling shutter fix.

YouTube/optodata

DS365 | Win11 Pro | Ryzen 9 3950X | RTX 4070 Ti | 32GB RAM | 10TB SSDs | 5K+4K HDR monitors

Canon Vixia GX10 (4K 60p) | HF G30 (HD 60p) | Yi Action+ 4K | 360Fly 4K 360°

Martin68

Newbie Location: UK Joined: Mar 31, 2012 08:50 Messages: 46 Offline

Jul 12, 2014 17:21

the clip is 50mb, and about 16 seconds long, i'll try to upload it, if i'm allowed to upload that much.
I have converted it from 4k to 1080 and have already applied image stabilization, but when i apply rolling shutter, the skew and wobble becomes worse and the sharpness of the video reduces to what looks more like standard definition.

Feel free to download it and try for yourself by applying rolling shutter, and if it works for you, let me know how you did it.

Filename	1080 IS applied.m2ts	Download
Description	severe rolling shutter
Filesize	51587 Kbytes
Downloaded:	251 time(s)

Martin68

Newbie Location: UK Joined: Mar 31, 2012 08:50 Messages: 46 Offline

Jul 12, 2014 17:38

here is the same clip with rolling shutter applied, see if you can do better with my first clip.

Filename	1080 IS and Rolling shutter applied.m2ts	Download
Description
Filesize	52462 Kbytes
Downloaded:	237 time(s)

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 12, 2014 17:48

I'm glad you were able to upload both clips. I'm downloading both and will let you know what I find.

When I reread your descriptions, I think I know how you might be able to improve your results. Since you're applying 3 different changes to try to get your final product, the order that you apply them is very important.

If you think carefully about what each step does, you'll understand that the rolling shutter is ONLY going to be effective on the raw video. That has to be the first step you take, otherwise the fix cannot compensate for the issues after the frame is rotated and cropped for IS, and it will also be much less effective at a scaled/reduced resolution.

See if you can get the "jello" effect removed as best you can from the raw clip first, then apply IS and finally reduce to 1080p. I'm betting that will give you much more satisfying results!

YouTube/optodata

DS365 | Win11 Pro | Ryzen 9 3950X | RTX 4070 Ti | 32GB RAM | 10TB SSDs | 5K+4K HDR monitors

Canon Vixia GX10 (4K 60p) | HF G30 (HD 60p) | Yi Action+ 4K | 360Fly 4K 360°

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 12, 2014 18:33

Martin, I was able to get the clip to be marginally more stable (eg noticeably less shaky to my eyes) by taking your IS Applied clip and setting the RS controls to the following settings:

Correction: 15

Quality: 150

Scanning Direction: Down *(probably not significant)

Border Fill: Zoom *(not significant)

I produced that file so it had all the RS corrections (along with your original IS), then I place that on the timeline and added the stabilizer set to 40 and the Fix rotational camera shake box checked

On your machine, I'd suggest trying the same steps. It may make a difference if the video is produced with the RS fix prior to trying the IS, because the two effects might interfere with each other. Test it both ways and see if one is obviously better, and if the results are similar, then use the approach that's quicker for you to finish.

I've attached the first 7-8 seconds of my attempted improvement, which is where most of the jello effect occurs. I do notice that the video is a little blurrier/less clearly defined in some areas compared to your clip, and I'm hoping that you'll see even more improvement and stability by running the RS on the raw clip first.

Filename	rs then is.m2ts	Download
Description	marginally improved clip
Filesize	22892 Kbytes
Downloaded:	222 time(s)

This message was edited 2 times. Last update was at Jul 12. 2014 18:35

Martin68

Newbie Location: UK Joined: Mar 31, 2012 08:50 Messages: 46 Offline

Jul 13, 2014 15:51

Thanks for trying optodata, it looks a bit better but i would have expected a much better result from PD
I have since tried as you suggested, by applying rolling shutter to the native 4k clip and the result is even worse, in fact it's more wobbly and skewey than the original.

I have downloaded a free trial of Muvee turbo video stabilizer, it worked 100 times better, but for some reason many clips won't play leaving a black screen, even though i'm feeding it mp4, but the ones that do play are very good indeed compared to PD with rolling shutter correction.
Unfortunatly my trial has since expired, so i'm wondering if you could try the software yourself to see if you get the same problem of many clips not playing? it's a free download here: http://www.muvee.com/products/turbo-video-stabilizer#multiple-clips
I don't want to buy it if it fails to play most of my clips, which it did in the trial period.

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 13, 2014 16:31

It sounds like you may have found the answer with the Muvee stabilizer. I have downloaded it but don't have time to experiment with it at the moment

When you say the stabilized clips won't play, are you talking about in PD or in Windows Media Player? Have you tried a free 3rd party player like VLC? Does it help (contrary to my advice yesterday) if you down-convert to 1080p first before running it through Muvee?

You can also try to run the stabilized clip through something like Format Factory or MultiAVCHD (both free) as they (and PD) can convert the video to another format that might play better on your system.

From where I sit, if you saw great improvement with that program and it only costs $20, I think it's a pretty easy decision to go for it and use Muvee's support resources to ensure that you get reliable stabilized videos.

YouTube/optodata

DS365 | Win11 Pro | Ryzen 9 3950X | RTX 4070 Ti | 32GB RAM | 10TB SSDs | 5K+4K HDR monitors

Canon Vixia GX10 (4K 60p) | HF G30 (HD 60p) | Yi Action+ 4K | 360Fly 4K 360°

Tontze

Newbie Joined: Mar 15, 2015 07:50 Messages: 8 Offline

Mar 21, 2015 11:45

Is there similar plugin in PD13 too ?

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Mar 21, 2015 12:19

Tomi, PD13 has a much more advanced stabilizer already built in. You can access it from the Fix/Enhance button above the timeline, then check the Stabilizer tab.

enhanced stabilizer