Real-time video processingSep 2015

What we do

Realtime HD video processing30 FPS33ms per frame5ms is ~15% of all available time

IOSHardware accelerated video recorder AVAssetWriter works with CVPixelBuffer.glReadPixels will help us!Wait, why there is only 10 FPSIt woks 9 ms at iPhone 5S almost 30% of available time!!!

Direct access to the texture data with some restrictions.HOWTO: http://allmybrain.com/2011/12/08/rendering-to-a-texture-with-ios-5-texture-cache-api/

3ms instead of 9ms at iPhone 5S3 times faster!

CVOpenGLESTextureCache

Couple of benchmarks

fullHDHDSD16x93 ms for HD6 ms for FullHD

AndroidThere is no TextureCache at the Android, but there is Android Graphic Buffer!

glReadPixels Summary for FullHDFastest glReadPixels iOS: 20.7 ms iPhone 5SFastest glReadPixelsAndroid: 11.5 ms Samsung S5(Adreno 330)Fastest TextureCache read(iOS): 5.4 ms iPhone 5SFastest GraphicBuffer read(Android): 8.8 ms Nexus 7(Adreno 320)Slowest glReadPixels: 106 ms Nexus 6(Adreno 420)Biggest difference: 106 vs 9.5 Nexus 6

THANK YOU