How to get frame data in AppRTC iOS app for video modifications?
<p>I am currently trying to make some modifications to the incoming WebRTC video stream in the <a href="https://github.com/Mahabali/Apprtc-swift" rel="noreferrer">AppRTC app for iOS in Swift</a> (which in turn is based on <a href="https://github.com/ISBX/apprtc-ios/" rel="noreferrer">this</a> Objective-C version). To do so, I need access to the data which is stored in the frame objects of class RTCI420Frame (which is a basic class for the Objective-C implementation of <a href="https://github.com/js-platform/libwebrtc" rel="noreferrer">libWebRTC</a>). In particular, I need an array of bytes: <strong>[UInt8]</strong> and <strong>Size</strong> of the frames. This data is to be used for further processing &amp; addition of some filters.</p>

<p>The problem is, all the operations on RTCVideoTrack / RTCEAGLVideoView are done under the hood of pre-compiled <strong>libWebRTC.a</strong>, it is compiled from the official WebRTC repository linked above and it's fairly complicated to get a custom build of it, so I'd prefer to go with the build available in the example iOS project; in my understanding it's supposed to have all the available functionality in it.</p>

<p>I was looking into RTCVideoChatViewController class and in particular, <strong>remoteView</strong> / <strong>remoteVideoTrack</strong>, but had no success in accessing the frames themselves, spent a lot of time researching the libWebRTC sources in official repo but still can't wrap my head around the problem of accessing the frames data for own manipulations with it. Would be glad for any help!</p>