Capture CMOS video with FPGA, encode and send over Ethernet

manpreet Best Answer 2 years ago

_x000D_ I have not seen any open source hardware h.264 encoders, but I was giving advice to someone who was moving some of the heavy computational parts of a software encoder into an FPGA. It might have been openh264. I would not recommend ffmpeg for this project, because it implements so many protocols. There are enough options just in h.264 without having to worry about other standards. As for container formats, MPEG4 boxes are pretty simple, so adding transport encapsulation should be pretty straightforward. I'm thinking of the Quicktime 4cc encapsulation. I would suggest MPEG DASH, because you can encapsulate each video frame into a separate box (a MOOF movie fragment). However, wrapping encoded data in containers is not computationally intensive. Here is some software that deals with that container format: https://gpac.wp.mines-telecom.fr/mp4box/dash/ Rather than implementing the entire encoder in hardware, you could focus on the computationally intensive parts, which you can find by profiling the software as it runs. The deblocking filter is one such function, and it is used both for encoding and decoding. Good luck with your project!