ML models on live video stream for production

Question

I was trying to run a deep learning model on a live video stream in the server (and then send that video back to client). I tried using aiortc for this but doesn't seem scalable. Does anyone know other ways?

tlack · Accepted Answer

You could try running the model in the browser with Tensorflow.js. I recently tried this for something like that and found the overall workflow much easier. TFJS tooling is pretty good.Before I had tried using custom setups with Janus in the loop and it was slow going. AioRTC flat out never worked for me.