Tensorflow lite (or TFLM) for On-Device

[jb-ahn]

Hi,
I am interested in running the model in micro controller.
So, Is it possible that converting the model to Tensorflow Lite model and run with it (or with Tensorflow Lite for microcontroller)?
Thank you!

[csukuangfj]

Does Raspberry Pi4 belong to the category of micro controller?

[keveman]

We have run it on Raspberry Pi Zero 2W using the CTranslate2 framework. Please look at OpenNMT/CTranslate2#1808 for the PR. I'll be releasing a whl file soon built from this branch, specifically for RPi Zero 2W. If you want to run on a different microcontroller, please let me know which, and I can try to provide options.

[jb-ahn]

Hi @keveman ,
Thank you for your reply.
I am using HiFi4 of Cadence and TFLM.
Is there any hint to convert by tensorflow lite?

[HemanthSai7]

Hi, I too want to know about a TFLM model. Maybe we can work on this and come up with something.