A plate, a scale, and a model that reads both
Mid-day meal programs feed millions of children with almost nothing measured. We built a vision system that turns one kiosk photo into a verified record: which dishes were served, how many grams were on the scale, and the nutrition that reached that child.
- Training data labelled by an ensemble of vision-language models, then corrected and verified by people before any round of training
- Embedded architectures trained and compared head to head — EfficientNet and MobileNetV4 classifiers, plus DINOv2 self-supervised features — to find what holds accuracy at the size the device allows
- Fine-tuned on real program photography, iterating through successive QLoRA rounds against a held-out evaluation set
- Built seven-segment OCR to read the weighing-scale display from the same frame — no second device, no manual entry
- Nutrition computed per serving from the recognised dish and measured weight
- The model is compressed and quantised to fit the device it ships to — accuracy held against the evaluation set at every step down
- Runs offline on a Jetson or Raspberry Pi class device in the school, so children's images never leave the building
