tl;dr:Previously, the team at Doordash relied on humans to transcribe and update restaurant menus manually, which is costly and time-consuming. The rapid improvement of large language models, or LLMs, creates an opportunity for a big stepwise change, allowing AI to transcribe information from menu photos. However the diverse menu structures restaurants use pose a challenge for an LLM to do an accurate job at scale. In this blog, we will discuss how we built a system with a guardrail layer for LLMs leveraging traditional ML techniques.