With vegan you can’t estimate it 100% from menu alone - because the sauce and other minor ingredients can be animal based.
If you want to do it, using “plant based” is probably better than “vegan”, and it’s always good to make sure your users are aware that the mark can be wrong and they should double-check with the waiter.
As for your question - I didn’t play with Donut, but ocr+gpt or multimodal gpt4 once released should handle this smoothly.
You could combine ingredient search, looking for symbols the actually designate vegan as some places do, along with long/lat data to determine what the restaurant actually is and then check it with a database you maintain.
So I could scan a menu, and then ask the owner or server about certain dishes, and then crowdsource an updated
It would be great if there was a standard API for all restaurants that included all menu items, prices, ingredients, preparation and sourcing information. I could be maintained like a wiki I suppose, and restaurants could be incentivized by including their restaurants.
Yeah crowd-sourcing updates is the way I'd like to go. I'm hoping people will submit photos of menus, because lots of bakeries, cafés etc don't have much of an online presence or keep their menus up-to-date.
Trying to solve the problem of scanning through menus for multiple restaurants to find something a vegan or vegetarian can eat, and instead just showing all the individual menu options in the area as a list.
If you want to do it, using “plant based” is probably better than “vegan”, and it’s always good to make sure your users are aware that the mark can be wrong and they should double-check with the waiter.
As for your question - I didn’t play with Donut, but ocr+gpt or multimodal gpt4 once released should handle this smoothly.