FoodPhone™ takes advanced vision technology to turn mobile phones into precise food and nutrition analysis devices using AI, 3D and Hyperspectral approaches. FRAMOS reveal how they took the calorie counting application to a new level.
Over 200 million people deal with Type-1 or Type-2 diabetes and obesity worldwide. Now, vision technology now helps in fighting these diseases by taking a smartphone picture of a meal on a plate and instantly knowing its nutritional contents in scientific-like precision – as easy as sharing on social media.
FoodPhone™ provides a mobile solution using Intel®’s RealSense™ (RS) 3D technology to determine the volumes, texture, and shapes of all types of food, with seemingly only one image capture. Besides identifying carbohydrates and counting calories, this new phone case, equipped with embedded vision, detects the ingredients of commercially prepared food based on their chemical composition and instantly displays FDA-formatted (US Food & Drug Administration) nutrition labels.
The FoodPhone™ device’s NIR (near IR) capabilities also recognise any natural imperfections, both visible and non-visible, and help in detecting the foods quality and freshness at the grocery store. Selecting the freshest fruits or vegetables like avocados, is made simple by instantly displaying “freshness” levels on the user’s smartphone.
Watching your nutritional intake
Diabetics, athletes, fitness-lovers, and many others struggling with their weight need to watch what they are eating. In the US alone, over 100 million people use smartphones and smart devices to monitor their weight, fitness and diet each day. In all modern western and rising eastern societies, diabetes is rapidly increasing in numbers.
Especially for diabetics, counting carbs is key to managing their disease and, for them, it is a matter of life and death. Their carbohydrate intake influences their insulin levels. The carbohydrate total is the key meal information needed by a diabetic for using emerging technologies like CGM (Constant Glucose Monitoring) and automated tubeless insulin pumps. There lies the problem: These health-saving monitoring tools are only successful with the right user input. Manual input and user’s food estimations tend to be very inaccurate, causing incorrect insulin dosages which can be very dangerous and even life threatening for the diabetic.
Only one Smartphone image needed
Today, smartphones have cameras, access to the internet, include modern, powerful Artificial Intelligence (AI) algorithms, and are used to take millions of food images every minute. The FoodPhone idea is to turn these smartphones into diet-helpers by analysing the food directly on the plate. By snapping what seemingly is one image of the meal, the FoodPhone app, with its SpectraPixel™ technology, connects with the company’s proprietary cloud-based AI to recognise the meal’s content, specifically its chemical composition, quantity in ounces/grams and quality, while also segmenting mixed meals. With the help of the multispectral cameras and NIR sensors embedded in the FoodPhone’s new smartphone case design, the user instantly gets a scientific analysis of their meal.
This one-shot analysis provides details on the carbohydrates, fats, proteins and other nutritional contents along with the true portion size of the prepared meal. Combining different imaging technologies with AI based intelligence, FoodPhone precisely identifies the amount and composition of food. There is no need to input any information into the application, nor touch or probe the food, or guess its volume. The analysis is fast. In a very user friendly and efficient way, the FoodPhone case delivers exact Nutrition Fact sheets with accuracies beyond 90 per cent. With a mix of AI and AR, the technology will impact the spread of diabetes and support food-watchers in reaching their goals.
Continue reading article…