Apple researching AI agent that can describe Street View scenes to the blind

Apple engineers have detailed an AI agent that accurately describes Street View scenes. If the research pans out, it could become a tool to help visually impaired people virtually explore a location in advance.Visually impaired iPhone users may get more out of Look Around in the futureBlind and visually impaired people already have tools at their disposal to navigate their devices and their local environment. However, Apple believes it could be beneficial for the same people to know about a place's physical features before visiting it.A paper released through Apple Machine Learning Research on Monday talks about SceneScout, a multi-modal large language model-driven AI agent. The key to the agent is that it can be used to view Street View imagery, analyze what is seen, and to describe it to the viewer. Continue Reading on AppleInsider | Discuss on our Forums