The new capabilities of the GPT-4 model have also made their way to the Be My Eyes app for the visually impaired. More specifically, the app is set to employ GPT-4’s dynamic image-to-text generator to bring a ‘Virtual Volunteer’ AI feature.
As per the company announcement, “Our new Virtual Volunteer tool, currently in beta testing, will push us further toward achieving our goal to improve accessibility, usability, and access to information globally, and aligns us with OpenAI’s stated principles on developing safe and responsible AI.”
How Virtual Volunteer improves the app
Be My Eyes is an app that connects visually challenged people with a community of volunteers and company representatives via video call. The platform enables them to take help from the volunteers for various daily needs, which may include reading small text or differentiating between colours. However, the app is inherently community-driven, and its users have a dependence on others to help them out.
By incorporating GPT-4 technology, the app may be able to finally overcome this limitation. The new AI model’s ability to analyse images is key to the new Be My Eyes AI offering. This feature lets visually impaired users share images with the AI and ask questions about the same. As shown in an official clip, the AI can do a number of tasks such as identifying a plant type and locating a particular machine at the gym.
New AI-powered beta feature will expand to more users soon
The Virtual Volunteer feature is currently in closed beta and only available to certain testers. ‘Be My Eyes’ users can register to be on the waitlist for the AI feature, which is set to roll out to more people over the forthcoming weeks. The company has also confirmed that Virtual Volunteer will be free to use for all users of the app.
