The brand new capabilities of the GPT-4 mannequin have additionally made their approach to the Be My Eyes app for the visually impaired. Extra particularly, the app is ready to make use of GPT-4’s dynamic image-to-text generator to convey a ‘Digital Volunteer’ AI characteristic.
As per the corporate announcement, “Our new Digital Volunteer device, at the moment in beta testing, will push us additional towards attaining our purpose to enhance accessibility, usability, and entry to data globally, and aligns us with OpenAI’s said ideas on creating protected and accountable AI.”
How Digital Volunteer improves the app
Be My Eyes is an app that connects visually challenged folks with a neighborhood of volunteers and firm representatives by way of video name. The platform permits them to take assist from the volunteers for varied every day wants, which can embody studying small textual content or differentiating between colors. Nevertheless, the app is inherently community-driven, and its customers have a dependence on others to assist them out.
By incorporating GPT-4 know-how, the app could possibly lastly overcome this limitation. The brand new AI mannequin’s capability to analyse pictures is essential to the brand new Be My Eyes AI providing. This characteristic lets visually impaired customers share pictures with the AI and ask questions on the identical. As proven in an official clip, the AI can do numerous duties similar to figuring out a plant sort and finding a specific machine on the gymnasium.
New AI-powered beta characteristic will increase to extra customers quickly
The Digital Volunteer characteristic is at the moment in closed beta and solely obtainable to sure testers. ‘Be My Eyes’ customers can register to be on the waitlist for the AI characteristic, which is ready to roll out to extra folks over the forthcoming weeks. The corporate has additionally confirmed that Digital Volunteer will likely be free to make use of for all customers of the app.