Tag: Be My AI

Posted on

Video Data For the Training of AI Models

According to Hans Jørgen Wiberg, the founder of the app for blind and visually impaired people, Be My Eyes plans to make video data from conversations between blind users and sighted volunteers available for training AI models. This was revealed in an email he sent to all users. The initiative takes place under a strict privacy policy that gives users the option to opt out of data sharing. Photos and their AI descriptions are not used for AI training in order to avoid perpetuating existing prejudices. According to Wiberg, AI models should reflect the actual experiences and abilities of blind people. Bryan Bashin, Vice Chairman of Be My Eyes, emphasizes that blind testers have improved the OpenAI models, which for him proves how important their participation is. Be My Eyes caused a sensation in 2023 with the new Be My AI feature. Prof. Dr. Oliver Bendel wrote the first paper on this topic in November 2023, submitted it in December 2023, and presented it at the AAAI Spring Symposia at Stanford University in March 2024 (Image: DALL-E 3).

Posted on

GenAI for the Blind

At the AAAI 2024 Spring Symposium “Impact of GenAI on Social and Individual Well-being” the paper “How Can Generative AI Enhance the Well-being of the Blind?” by Oliver Bendel was accepted. In his paper, the information systems specialist and technology philosopher from Zurich discusses the GPT-4-based Be My AI feature of the Be My Eyes app. He presents his own tests with the app and discusses it from an ethical perspective. The feature is one of the most important inventions in recent years for blind and visually impaired people. It allows them to describe and categorize their surroundings without outside help. However, it is troubling that the app refuses to show some objects, including famous works of art that depict nudity. This disenfranchises people because of the moral sensitivities and economic considerations of the developers. Oliver Bendel will present the paper at Stanford University on March 25-27. It is his ninth consecutive appearance at the AAAI Spring Symposia, which this time consists of eight symposia on artificial intelligence.

Posted on

Project on the Potential of Be My AI

In a recent project, Prof. Dr. Oliver Bendel investigates the capabilities and limitations of the Be My AI feature of the Be My Eyes app. This development, based on GPT-4, is in the field of visual assistance for the blind and visually impaired. The study describes and evaluates Oliver Bendel’s own tests. Additionally, there is an ethical and social discussion. The study reveals the power of the tool, which can analyze still images in an astonishing way. Those affected gain new independence and a new perception of their environment. At the same time, they are dependent on the worldview and morality of the provider or developer, who dictates or withholds certain descriptions. Despite all the remaining weaknesses and errors, it is clear that a paradigm shift has occurred. The study’s outlook suggests that the analysis of moving images will be a significant advancement. It can be justifiably claimed that generative AI can fundamentally improve and change the situation of the blind and visually impaired in various ways. The project’s results will be published in the spring of 2024.

Posted on

Be My AI

Be My AI is a GPT-4-based extension of the Be My Eyes app. Blind users take a photo of their surroundings or an object and then receive detailed descriptions, which are spoken in a synthesized voice. They can also ask further questions about details and contexts (Image: DALL-E 3). Be My AI can be used in a variety of situations, including reading labels, translating text, setting up appliances, organizing clothing, and understanding the beauty of a landscape. It also offers written responses in 29 languages, making it accessible to a wider audience. While the app has its advantages, it’s not a replacement for essential mobility aids such as white canes or guide dogs. Users are encouraged to provide feedback to help improve the app as it continues to evolve. The app will become even more powerful when it starts to analyze videos instead of photos. This will allow the blind person to move through his or her environment and receive constant descriptions and assessments of moving objects and changing situations. More information is available at www.bemyeyes.com/blog/announcing-be-my-ai.