Tag: Blind

Posted on

Generative AI for the Blind

The paper “How Can Generative AI Enhance the Well-being of the Blind?” by Oliver Bendel is now available as a preprint at arxiv.org/abs/2402.07919. It was accepted at the AAAI 2024 Spring Symposium “Impact of GenAI on Social and Individual Well-being”. From the abstract: “This paper examines the question of how generative AI can improve the well-being of blind or visually impaired people. It refers to a current example, the Be My Eyes app, in which the Be My AI feature was integrated in 2023, which is based on GPT-4 from OpenAI. The author’s tests are described and evaluated. There is also an ethical and social discussion. The power of the tool, which can analyze still images in an amazing way, is demonstrated. Those affected gain a new independence and a new perception of their environment. At the same time, they are dependent on the world view and morality of the provider or developer, who prescribe or deny them certain descriptions. An outlook makes it clear that the analysis of moving images will mean a further leap forward. It is fair to say that generative AI can fundamentally improve the well-being of blind and visually impaired people and will change it in various ways.” Oliver Bendel will present the paper at Stanford University on March 25-27. It is his ninth consecutive appearance at the AAAI Spring Symposia, which this time consists of eight symposia on artificial intelligence.

Posted on

GenAI for the Blind

At the AAAI 2024 Spring Symposium “Impact of GenAI on Social and Individual Well-being” the paper “How Can Generative AI Enhance the Well-being of the Blind?” by Oliver Bendel was accepted. In his paper, the information systems specialist and technology philosopher from Zurich discusses the GPT-4-based Be My AI feature of the Be My Eyes app. He presents his own tests with the app and discusses it from an ethical perspective. The feature is one of the most important inventions in recent years for blind and visually impaired people. It allows them to describe and categorize their surroundings without outside help. However, it is troubling that the app refuses to show some objects, including famous works of art that depict nudity. This disenfranchises people because of the moral sensitivities and economic considerations of the developers. Oliver Bendel will present the paper at Stanford University on March 25-27. It is his ninth consecutive appearance at the AAAI Spring Symposia, which this time consists of eight symposia on artificial intelligence.

Posted on

Project on the Potential of Be My AI

In a recent project, Prof. Dr. Oliver Bendel investigates the capabilities and limitations of the Be My AI feature of the Be My Eyes app. This development, based on GPT-4, is in the field of visual assistance for the blind and visually impaired. The study describes and evaluates Oliver Bendel’s own tests. Additionally, there is an ethical and social discussion. The study reveals the power of the tool, which can analyze still images in an astonishing way. Those affected gain new independence and a new perception of their environment. At the same time, they are dependent on the worldview and morality of the provider or developer, who dictates or withholds certain descriptions. Despite all the remaining weaknesses and errors, it is clear that a paradigm shift has occurred. The study’s outlook suggests that the analysis of moving images will be a significant advancement. It can be justifiably claimed that generative AI can fundamentally improve and change the situation of the blind and visually impaired in various ways. The project’s results will be published in the spring of 2024.

Posted on

Be My AI

Be My AI is a GPT-4-based extension of the Be My Eyes app. Blind users take a photo of their surroundings or an object and then receive detailed descriptions, which are spoken in a synthesized voice. They can also ask further questions about details and contexts (Image: DALL-E 3). Be My AI can be used in a variety of situations, including reading labels, translating text, setting up appliances, organizing clothing, and understanding the beauty of a landscape. It also offers written responses in 29 languages, making it accessible to a wider audience. While the app has its advantages, it’s not a replacement for essential mobility aids such as white canes or guide dogs. Users are encouraged to provide feedback to help improve the app as it continues to evolve. The app will become even more powerful when it starts to analyze videos instead of photos. This will allow the blind person to move through his or her environment and receive constant descriptions and assessments of moving objects and changing situations. More information is available at www.bemyeyes.com/blog/announcing-be-my-ai.