Voice-Enabled Makeup Assistant Assistive Technology for the Blind & Visually Impaired
Meet Estée Lauder’s Voice-enabled Makeup Assistant, an AI-powered tool for the Blind and visually impaired.
This innovative app for iOS devices offers audio feedback on foundation, eyeshadow and lipstick application, creating a more accessible beauty experience for the visually impaired.
This app is a small step in advancing the accessibility of our Estée Lauder products and services, and helping to ensure all consumers can feel their most confident and beautiful when it comes to makeup application.
What does the app do?
The Voice-enabled Makeup Assistant leverages facial recognition, machine learning and voice instruction technologies and provides detailed audio feedback on a user’s application of foundation, eyeshadow and lipstick.
The Virtual Makeup Assistant guides the user through their makeup application process including any recommended touch ups along the way.
How does it work?
After the user applies foundation, eyeshadow or lipstick, the Voice-enabled Makeup Assistant will use the phone’s camera for a face scan.
Using artificial intelligence, the app identifies the makeup applied to the face, eyes and lip and assesses the uniformity and boundaries of application and coverage.
If there are suggested areas to touch up, the Virtual Makeup Assistant identifies them and makes audible recommendations so the user can adjust their look. After the user’s touch up, the app does another face scan and provides feedback on accuracy of the application.
Frequently Asked Questions
What can this app check for me?
Right now, the VMA app identifies makeup on the user’s face (foundation, eyeshadow or lipstick) and checks for application uniformity and symmetry. The user is notified if there are areas to touch up, and what specifically needs attention. The user is given time to make touch ups before their makeup gets checked again. This app does not include shade matching guidance.
Can I adjust the voice settings?
Users have told us that familiarity is the most important factor with a voice assistant. Therefore, if a user has a screen reader enabled, the selected voice will apply to this VMA app. Otherwise it will use the voice selected in the user’s own accessibility settings on their device. A user can change these setting manually at any time by opening ‘Settings’ > ‘Accessibility’ > ‘Spoken content’ > ‘Voices’ > ‘English’. The assistant’s voice speed can also be adjusted in the app at any time. Simply say ‘Open Settings’ and either speed up or slow down the voice from there.
What if I encounter a problem while using the app?
We are continuously improving and updating the VMA App to be a more seamless experience. Though unlikely, you might sometimes encounter a temporary technical issue with the EL VMA app. In case the assistant repeats the same conversation flow several times or does not properly respond to commands, we recommend closing the app, waiting ten seconds, and opening it again. We also encourage users that encounter any technical difficulties to offer feedback so we can find a proper solution. Feedback can be submitted by using the voice command ‘Open Settings’ and selecting ‘Feedback’ from the menu.
What devices does this app work on?
VMA is compatible with iPhones 8 and above, using iOS 14.1 or later.
How can I provide feedback?
We welcome user feedback and incorporate it into the app as we constantly make updates. During the VMA experience, users are prompted by the app to share their thoughts at key intervals. Feedback can also be given at any time by using the voice command ‘Open Settings’ and selecting ‘Feedback’ from the menu.
Can I skip the instructions?
Right now, the app is unable to skip over the instructions section of the experience.
Can I stop the app while it's talking?
When the voice assistant is talking, the mobile device's microphone is turned off so the user can clearly hear the instructions. An option is to speed up the assistant’s voice speed in the phone's settings.
Where is the App available?
EL VMA can currently be downloaded from the iOS App store in the UK and Ireland.
What languages are available for this App?
The EL VMA app is currently available in English only.
Tell us what you think:
We welcome your comments and feedback on this app. If you have any questions or require additional assistance, please contact us using phone number 0808 281 0228.