Amazon has launched Lens Live, an AI-enhanced version of its Lens feature in the Amazon Shopping app. The feature enables users to instantly scan products, view real-time matches, and access AI-generated insights from Amazon’s assistant, Rufus.
Lens Live
Amazon Lens allows shoppers to identify items they see online or in physical stores. According to Trishul Chilimbi, Vice President and Distinguished Scientist for Stores Foundational AI at Amazon, Lens Live makes the process faster and more interactive.
Key Features
- Real-Time Product Scanning: Upon opening Lens Live, the camera automatically detects items and displays top matches in a scrollable carousel for easy comparison.
- Interactive Camera Tools: Users can tap any item to focus, add products directly to their cart using the + icon, or save items to a wish list via the heart icon without leaving the camera screen.
- AI-Powered Insights: Rufus provides suggested questions, concise product summaries, and key information beneath the carousel, enabling rapid research and informed decisions.
Technology Behind Lens Live
Trishul Chilimbi explained that Lens Live runs on AWS-managed Amazon OpenSearch and Amazon SageMaker, which enable the deployment of machine learning models at scale. A lightweight on-device computer vision model identifies products in real time as users pan their cameras across scenes.
A deep learning visual embedding model then compares the camera view against billions of Amazon products to locate exact or similar matches. Chilimbi noted that Amazon’s AI, Rufus, assists users by generating helpful questions, answers, and key product information for faster discovery.
Availability
Amazon Lens Live is now available on the Amazon Shopping app for iOS and will gradually roll out to additional U.S. customers. Users can still use traditional Lens features, such as uploading images, scanning barcodes, or taking pictures.