Inside the 100,000 Prompt Alexa Study: ReFiBuy VP of Research Andrew Bell

This is a solo research-and-playbook deep dive. Andrew Bell walks through a study of 100,000 shopping prompts tested from Amazon’s homepage context, looking at which products Alexa for Shopping shows, how it groups them, where they land, and what the explanation says. He turns the findings into three takeaways and a starting plan any e-commerce or product content team can use.

Highlights

• 𝗧𝗵𝗲 𝘀𝘁𝘂𝗱𝘆: 100,000 shopping prompts across several categories, tested from Amazon’s homepage context, tracking which products Alexa for Shopping showed, how they were grouped, where they were positioned, and what the explanation said.
• 𝗦𝗲𝗺𝗮𝗻𝘁𝗶𝗰 𝘀𝗵𝗲𝗹𝘃𝗲𝘀: A group of products organized around a particular need or reason to choose. One request like “budget laptops for school” splits into groups such as all-around MacBook, Windows laptops, two-in-one convertibles, and ultra budget picks.
• 𝗧𝘄𝗼-𝘁𝗵𝗶𝗿𝗱𝘀: Roughly two-thirds of products leading their own shelf were still below the first overall position.
• 𝗔 𝗵𝗮𝗿𝗱 𝗹𝗶𝗺𝗶𝘁 𝗼𝗻 𝗰𝗼𝗽𝘆: “Better copy can explain a product’s capabilities. It can’t give the product a capability it doesn’t have.”
• 𝗪𝗵𝗶𝗰𝗵 𝗴𝗿𝗼𝘂𝗽𝘀 𝗮𝗽𝗽𝗲𝗮𝗿 𝗳𝗶𝗿𝘀𝘁: Groups built around ratings, popularity, trust, and value showed up first more often than the baseline. Premium groups showed up first less often. These are presentation patterns, not ranking weights.
• 𝗧𝗵𝗲 𝘁𝗵𝗿𝗲𝗲 𝗹𝗲𝗻𝘀𝗲𝘀: Review every response for the comparison, the explanation, and the reason to choose.

Showing up in the answer is only half the job, and this one is about the other half. Enjoy the episode.

Timestamps:

01:10 The study: 100,000 Alexa for Shopping prompts
01:40 What the research can and can't tell you
02:00 Preview: the three takeaways
03:00 Takeaway 1: Competing inside a product group
03:30 Example: budget laptops for school
04:10 Semantic shelves explained
04:30 First in group vs. fifth overall
05:35 Takeaway 2: Persuasive, but is the requirement answered?
06:00 The machine-washable running shoe example
06:50 How to audit product info and shopping responses
08:00 Takeaway 3: Your role in the shopping decision
08:15 Which groups appear first (Chart 18)
09:30 Reviews, price, and the New Balance comparison
10:10 When fewer reviews win
11:00 What a brand team should do next
12:15 Visibility vs. sales
12:50 Walking through the interactive study

👉 Read the full study: https://alexaforshopping.refibuy.ai/

🧠 Want to stay ahead in AI commerce? Subscribe and follow along:

📰 Subscribe to the free Substack: retailplaybook.ai
📺 Watch episodes on YouTube & Subscribe for updates: https://www.youtube.com/@Retailplaybooks

What is RetailPlaybook | Agentic Commerce Strategies for Amazon, Walmart, & Target?

RetailPlaybook, provided by ReFiBuy and written by Andrew Bell, equips brands with cutting-edge research, original playbooks, and future-proof strategies for agentic commerce, helping you optimize for AI shopping assistants like Amazon's Rufus, Walmart's Sparky, and Target's shopping assistant.