The 5-Step Main Image Testing SOP

In e-commerce, everyone’s chasing click-through and conversion rates. Amazon gives you Manage Your Experiments to test what works – but it only shows what happened, not why.

And without the why? You’re guessing.

In a crowded marketplace where everyone’s optimizing the same levers, understanding shopper intent is what separates top performers. McKinsey found that companies who decode customer behavior grow 85% faster than those who don’t.

Most brands still rely on black-box dashboards and gut instinct. That’s not strategy. That’s risk.

At ProductPinion, we close that gap. We study real people as they shop—capturing what they notice, what confuses them, and what actually drives their clicks.

This article breaks down our 5-step Main Image SOP so you can test smarter, cut wasted spend, and build listings that convert better on day one.

Table of Contents

1. The Case for Combining Qualitative + Quantitative Testing
2. Step 1: Qualitative Testing – Watch People Shop
3. Step 2: Search Simulation – Establishing the Baseline
4. Step 3: Concept Creation & Testing
5. Step 4: Re-Running the Baseline With the Winning Image
6. Step 5: Testing the Final Image Live on Amazon
7. Conclusion: From Guessing to Growth

Main Image Optimization: Why Combining Qualitative and Quantitative Testing Wins

While ProductPinion supports a wide range of listing optimization use cases, this article focuses on one of the highest-impact levers for conversion: your product’s main image.

Amazon gives you the numbers-click-through rates, conversion rates, sales-but those metrics only show what happened. They don’t tell you why shoppers chose one listing over another. That missing context often leads brands to make costly creative mistakes based on assumptions.

ProductPinion closes that gap. Recognized as the #1 Best A/B Testing Platform by the Golden Seller Awards, ProductPinion helps brands turn shopper behavior into real performance lifts.

We combine qualitative insights, like real-time shopper reactions via screen recordings and polls, and click behavior – with quantitative validation. Our tools simulate real Amazon shopping experiences, so you can understand not just what performs best, but what actually drives performance.

By layering both types of data, brands avoid guesswork, reduce risk, and consistently build main images that convert.

Here’s the 5-step SOP that makes that possible. 

The 5-Step Main Image Testing SOP Behind Improved Conversion

Let’s bring this SOP to life with a real example.

A sleep brand selling a knee pillow on Amazon UK had a decent main image – but “decent” doesn’t win clicks. Using our 5-step SOP, they uncovered hidden objections (like washability), tested new image concepts, and launched a version that doubled click-through rate and lifted conversion by over 14%.

The result? +35% in sales and nearly £20K/month in added revenue – driven by one smarter image.

This exact process was shared by ProductPinion co-founder Andri Sadlak during his keynote at the Know How Conference in Warsaw. Below, he breaks down every step for you.

Step 1: Qualitative Testing – Watch People Shop

We started with the most unfiltered human insight. Using ProductPinion’s Pinion Video feature, we asked 10 UK-based shoppers to record their screens as they browsed Amazon for a knee pillow – and respond to three simple but revealing questions:

1. Which knee pillow on the search result page would you most likely click into? Why?
2. Click into your top 3 listings. For each, what did you like? What could be improved?
3. What are the most important features and benefits you look for in a knee pillow?

What we learned went beyond what quantitative tests alone can reveal:

• Washability was a top concern. Shoppers looked closely for signs that the cover was removable and easy to clean.
• That insight led to a potential product enhancement: offering an extra cover as a key differentiator.
• The phrase “Orthopedic Approved” served as a major trust signal-attracting attention to listings that displayed it prominently, including one that happened to be the category’s best seller.

By uncovering these unspoken objections and priorities, we laid the groundwork for a much stronger image strategy in the next steps.

Step 2: Search Simulation – Establishing the Baseline

With initial shopper insights in hand, the next step was to quantify how the existing main image stacked up against the most similar competition. Using ProductPinion’s Search Simulation tool, the brand conducted a Baseline Test to measure clickshare in a realistic, side-by-side marketplace environment.

The setup:
The test included five direct competitors – products with comparable designs, price points, and review volumes. Because pricing and reviews are less flexible levers, the test isolated what the brand could control: the visual strength of its main image.

The results:
The original image attracted just 7% of total clicks, placing the listing near the bottom of the group. Competing images performed significantly better, making it clear that a creative reset was needed.

This baseline gave the team both a quantitative benchmark and qualitative context (reasoning) – essential for creating and evaluating future image variations with confidence and precision.

Step 3: Concept Creation & Testing

With clear shopper feedback from Pinion Videos and Polls, we moved into concept development – creating new main image variations rooted in what real customers actually cared about.

What mattered most to shoppers:

• Aesthetic Appeal & Design – Images that were visually compelling and clearly communicated product function
• Product Quality – Indicators like “washable cover” helped convey durability and usability
• Brand Trust – Claims such as “Orthopedic Approved” served as immediate credibility triggers

Our competitive analysis also uncovered a standout tactic: a pattern interrupt. While most pillows in the category were shown horizontally, the top-performing listing positioned the product upright – breaking the visual rhythm of the search results and naturally drawing more attention.

Guided by these insights, the creative director who worked on this project, Dorian Gorski, developed three distinct image concepts with the upright angle:

• Option A – clinical trust and doctor-led authority
• Option B – kept “Doctor Recommended” claim and played with the UK flag
• Option C – used “Doctor Developed” but also “Washable Cover” claim

Option C clearly stood out, winning 48% of shopper preference with over 80% statistical significance.

Step 4: Re-Run the Baseline With the Winning Image

We ran the same Search Simulation again – but with a fresh audience to eliminate carryover bias. The setup mirrored the original test, allowing us to isolate the effect of the new main image.

In the first round, the original image captured just 7.07% of shopper clicks.

Original Concept

Click Share: 7.07%

The new concept, informed by real shopper insights, delivered a striking improvement – earning 14.00% of the clicks in the exact same competitive context.

New Concept

Click Share: 14.00%

That’s a 2x increase in click-through rate – driven entirely by creative optimization. No pricing tweaks. No extra promotions. Just sharper alignment with what buyers actually want to see.

This kind of lift is only possible when brands test with both qualitative and quantitative rigor – before ever touching their live Amazon listing.

STEP 5: Testing the Final Image Live on Amazon

After pinpointing the winning concept through qualitative insights and controlled simulations, the brand owner moved to final validation: direct upload to Amazon (Amazon’s Manage Your Experiments tool is recommended). This is testing the new main image with real traffic now.

The results were decisive.

• Conversion rates in the UK rose from 21% to 24%

• Sales jumped +35.5% month over month
  
• Net profit increased by 67.8%, adding £19,208/month in revenue!

• Total cost of executing this entire SOP? Just $447

A 14.29% increase in conversion rate – powered by one image change!

This final step confirms your hypothesis with real-world data.

Smart brands don’t just ship and hope. They layer validation – qualitative → simulated → live – to launch or relaunch confidently and profitably.

Conclusion

Your main image is your first impression – and often your only chance to win the click. But guessing what works is no longer enough. By layering qualitative insights with quantitative validation, brands can turn creative decisions into measurable growth.

This 5-step SOP didn’t just improve click-through and conversion rates – it added over £19K in monthly revenue for the brand, with just $447 in testing costs.

Start your free trial of the best A/B testing platform for Amazon Sellers today.

Want more real-world strategies that drive results? Follow Andri Sadlak on LinkedIn.