A mystery shopper is a trained person who visits your store, showroom, clinic or branch as an ordinary customer and records what really happens. It answers questions that sales numbers cannot: Were customers greeted? Was the price quoted correctly? Did the staff handle a complaint well? This guide explains how to run a mystery shopping study that gives you reliable results.
When mystery shopping is worth doing
- You have several outlets and the customer experience varies from one to another.
- Sales are flat even though footfall is steady, so something is lost between entry and billing.
- You have launched a new process, offer or training programme and want to know whether the staff follow it.
- You want to compare your outlets with a competitor on the same checklist.
Step 1: Decide what you will measure
Choose five to ten observable behaviours. Avoid opinions such as ‘friendly’. Write each check so that two different shoppers would give the same answer: ‘Greeted within 30 seconds: yes or no’, ‘Price quoted matches shelf price: yes or no’, ‘Bill itemised: yes or no’.
Step 2: Build a weighted scorecard
| Check | Maximum points |
|---|---|
| Greeted within 30 seconds | 10 |
| Product knowledge and honest advice | 20 |
| Cleanliness and display | 15 |
| Billing accuracy | 15 |
| Offer or add-on suggested, without pressure | 10 |
| Complaint or return handled (planned scenario) | 15 |
| Courteous exit | 15 |
| Total | 100 |
Give more weight to what customers care about most and to what you have asked staff to change. Keep the weights fixed through the study so that the scores can be compared.
Step 3: Choose the number of visits
This is where many studies go wrong. A single visit can be a good day or a bad day for the staff. Plan several visits per outlet, at different times of day and on different days, including a weekend.
Here is a worked example. A chain has 20 outlets and plans 3 visits each, so 60 visits in all. Suppose the average score is 74 out of 100 and the scores vary with a standard deviation of 12 points.
- For the whole chain: margin of error at 95 per cent confidence = 1.96 x 12 / square root of 60 = about 3 points. So the chain average is 74, give or take 3.
- For one outlet with only 3 visits: 1.96 x 12 / square root of 3 = about 14 points. One outlet’s score of 74 could really be anywhere from about 60 to 88.
The lesson is clear. With three visits you can judge the chain, a region or a type of outlet with confidence, but you should not rank or punish a single outlet on that evidence. If you need reliable scores for each outlet, plan more visits for those outlets or use the study to find weak behaviours and then investigate further.
Step 4: Train and brief the shoppers
- Give each shopper a short scenario, such as buying a gift within a budget or asking about an exchange.
- Teach them what to observe, not to judge.
- Ask for the report within a few hours, while memory is fresh, and for supporting details such as the time, the staff description and the bill.
- Rotate shoppers so that one person’s style does not colour a whole outlet.
Step 5: Read the results carefully
- Look first at the behaviours with the lowest average across all outlets. These point to a training or process gap, not a people problem.
- Compare outlet types, for example mall and high street, or morning and evening. Differences here are usually more reliable than outlet-by-outlet differences.
- Repeat the study after the training and compare like with like. A rise from 74 to 82 over 60 visits each is a real change; a rise of 2 points is within the noise.
- Share the findings with the staff in a constructive way. Mystery shopping works best when it is used to coach, not to catch.
Common mistakes to avoid
- Too few visits, then treating a score as a verdict on one outlet.
- Changing the checklist halfway through the study.
- Telling the outlet when the visit will happen.
- Collecting scores but not asking what the customer actually decided, such as buying, leaving or asking again.
ARS Market Research Services, Chennai, designs and runs mystery shopping and satisfaction studies for retail chains, showrooms, clinics and service businesses, with analysis explained in plain language. Write to admin@arsmrs.in, and watch our free lessons at arsmrs.in.
