ArticleA vendor we had hired to build visibility for a client sent through a monthly traffic report that looked excellent. Growth every single week, and weekends that behaved exactly like weekdays. That flatness is what made me open the server logs instead of the slide. What we found was a script refreshing pages on a timer and bot visits shaped to pass as sessions. The audience existed in the report and nowhere else.
I run marketing at FameNinja, mostly reputation and PR work, and I have never managed a shop floor. I will not pretend otherwise. But what I just described is not a marketing failure. It is a procurement failure, and it travels. Retail buys vendor-reported numbers constantly. Footfall counters. Loyalty app engagement. Review generation services. Delivery platform visibility. Agency reach. In every one of those, the party being graded is also the party producing the grade.
A number that never has a bad week is not a good number
Operational data is ugly. Your Tuesdays do not match your Saturdays. A public holiday distorts a fortnight. One staffing change moves a metric you had no reason to expect it to move. In the cases we run, the reports that turn out to be fabricated are almost never the ones with bad results in them. They are the ones with no texture: a line that climbs at the same angle month after month, categories that sit in the same order every time, and a total that lands suspiciously close to whatever was promised in the proposal.
So the question to put to a vendor is not why this month is down. It is why nothing is ever down. A report with no losses anywhere in it has been edited, and the only open question is whether the editing happened before or after the data was collected.
Instrument on your side of the wall
You do not need to catch anybody. You need one number the vendor cannot reach.
If a review generation service reports how many requests it sent, the number you own is how many of your own transactions produced a review in the same window. If a loyalty app reports engagement, the number you own is redemptions at the till. If an agency reports reach, the number you own is calls to the shop and bodies through the door. None of these have to be sophisticated. They have to be collected by your own staff on your own systems, then compared against the vendor file before anybody approves an invoice.
Write that comparison into the contract while you are still attractive to the vendor, which is before you sign. Ask for raw exports rather than summaries, and say plainly what you intend to do with them. Vendors who are actually doing the work say yes, and some of them sound relieved. How a supplier reacts to that one clause has told us more, and faster, than any reference call we have ever made.
The person who runs the process should build the check
We spent a long time hiring developers to build our internal checks, and the checks kept missing things. What changed it was handing the work to our own operations people and teaching them workflow automation instead. They built slower. They were far better at knowing which step in a process is capable of lying, because they had spent months being the person doing that step.
The same logic sits inside a shop. Your store manager already knows the door counter reads high when the delivery bay is propped open, and that loyalty sign-ups jump on the days one particular person is rostered. That is exactly the knowledge a check needs in order to be worth running. A head office analyst does not have it and cannot buy it.
One warning, from our own systems rather than anyone else's. Automated checks fail quietly. We have had reconciliation workflows stall while everything downstream carried on looking perfectly healthy, because nothing was watching the watcher. The rule we run now is that a missing check counts as a failed check. If the vendor report arrives and the comparison did not run, the invoice waits.
None of this is about distrust, and most of the suppliers we work alongside are good at their jobs and worth paying. It is about what a number actually is. If the only place a figure exists is the file your supplier sent you, you are not holding a measurement. You are holding their opinion of their own performance, formatted to look like arithmetic.