What must a transparent product ranking include?

A transparent product ranking says what was measured and how, how many products were compared, when and where the data was gathered, and who paid for it. If any of these is missing, the list is the author’s opinion, not a comparison you can check. Below is a checklist with an example.

Before you trust a list of “the best” products, see whether it answers four questions. What was measured, and how? How many products were compared and how were they chosen? When and where was the data collected? Who paid, and does the author earn from clicks on links?

What method lies behind this guide, and what is missing from it?

The criteria for a transparent ranking described here rest on four pillars: measure, date, sample and funding. The basis is Directive 2005/29/EC as amended by Directive (EU) 2019/2161, Regulation (EU) No 1169/2011 and Directive 98/6/EC.

This article is not a ranking and has no shop sample. The example uses invented products and numbers, and its period is any shopping day, because shop prices change. We show a way of scoring, not the result of a test.

One limit: the checklist tells you what to look for, but it does not replace a legal assessment of a particular website. If you have doubts about a trading practice, your national consumer authority decides, in Poland UOKiK.

Dyrektywa 2005/29/WE dotycząca nieuczciwych praktyk handlowychDyrektywa (UE) 2019/2161 w sprawie lepszego egzekwowania i unowocześnienia unijnych przepisów dotyczących ochrony konsumentówRozporządzenie (UE) nr 1169/2011 w sprawie przekazywania informacji na temat żywnościDyrektywa 98/6/WE w sprawie ochrony konsumenta przez podawanie cen produktów

What does EU law say about rankings and reviews?

Directive 2005/29/EC on unfair commercial practices, as amended by Directive (EU) 2019/2161, includes rules that cover rankings in online trade. When a consumer can search for products from different sellers, the key information is the general rules, meaning the main parameters that decide the order of results, and their relative importance.

The list of practices that are always considered unfair includes showing search results without clearly disclosing paid advertising or payment for a higher position in the ranking. It also prohibits claiming that reviews come from consumers who actually bought or used the product without reasonable steps to check, and posting fake reviews. If a seller offers reviews, it should say whether and how it checks where they come from.

These rules apply to traders and commercial practices. Editorial rankings in guides are not always covered, but the same principles are a good measure of honesty: open criteria, a marked paid position, verified reviews.

Dyrektywa 2005/29/WE dotycząca nieuczciwych praktyk handlowychDyrektywa (UE) 2019/2161 w sprawie lepszego egzekwowania i unowocześnienia unijnych przepisów dotyczących ochrony konsumentów

What checklist should you apply to any ranking?

Seven elements are enough to tell a list with an open method from an advert dressed up as a test in a few minutes. The table says what to ask and why it matters.

A checklist for a transparent ranking
ElementWhat to askWhy it matters
CriteriaWhat exactly was measured: price per kilogram, salt per 100 g, a taste score?Without a definition, “better” means nothing.
WeightsHow much does each criterion count in the final score?Changing the weights changes the order.
SampleHow many products, from which shops, how chosen and which left out?Three products from one shelf do not describe a market.
Date and placeWhen and where were prices and ingredients collected?A ranking with no date goes stale unnoticed.
ProcedureHow many people judged, did they know the brand, on what scale?In a taste test, knowing the brand changes the score.
FundingDid the producer pay, supply products, or are the links affiliate links?Disclosure does not disqualify a ranking, concealment does.
CorrectionsHow can you report an error and where are the fixes shown?An honest author corrects and shows what changed.

Label data is a good criterion, because Regulation (EU) No 1169/2011 requires it to be given in a fixed way and Directive 98/6/EC requires a unit price. You can compare a price per kilogram without guessing. A ranking built on impressions with no description of the procedure is weaker than one built on numbers from the label.

Rozporządzenie (UE) nr 1169/2011 w sprawie przekazywania informacji na temat żywnościDyrektywa 98/6/WE w sprawie ochrony konsumenta przez podawanie cen produktów

What does a transparent score look like with invented data?

The example uses invented products A, B and C and invented numbers. It is not the result of a test. It only shows what a score looks like when the reader can check it.

We compare three tomato passatas. Criteria: price per kilogram (weight 50%), salt per 100 g from the nutrition table (weight 30%) and a short ingredients list with nothing added besides salt (weight 20%). For each criterion the best product gets 3 points, the middle one 2 and the weakest 1.

Invented data for three passatas and the points
ProductPrice per kgSalt per 100 gIngredientsPoints: price / salt / ingredients
Passata A£1.400.4 gtomatoes and salt only1 / 2 / 2
Passata B£1.120.8 gtomatoes, salt, sugar3 / 1 / 1
Passata C£1.280.2 gtomatoes only2 / 3 / 3

The weighted score: A = 0.5 × 1 + 0.3 × 2 + 0.2 × 2 = 1.5. B = 0.5 × 3 + 0.3 × 1 + 0.2 × 1 = 2.0. C = 0.5 × 2 + 0.3 × 3 + 0.2 × 3 = 2.5. The order is C, B, A.

If price counted for 80% and salt and ingredients for 10% each, the scores would be A 1.2, B 2.6 and C 2.2. B would come first. The same three products, different weights, a different winner. That is why a ranking has to publish its weights.

How can you spot a sponsored or affiliate ranking?

A sponsored ranking need not be dishonest, but it must be marked. Four signals show whether the author is open about their interests.

  • A marked paid position. A paid place on a list should be clearly shown, not hidden in the text. A paid position with no marking is a warning sign.
  • The same product always on top. If one brand wins every list on one site, check whether the criteria were picked to suit it.
  • Affiliate links. The author may earn from clicks. An honest site says so next to the ranking, not in the footer.
  • Reviews with no source. “Users rated” without saying who, how many and how it was checked is not evidence.

Remember too that no information about funding does not mean no funding. If you cannot find out who paid for a list, treat it as an opinion.

How do you judge a ranking in five minutes?

You do not need to be a statistician to spot a weak list. Five steps are enough, and each ends with a yes or a no.

  1. Find the description of the method. If there is none, the ranking stops here.
  2. Check the criteria and weights. If the result is one number with no breakdown, you do not know what makes it up.
  3. Look at the date the data was gathered. Treat prices older than a few months as an illustration, not a current offer.
  4. Look for information about funding and affiliate links.
  5. Repeat one calculation yourself, for example the price per kilogram from the label. If it matches, trust in the rest grows.

How do you build your own comparison in BuyNest?

BuyNest does not publish test rankings or paid lists. You can, though, make your own comparison with the checklist above. A list for your own tomato product comparison holds a few products to compare and the ingredients for a simple sauce in which to try them.

Add the list to BuyNest and in the note on each product write the price per kilogram, the salt per 100 g and the purchase date. The barcode scanner helps you find the same product again on later shops, and assigning products to shops shows where you bought it.

Your ranking then has everything you ask of someone else’s: criteria, date, place and sample. Compare the price per kilogram using the guide to unit prices, and portions using the guide to cost per portion.

Your own tomato product comparison

  • To compare
  • Passata two different brands2 pcs
  • Chopped tomatoes two different brands2 pcs
  • Whole tinned tomatoes1 pcs
  • Tomato purée note the concentration1 pcs
  • Fresh tomatoes for reference1 kg
  • For the sauce
  • Pasta1 kg
  • Onions500 g
  • Garlic1 pcs
  • Olive oil500 ml
  • Basil in a pot1 pcs
  • Parmesan100 g

Your own tomato product comparison

Scan the code with your phone or open the same list with the button. If the app is not installed, the store buttons remain. The list is not kept automatically after you install it.

Open in BuyNest

Need the app?

Download on the App StoreGet it on Google Play

Frequently asked questions

Can a sponsored ranking be honest?

Yes, if the paid position is clearly marked and the criteria and weights are open. A hidden payment cannot be defended. Directive 2005/29/EC lists hidden payment for a higher position as an always unfair practice in online trade.

How many products should a ranking compare?

There is no single number, but the sample must be described: how many products, from which shops, how they were chosen and which were left out. Three products from one shelf do not describe a market.

Are customer reviews enough as proof of quality?

Not on their own. What counts is whether anyone checked that the reviews come from people who bought or used the product. EU rules prohibit posting fake reviews and claiming reviews are genuine without reasonable steps to check.

Can a ranking with no date be trusted?

It is hard to judge. Prices and recipes change, so a ranking without the date the data was collected goes stale unnoticed. Trust a list with a date and a description of where the products were bought.

Where can I report a ranking that looks misleading?

If you suspect an unfair commercial practice, you can report it to the consumer authority in your country, in Poland UOKiK. Keep a screenshot with the date and the page address to show how the list looked.

Before you trust the next list, check that a transparent product ranking gives its criteria, weights, sample, date and funding. Build your own comparison on a BuyNest list, noting prices and salt from the label. The result will have an open method that you can always repeat.

Open the ready list in BuyNest

Method and criteria

The criteria for an honest ranking are in the piece: measure, date, sample, funding. This article is not a ranking and has no shop sample.

Sources

Take the shopping into BuyNest

BuyNest is on iPhone and Android. The app has no ads, including on the free plan.

Download on the App StoreGet it on Google Play

Related guides

Food price inflation: what it measures and how to read itUnit price: how to compare packs of different sizes in a shopShrinkflation: how to calculate a smaller pack at the same price