#940 1991 · Billboard (with Nielsen SoundScan) · Music publishing / trade press
Billboard swapped phone-survey opinions for barcode scans and found decades of hidden hits
the problem
Billboard's charts came from phone calls to store managers, gamed by labels and blind to genres never asked about
background
Before 1991, Billboard compiled its influential album and singles charts by having staff telephone a sample of record store managers and ask what had sold best that week, a method built entirely on memory, guesswork, and whatever the manager felt like reporting. Record labels understood exactly how soft that data collection was and courted the retailers who filed those reports — gifts of refrigerators and microwaves in exchange for favorable store reports were part of the informal economy around chart placement — while stores serving country, hip-hop and hard-rock audiences, genres viewed as niche by the mostly pop-focused reporting panel, were frequently left off the sample altogether.
The chart was supposed to measure what America was actually buying, but it was structurally built to measure what a small, unrepresentative, persuadable set of store managers said America was buying — which meant entire genres with real commercial audiences could sell enormous numbers of records and never crack a national top ten, because nobody serving those audiences was ever asked.
what everyone would do
Billboard could have tried to expand or diversify its phone-survey panel, audit store managers for honesty, or simply defend the existing chart's credibility as the industry standard — all of which left the fundamental flaw in place, since even an honest, well-intentioned store manager reporting from memory is still reporting an opinion, not a count.
what they saw
Billboard's chart measured opinions about sales, not sales. Its old panel asked store managers what sold; SoundScan counted barcode scans instead, and country and hip-hop turned out to be huge all along.
the move
Starting in May 1991, Billboard replaced the phone-survey methodology with Nielsen SoundScan, which paid retailers to install point-of-sale barcode scanners and tabulated the actual number of units scanned at checkout nationwide, removing human reporting from the chart entirely.
why it works
Self-reported data is vulnerable everywhere a reporter's incentives or biases diverge from the truth, and record store managers had every reason — free appliances, personal taste, incomplete memory — to diverge from what actually crossed the register. Point-of-sale scanning collapsed that gap to zero by recording the transaction itself rather than someone's account of it, and because scanning covered stores of every kind, including Walmart and rural chains the old panel skipped, it also fixed a sampling bias that had nothing to do with dishonesty at all.
the payoff
N.W.A and Skid Row both debuted at number one in SoundScan's first month — genres the old phone-survey chart had undercounted for decades.
where it breaks
The fix only works where a real, countable transaction exists to substitute for the opinion — genres or channels with no equivalent scan point, like mixtapes or early illegal downloads, remained invisible to SoundScan exactly as they'd been invisible to the phone survey. It also requires retailers willing to install and pay for the tracking infrastructure; SoundScan's accuracy was only as complete as its retailer adoption, and gaps in that adoption created their own, smaller blind spots for years after 1991.
what came after
SoundScan permanently changed which genres labels invested promotion dollars in — country and hip-hop, revealed almost overnight to have far larger buying audiences than the old chart implied, saw budgets and radio attention scale up to match real demand, reshaping the commercial map of American popular music through the 1990s; the point-of-sale principle SoundScan proved later became the template streaming-era chart methodologies were built on.
references
- [1]How SoundScan Changed Music Charts in 1991Billboard, 2021billboard.com
- [2]How the SoundScan Era Rocked the Music IndustryUltimate Classic Rock, 2016ultimateclassicrock.com