Jewish World Review March 26, 2004 / 4 Nissan 5764

Wendy McElroy

Wendy McElroy
JWR's Pundits
World Editorial
Cartoon Showcase

Mallard Fillmore

Michael Barone
Mona Charen
Linda Chavez
Ann Coulter
Greg Crosby
Larry Elder
Don Feder
Suzanne Fields
James Glassman
Paul Greenberg
Bob Greene
Betsy Hart
Nat Hentoff
David Horowitz
Marianne Jennings
Michael Kelly
Mort Kondracke
Ch. Krauthammer
Lawrence Kudlow
Dr. Laura
John Leo
Michelle Malkin
Jackie Mason
Chris Matthews
Michael Medved
Kathleen Parker
Wes Pruden
Sam Schulman
Amity Shlaes
Roger Simon
Tony Snow
Thomas Sowell
Cal Thomas
Jonathan S. Tobin
Ben Wattenberg
George Will
Bruce Williams
Walter Williams
Mort Zuckerman

Consumer Reports

Reading between the numbers | Last week, sociologist Dr. Ellie Lee cast doubt upon the increasingly popular theory that postnatal depression affects as many as one in five new mothers, telling the BBC that the research underlying that claim is "wrong."

"According to 'experts,' growing numbers of women are traumatized by childbirth and are not capable of child-rearing without professional help," Lee said, prompting a much larger question than the mental status of post-natal women:

How can we trust research?

The question is not trivial, since studies and statistics form the basis for many of the laws under which we live. If they are wrong, then the laws may be as well.

Short of taking a course on statistics and poring over data, the best way to get a sense of which data to trust is through common sense. There are five questions you should demand of any statistic.

Who Says So? The purpose of this question is to discover possible bias on the part of those offering the data. The bias may be conscious -- such as research conducted expressly to win a government grant. The bias may be unconscious -- such as research conducted by those who have deep ideological convictions that influence the questions asked.

Bias does not invalidate findings. Just because a researcher seeks funds or has a personal opinion doesn't mean his finding that 2+2=4 is false. But it does mean you should look at the math more closely.

How Does He Know? Imagine a researcher who rang doorbells at random to ask, "Are you a criminal" or "Do you suffer stomach gas often?" That researcher might discover the world to be both crime and gas-free -- not because it actually is, but because many people will not admit to either. One of the most common methodological mistakes is to rely upon an unrepresentative sampling, such as polling only Baptists or limiting your sample to 10 people.

Donate to JWR

"Seventy-five percent of Americans prefer milk to lemonade" is an impressive finding until you realize that only 12 people were sampled, all of whom were Wisconsin dairy farmers. At that point, the surprising statistic is that 25 percent preferred lemonade. Demand to know the exact question asked or studied, the size of the sampling and whether it was random.

What does the competition say? Many studies contradict past findings or constitute "surprising revelations." It could be that past or competing studies were flawed; times may have changed. Data, like opinions, can vary and a finding that "eating cheese increases your chance of cancer by 12 percent" should be considered in light of past or current studies that render different results. It is possible for a multitude of small surveys to be conducted until one of them produces the desired results.

For example, after tossing a coin many times, it will land "heads up" nine times in a row. From that isolated experience, a researcher could conclude that a tossed penny will come up heads 90 percent of the time. Do other findings contradict him?

What is missing? Does the data tell you enough to evaluate its statements? Consider the statement, "the average salary at this company is $30,000 a year." Ninety percent of employees may make much less than that amount but, when total incomes are divided by total employees, $30,000 may be the "mean" result. A "median" result reflects what the person at the exact middle of the earning range takes home. The "mode" is nothing more than the most frequently encountered figure. Does the figure $30,000 indicate a mode, a median or a mean?

Did Someone Change the Subject? A newscaster states, "reports of domestic violence have increased" and concludes that "domestic violence is on the rise." This conclusion is not justified because the increased reporting may reflect nothing more than a greater willingness on the part of women to contact the police or a greater willingness of police to file the reports. The newscaster has changed the subject from increased reporting to increased incidents.

Does It Make Sense? Never allow a statistical finding to override common sense or your own perceptions: guesstimate. That technique involves taking a statistic to its logical conclusion and seeing if it reduces to absurdity. Consider the alarming statement, "over 3,000,000 teenage girls on welfare became pregnant this year."

Start with the total population of the U.S. -- roughly 300 million. Assume that roughly half are male, leaving 150 million. Assume a uniform female age-spread of one to 75 years, with teenagers (13-19) constituting approximately 9.3 percent, or 14 million. Assume every teenage girl can become pregnant. Divide this figure by the reportedly three million pregnant welfare teens and the ratio you get is 4.67. One in five teenage girls is not only on welfare but has also become pregnant in the last year. Does this make sense, does it accord with your own perceptions?

The research on postnatal depression may or may not be valid. Lee accuses its advocates of constructing a problem, of "medicalizing motherhood." Lee states, "There is every possibility that ... parents will come to experience the normal disruption that parenting brings with it, as highly disabling, and find themselves less able to manage ... This risks branding an essential part of life a hazard."

Our society rewards those who construct problems. They receive financing and media attention, write books and become "experts." Statistics are tools and those who wield them should be neither glamorized nor ignored. But they should be required to answer basic questions before being included in that rare category: purveyor of truth.

Every weekday publishes what many in Washington and in the media consider "must reading." Sign up for the daily JWR update. It's free. Just click here.

JWR contributor Wendy McElroy is the editor of She also edited Freedom, Feminism, and the State (Independent Institute, 1999) and Sexual Correctness: The Gender Feminist Attack on Women (McFarland, 1996). She lives with her husband in Canada. Comment by clicking here.


03/11/04: When ‘mother’ is a bureaucracy
03/04/04: Do Gun Control Activists Pad Gun Death Statistics?
02/26/04: The Separation of School and State
01/21/04: A Man's (and Woman's) Home Is a Castle
12/17/04: The Conservative Cookie Rebellion
11/26/03: Zero Patience for Zero Tolerance
10/22/03: Killing the Good Samaritan
10/08/03: Collective western guilt burdens today's children
10/01/03: Families pay price for government spending
09/24/03: Do Poor Fathers Deserve Debtors' Prison?
08/29/03: Going to extremes
08/23/03: The Marriage Strike
07/30/03: University Students Deserve Human Rights
07/09/03: The PCspeak of Diversity
07/02/03: Rebuttable presumption of joint custody
06/18/03: A Conscientious Objector to the Gender War
06/04/03: Gender issues impacted by masculinists
05/28/03: The value of error
05/21/03: U.S. to Fund Gender Feminism in Africa?
05/14/03: Cut men: Do they not bleed?
05/07/03: Women with guns fight back
04/30/03: No oil for food
04/28/03: The Great Lie
04/16/03: War may redefine gun control
04/09/03: Why we must discuss a post-war U.S.
04/02/03: Leftist feminists using war as podium
03/26/03: Laying down 'the white woman's burden'
03/19/03: Iraq War may kill feminism as we know it
03/13/03: A woman to replace Saddam
02/19/03: Elder abuse demands family solutions
02/13/03: Iraqi women brutalized by Saddam
01/29/03: There ought not to be a law
01/22/03: Gambling with race and gender cards
01/02/03: The future of fatherhood
12/26/02: U.N. complicit in forced sterilizations
12/20/02: Compassion, kindness killed by fear, paranoia
12/11/02: Affirmative action insults immigrant contributions
12/04/02: Stand up for yourself
11/27/02: Feminist fighting: Aren't we all women?
11/20/02: Rights & responsibilities
11/14/02: Feminist "urban legends"
11/06/02: Equal access does not guarantee equal outcome
10/24/02: Battered Women's Syndrome: Science or sham?
10/17/02: I demand a civil society that respects the individual and acknowledges the existence of honest disagreement between human beings of good will
10/09/02: Abortion debate is about to be ratcheted up yet again
10/02/02: 'Restorative justice' offers battered women more options
09/25/02: Why is prez promising to embrace UN radical social engineering programs?
09/18/02: Dirty dealings kill men's panel
09/11/02: Taking back your power
09/05/02: Calm down, Hootie!
08/21/02: Will Congress empower a group of radical feminists to oversee money slated for Afghan women?
08/14/02: Empower the U.N. with power to sculpt American laws and institutions into the image of gender feminism!?
08/01/02: Practicing 'intellectual virtue'
07/24/02: All male, bad. All female, good: Your tax dollars at work
07/11/02: Put Up or Shut Up
07/03/02: NOW they've done it, again!
06/19/02: A dark cloud shades U.N. Women's Treaty
06/10/02: This Father's Day, send justice
05/31/02: When good women do nothing
05/28/02: Feminists claiming motherhood as liberal cause
05/20/02: Wounds in health care system are self-inflicted: Or, why "my son the lawyer" makes more sense
05/10/02: Are parents boycotting public schools?
05/03/02: Women can't be gun-shy about defense
04/25/02: The Bill of Intellectual Rights
04/19/02: World Bank or World Government?: The World Bank is blackmailing impoverished nations
04/12/02: Victims From Birth: Engineering Defects in Helpless Children Crosses the Line
04/05/02: The professor made me cry, now I will make him pay!
03/31/02: Doctors and teens --- parents be on guard
03/22/02: I was born, now I'm suing you!
03/15/02: The 21st Century is knocking at the barricaded door of feminism
03/08/02: Fun and games at the Ms mag Bulletin Board
03/01/02: Andrea Yates, NOW, and Feminist Jurisprudence
02/22/02: Lady, Your Slip is Showing
02/14/02: 'Abusing' Valentine's Day
02/11/02: Is NOW Pro-Choice or Pro-Abortion?
02/01/02: Are 'fathers' rights' a factor in male suicide?
01/25/02: Is the U.N. Running Brothels in Bosnia?
01/18/02: 'Freedom' at another's (moral) expense
01/11/02: Feminists hit Ground Zero with WTC funds grab
01/04/02: Males winning "diversity discrimination" cases is good?
12/21/01: Good will toward men
12/14/01: "Boss Tweed" feminism
12/07/01: Call me 'anti-woman'

© 2001, Wendy McElroy