Explore The NRA Universe Of Websites

APPEARS IN News

New York Times Resurrects Flawed Study

Friday, April 5, 2019

New York Times Resurrects Flawed Study

Bad anti-gun research, and the sensationalist journalism that often accompanies it, provide unending opportunities for the most used (overused?) of all firearm themes: Zombies. Just when you think the thing is gone for good, it appears again.

Such was the case with a study we deconstructed last summer, “The Association of Firearm Caliber With Likelihood of Death From Gunshot Injury in Criminal Assaults.” Coverage of the research was revived by the New York Times in an article published on March 27, 2019. In the Times piece, writers Margot Sanger-Katz and Quoctrung Bui recounted the inquiry by Profs. Anthony Braga and Phillip Cook (Northeastern University and Duke University, respectively):

In Boston from 2010 to 2015, there were 221 gun homicides.

Research suggests that one change could have lowered that number by 40 percent: smaller bullets.

A study last year, published in JAMA Network Open, examined the type of weapon used in every fatal and nonfatal shooting in the city. It found that — regardless of the time of day, the number of wounds or the circumstances of the crime — the size of the bullet affected which gunshot victims lived and which ones died.

The research was better summarized, however, by NRA-ILA’s August 2018 headline: “Government-funded Researchers Discover Basic Ballistics.”

That’s right, larger-caliber firearms generally deliver a more powerful payload. Hard to imagine, but somehow the study’s authors – echoed by the Times – made the leap from that fact, confirmed by statistical analysis of shooting incidents in Boston (the study’s geographic focus), to the conclusion that prohibiting the technology- and market-based diffusion of larger-caliber semiautomatic handguns in the 1990s would have resulted in fewer deaths by shooting. Braga and Cook (2018, p. 7) stated, “the implication is that if the medium- and large-caliber guns had been replaced with small caliber (assuming everything else unchanged), the result would have been a 39.5% reduction in gun homicides.”

And, continuing to an ad absurdum conclusion, the authors hypothesized, “it is plausible that larger reductions would be associated with replacing all types of guns with knives or clubs” (emphasis added). So much for advocating for “reasonable restrictions” on guns.

The authors, of course, quickly dismiss that it is gun control measures on “Saturday Night Specials” (small, usually low caliber handguns) that likely led to an increase in the number larger caliber handguns used in crime. It’s inconvenient when your “study” that is supposed to advocate for gun control reveals the flaws of past gun control measures.

When studying firearm lethality, it helps to have even a passing knowledge of the things you claim to be studying. Authors who claim to study the relationship between handgun caliber and shooting fatality should have known better than to include in their analysis a case in which the victim was shot with a 7.62 x 39mm round.

And, even the most novice gun owners understand that caliber (and really cartridge) selection is a matter of trade-offs. All else being equal, larger caliber firearms usually result in greater recoil and less capacity. Braga and Cook should probably tell the most data-driven federal law enforcement agency that its decision to reduce the caliber of its standard service pistol is going to make its agents less effective gunfighters. 

Lack of basic firearms knowledge aside, there is potentially a more fundamental weakness with the analysis. First, a summary:

Braga and Cook (2018) assessed the relationship between characteristics of the victim (e.g., demographics, prior arraignments), circumstances of the crime (e.g., indoor vs. outdoor), and caliber used. The intent of this portion of the research was to determine whether caliber was a random variable – i.e., independent of other characteristics of the shooting – or whether it was related systematically to those characteristics. (For example, one hypothesized relationship might be that gang-related shootings consistently involved the use of large-caliber firearms.) Findings indicated no statistically significant relationships between those measured situational variables and firearm caliber, lending support to the idea that shooters’ choice of round size was independent of any characteristics of the crime or the criminal.

The key analysis was a regression to test the effect of gun caliber – not cartridge, bullet weight, projectile design, or other theoretically relevant elements – on whether or not a victim lived or died. Results showed that, “relative to shootings involving small-caliber firearms … the odds of death if the gun was a large caliber were 4.5 times higher and, if medium caliber, 2.3 times higher” (Braga & Cook, 2018, p. 6). Covariates (i.e., control variables) including victim gender, race, age, and prior arraignments all lacked statistical significance. (As mentioned earlier, indoor location did significantly boost the odds of a fatality.)

That all makes sense. As we observed in our prior critique of the study, those are “findings obvious to any middle school physics student.” But the potential weakness teased above involves control variables that the researchers did not include in the test between caliber and likelihood of fatality: the number of wounds and their location. Intuitively, one would suppose that more bullet wounds, and in more serious locations, would generally increase the potential for a fatality. And, as discussed, the researchers noted significant relationships between those variables and fatalities.

So, why didn’t the researchers attempt to control for the number of wounds and their location while measuring the association between caliber and fatality? Why did the Times writers misstate the study conclusions in this regard?

We don’t know, and we also don’t know for certain whether those factors would have mitigated the significance of the caliber-fatality connection. What we do know, however, is that you can’t answer questions that aren’t asked. And, if someone aimed to demonstrate that replacing large-caliber guns with smaller calibers would result in fewer fatalities – which the Braga and Cook (2018) model did do – including covariates that might mitigate the association probably would not be the best thing.

As even casual consumers of undead cinema know, shot placement, not caliber, is king.

TRENDING NOW
U.S. Senate Adds Pro-Gun Tax Relief Language Back into Reconciliation Bill

News  

Saturday, June 28, 2025

U.S. Senate Adds Pro-Gun Tax Relief Language Back into Reconciliation Bill

Overnight, the U.S. Senate added pro-gun tax relief language back into the Reconciliation bill after the Senate Parliamentarian struck out an earlier provision.  While this new provision is not as expansive as the language we advocated for which ...

U.S. Senate Forced to Remove Pro-Gun Language from Reconciliation Bill

News  

Friday, June 27, 2025

U.S. Senate Forced to Remove Pro-Gun Language from Reconciliation Bill

Today, the U.S. Senate was forced to remove the pro-gun language that had been previously included in the Reconciliation Bill currently making its way through the chamber. We explained in a previous article that this language would, ...

One Big Beautiful Bill Clears Senate, and Heads Back to House

News  

Tuesday, July 1, 2025

One Big Beautiful Bill Clears Senate, and Heads Back to House

Earlier today the U.S. Senate passed the “One Big Beautiful Bill.” This bill contained a provision that would, among other things, eliminate the burdensome $200 excise tax imposed by federal law on suppressors, short-barreled firearms, and “any ...

U.S. House Passes Reconciliation Bill, Removing Suppressors from the National Firearms Act

News  

Second Amendment  

Thursday, May 22, 2025

U.S. House Passes Reconciliation Bill, Removing Suppressors from the National Firearms Act

Earlier today, the U.S. House of Representatives passed H.R.1 the One Big Beautiful Bill Act, which included Section 2 of the Hearing Protection Act, completely removing suppressors from the National Firearms Act (NFA).

Armed Churchgoers Prevent Mass Attack as State Lawmakers Plot More Gun Control

News  

Monday, June 30, 2025

Armed Churchgoers Prevent Mass Attack as State Lawmakers Plot More Gun Control

Just over an hour away from the state capitol in Lansing, Michigan – even as lawmakers worked feverishly to pass various gun control measures, including expansion of “gun free” zones – a chilling reminder unfolded of the ...

Urge the U.S. Senate to Pass the One Big Beautiful Bill – Contact Your U.S. Senators Today!

News  

Monday, June 30, 2025

Urge the U.S. Senate to Pass the One Big Beautiful Bill – Contact Your U.S. Senators Today!

The U.S. Senate has cleared a number of procedural hurdles and is preparing to vote on the One Big Beautiful Bill. This vote will likely come within the next day. The One Big Beautiful Bill includes ...

Canada’s Big Ugly Gun Grab: An Update

News  

Monday, June 30, 2025

Canada’s Big Ugly Gun Grab: An Update

Canada’s Liberal government is pressing on with its harebrained gun ban and confiscation program for “assault style weapons,” but, true to form and precedents, it has been far from smooth sailing.

U.S. Court of Appeals Backtracks on Adverse Suppressor Ruling

News  

Monday, June 23, 2025

U.S. Court of Appeals Backtracks on Adverse Suppressor Ruling

In a single sentence, the U.S. Court of Appeals for the Fifth Circuit added to the high-profile and consequential national conversation on firearm suppressors.

North Carolina: Update on Gun Bills Moving through the General Assembly

Tuesday, June 24, 2025

North Carolina: Update on Gun Bills Moving through the General Assembly

Recently, House Bill 193 (H193) was reported favorably out of both the Senate Judiciary Committee and the Senate Rules Committee, with amendments.

News  

Second Amendment  

Friday, June 27, 2025

Joint Statement from Pro-Gun Groups on the Senate Reconciliation Bill

On behalf of millions of NRA members and gun owners, we stand united in calling on Congress to uphold Americans' Second Amendment rights and zero out the NFA's excise tax on suppressors and short-barreled firearms.

MORE TRENDING +
LESS TRENDING -

More Like This From Around The NRA

NRA ILA

Established in 1975, the Institute for Legislative Action (ILA) is the "lobbying" arm of the National Rifle Association of America. ILA is responsible for preserving the right of all law-abiding individuals in the legislative, political, and legal arenas, to purchase, possess and use firearms for legitimate purposes as guaranteed by the Second Amendment to the U.S. Constitution.