Does the NSCA have a Responsibility to Publish Accurate Information?

a9d78c65721852a_619751

As most of our readers know, last year the NSCA published a study on CrossFit that included fabricated injury data. CrossFit has since sued the NSCA, and an official response from the NSCA highlights their strategy of defense:

At the center of the lawsuit is a research article published in NSCA’s Journal of Strength and Conditioning Research. As with all research published in NSCA’s journals, the article in question was authored by independent researchers and was accepted for publication following a rigorous peer-review process. While NSCA has no opinion on the validity or invalidity of claims made in the article or the criticisms of same being leveled by CrossFit, NSCA has full confidence that the review and publication processes for research published in NSCA journals is beyond reproach.

In other words, the NSCA claims it didn’t do anything wrong by publishing the fraudulent study, because they followed a “rigorous peer-review process” prior to deciding to publish the article. But they received serious allegations of scientific misconduct after completing the peer-review process, and failed to investigate these allegations. Did the NSCA’s responsibility for verifying accuracy and preventing scientific misconduct end when the peer-review process finished?

The NSCA also denies that they were made aware of my allegations that the study data was fabricated. This is demonstrably false, as I have email records and phone records showing I emailed the NSCA and spoke at length with the JSCR’s Editor-in-Chief Dr. William Kraemer about this very issue before the study was officially published.

nsscomic1I decided to do some formal research into the published ethical responsibilities of peer-reviewed journals. I specifically focused on the areas of editor responsibility regarding allegations of scientific misconduct. Virtually every authoritative body I found, from the Office of Research Integrity to the Council of Science Editors, agree that it is the responsibility of a Journal and its editors to appropriately investigate allegations. What follows is a series of quotations from these sources to support this point.

The JSCR has a responsibility to investigate allegations of scientific misconduct, and they failed to do so in this case. 

“In 1989, the US Public Health Service (PHS) published a definition of scientific misconduct as fabrication, falsification, plagiarism, or other serious deviations from the scientific norm. Detection lies in the hands of editors, peer reviewers, coauthors, and readers.” (source)

“Journals are not usually in a position to investigate misconduct allegations themselves, but editors have a responsibility to alert appropriate bodies (for example, employers, funders, regulatory authorities) and encourage them to investigate.” (source)

“Editors should pursue cases of suspected misconduct that become apparent during the peer-review and publication processes, to the extent and in the ways defined in this document in the ‘Promoting research integrity’ section (p. 4). Editors should first work with the authors, the journal owners and/or the journal publishers (at Blackwell Publishing this is via the Journal Publishing Manager), referring to information from the Committee on Publication Ethics (COPE), the Council of Science Editors (CSE), or another appropriate body if further advice is needed.” (source)

“The role editors should play in responding to scientific misconduct has been articulated by their colleagues, asserted by two national reports, and demonstrated by the scientific misconduct allegations investigated by institutions and the Office of Research Integrity (ORI)…. According to the International Committee of Medical Journal Editors (ICMJE), editors have a responsibility to pursue possible scientific misconduct in manuscripts submitted to or published in their journals and to publish a retraction of any fraudulent paper published in their journals. However, editors are not responsible for conducting a full investigation or deciding whether scientific misconduct occurred. Those responsibilities rest with the institution where the work was conducted or with the funding agency.” (source)

“Editors are unavoidably involved in the effort being made by institutions and PHS to respond to allegations of scientific misconduct. Editors are not required to investigate allegations of scientific misconduct, but they do have a responsibility to ensure that significant suspicions are reported to those able to conduct inquiries and investigations. Their responsibility has been articulated by their colleagues, prescribed by two national reports, and validated by the handling of scientific misconduct cases since 1992.”(source)

When allegations and/or findings of misconduct are presented, the editor will be faced with some level of responsibility for investigating, judging, and/or penalizing the author for these lapses. The Council of Science Editors recommends that each journal articulates a specific policy on the editor’s responsibility for notifying an author’s institution of failure to comply with the journal’s ethical standards. (source)

Under “Editor Roles and Responsibilities

“Describing, implementing, and regularly reviewing policies for handling ethical issues and allegations or findings of misconduct by authors and anyone involved in the peer review process.”

“Editors have a duty to act if they suspect misconduct or if an allegation of misconduct is brought to them. This duty extends to both published and unpublished papers… Editors should make all reasonable efforts to ensure that a proper investigation into alleged misconduct is conducted; if this does not happen, editors should make all reasonable attempts to persist in obtaining a resolution to the problem. This is an onerous but important duty.” (source)

The JSCR has a responsibility to ensure accuracy of published materials, and failed to do so in this case

“Journal editors have a responsibility to ensure the accuracy of the material they publish” (source)

“Editors should be accountable for everything published in their journals.” (source)

“Errors, inaccurate or misleading statements must be corrected promptly and with due prominence.” (source)

The JSCR has a responsibility to encourage discussion, objection, and allegations of error, and failed to do so. 

“Journals should encourage authors and readers to inform them if they discover errors in published work.” (source)

Journals should develop a consistent policy to encourage the reporting of indications of misconduct, for evaluating the allegations, and for handling the findings. Journals should include a general statement in their Instructions for Authors that allegations of misconduct will be pursued. (source)

“Editors should encourage and be willing to consider cogent criticisms of work published in their journal.” (source)

10 comments

  1. John Weatherly

    Many times I have pointed out studies on vibration published in JSCR that did not test vibration platforms for reliability or did not report the reliability of the platforms in the studies that were published. Researchers apparently just “trusted the manufacturer” that “30 HZ and 4 mm amplitude” was “30 Hz and 4 mm amplitude” in unloaded and loaded conditions. Well, I know of two individuals (one a research scientist) that tested a certain well-known brand of vibration platform and found it bogged down around 85 kg and really bogged down at loads around 100 kg or more. And these people are on different continents and they found the same thing on the same brand of vibration platform. I’ve mentioned this for years and the NSCA has not retracted vibration studies. They do not care. Can you tell me how “research scientists” (these are supposedly PhDs folks) could be so dumb or lazy to conduct research studies on vibration equipment and not even test the reliability and validity of the equipment settings before conducting and publishing studies? Can you tell me how reviewers for JSCR could “miss elephants in the room” like these and accept this type of work for publication? And, after the mistakes have been pointed out, why the NSCA has not retracted the studies that were published on vibration that did not report reliability of the vibration platforms?

  2. Eric

    Let’s be clear – there were no concerns raised by an independent researcher, the concerns were raised by CrossFit who was cast in a negative light by the research.
    Want to solve this problem easily – allow independent researchers access to CrossFit’s records but you won’t do that because CrossFit HQ does not want to accept the truth – that they are the main problem with CrossFit and are unwilling to accept any ideas that differ from their thinking which is why so many respected experts have tried to help CrossFit and quit or where fired.
    If Crossfit doesn’t have an injury problem why are the boxes required to self-insure? Why is Rhombo a well known term in CrossFit but most Dr have never seen it? Maybe a one weekend course isn’t sufficient to open a franchise?

      • Eric

        Rhombo is a well known term within the CrossFit community, maybe you should look at the Crossfit message boards. And I’m sorry, you don’t have franchises, you have affiliates. Good job not addressing any of the points like how it’s a joke someone can open a box after taking a one weekend course or that of course CrossFit has a problem with an article against them

      • Eric

        Hmm, the article is about the NCSA publishing incorrect injury rate information so maybe that?? Please pull your head out of the koolaid, stop worshipping Greg Glassman and realize the truth, CrossFit has serious issues and the current people running the show are the main cause of these issues.

  3. Matthew Zalewski

    More Research on the injury rate of Crossfit will occur as the growth of the company, it’s affiliates, and those affiliates’ membership base grows. I see the importance of protecting the brand against blanket injury reports for general CVFMHI exercising, particularly when the term CrossFit is used as a synonym for the overarching methodology (which is mimicked and directly copied). But, the reality is the need to protect “Crossfit” won’t end, and will likely get worse, because people use the term Crossfit to describe CVFMHI the way others use iPod to describe MP3 players.

    Since I’ve started Crossfit I’ve ruptured my left pectoralis tendon twice, and torn the right one once. I debate every day whether I should ever return to Crossfit. I blame genetics as much as I blame the intensity and volume of Crossfit itself for what is otherwise a very rare occurrence.

    Would I have torn tendons if I continued traditional weightlifting? Probably. Will I monitor and modify the hell out of WODs in order to continue to train in a Crossfit gym? Definitely.

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: