Skip to Main Content

AFS 201

A Library Research Guide for AFS 201

Peer-Review, Trustworthy, Scholarly?

A large part of the research process is evaluating the resources that you find. This evaluation might include questions such as 'is this resource scholarly?' and 'can I trust this author?'

To make such judgements, it is important to understand a few simple concepts and terms.

Peer-reviewed research is also called scholarly or refereed  research. In short, peer-review is a gate keeping process where scholars in a particular field evaluate a research paper to determine if it is sound in its methodology and conclusion. 

Authoritative resources are trustworthy but not necessarily peer-reviewed. They can come in many forms including government reports, some popular press, certain extension resources, etc. To determine if a source is credible, it is important to evaluate what sort of knowledge the author has on the topic and their incentives for producing the research.

Below are some ways to determine if a source is scholarly and/or authoritative.

Determining if a Journal Is Peer-Reviewed:

Peer-review refers to a scholarly publishing process where authors who are doing research submit a paper they have written to a journal. The journal editor then sends the article to the other scholars who are knowledgeable of the research field. Those reviewers determine if that article should be published based on the quality of the research, the validity of the data, the conclusions the authors' draw, and the originality of the research. Typically the names of the author(s) and reviewers are kept private.

 

Note: Determining if an article is peer-reviewed can occasionally be confusing. Not everything published within a peer-reviewed journal is necessarily peer-reviewed. For example, peer-reviewed journals might have book reviews or editorials within them (that may not be peer-reviewed). When in doubt, ask your instructor or a librarian.

 

How to Determine if a Journal is Peer-Reviewed

Method #1

Look in the WSU Libraries' Catalog 

The WSU Libraries' catalog (Search It) will display a peer-reviewed tag if an article or journal is peer-reviewed.

WSU Libraries' Peer Review Tag Display

 

 

Method #2

Check the Publisher's Website

Typically the journal website will have information regarding whether it is a peer reviewed publication. That info is generally found in an "About" section.

 

Homepage of a typical scholarly journal

 

Information on the journal website stating that the journal is peer-reviewed

 

Method #3

Search the Ulrich's Directory

Ulrich's Directory is a directory of journals which provides information regarding if a journal is peer-reviewed, open access, its place of publication, etc. 

Peer-Reviewed journals in Ulrich's will have a referee icon next to the title if the journal is peer-reviewed, like in the picture below:

Ulrich's search interface

 

This video was created by the Walden Libraries and explains how to search Ulrich's to see if a journal is peer-reviewed. 

 

Method #4

Email me and I'll take a look at the publication. You can email me using this link (my contacts are in the upper left side of the page) .

 

The CRAP Test (for evaluating resources)

Is your resource trustworthy? Is it peer reviewed?

To find out the if a research article is trustworthy and peer reviewed I utilize the CRAP Test (see below). If you are interested in learning if an article is peer-reviewed follow this link.

 

CRAP Test

You can evaluate the trustworthiness of a resource by utilizing the CRAP Test. CRAP is an acronym that will help you determine the reliability  of the research you found. 

This video was created by UTS Libraries (Australia) and assists with utilizing the CRAP Test.

Currency (the timeliness of the information)
● How recent is the information? 
● When was the information published or last updated?
● Have newer articles been published on your topic?
● Is your topic in an area that changes rapidly, like technology, health, science or popular
culture?


Relevance or Reliability (the accuracy of the information)
● Are there statements you know to be false? ? Is the article based on transparent on facts and statistics? Is the language scholarly?
● Was the information reviewed by editors or subject experts before it was published?
● What citations or references support the author’s claims?
● What do other people say about the topic?


Authority (the source of the information )
● Who is the author/publisher/source/sponsor of the source? Are they reputable?
● What are the author’s credentials or organizational affiliations?
● Is the author qualified to write on the topic?

 

Purpose ( the reason the information exists)
Is the purpose of the source to sell, persuade, entertain or inform?
● Are there political, ideological, cultural, religious, institutional or personal biases?
● Are alternative points of view presented?
● Does the author use strong or emotional language?

The SIFT Method (for evaluating resources)

There are many different tests used for evaluating an article or website that you've found online. I think SIFT, developed by WSU Vancouver's Mike Caulfield is the best for it's simplicity and usefulness. 

The key to SIFT is reconstructing the necessary context to so as to read, view, or listen to digital content effectively.

 

Logo indicating steps of SIFT method

The following information was taken from Mike Caulfield's Sift - The Four Moves

 

 

Logo for Stop Stop  

When you first arrive at a webpage, article, etc. ask yourself whether you know the website or source of the information, and what the reputation of both the claim and the website is. If you don’t have that information, use "lateral moves" to get a sense of what you’re looking at. This means doing exploration, perhaps in another browser window, before you read the resource that you found.

Don’t read it or share media until you know what it is.

If you are doing scholarly research, you will probably want to chase down individual claims in an article and independently verify them. If you just want to repost, read an interesting story, or get a high-level explanation of a concept, it’s probably good enough to find out whether the publication is reputable.

Please keep in mind that both sorts of investigations are equally useful. Quick and shallow investigations will form most of what we do on the web. We get quicker with the simple stuff in part so we can spend more time on the stuff that matters to us. But in either case, stopping periodically and reevaluating our reaction or search strategy is key.

Tip 1:  After you begin to use the lateral moves it can be easy to go down a rabbit hole, going off on tangents only distantly related to your original task. If you feel yourself getting overwhelmed in your fact-checking efforts, STOP and take a second to remember your purpose.

Tip 2: Want to learn more about "lateral reading" as it relates to media literacy. Take a look at WSU Vancouver's Mike Caulfield's short book "Web literacy for student fact-checkers (and other people who care about facts."

 

Logo for investigate the source Investigate the Source

The key idea here is to know what you're reading *before* you read it.

This doesn't mean you have to do a Pulitzer prize-winning investigation into a source before you engage with it. But if you're reading a piece on economics by a Nobel prize-winning economist, you should know that before you read it. Conversely, if you're watching a video on the many benefits of milk consumption that was put out by the dairy industry, you probably want to know that as well. All of this will assist you in contextualizing the information that you're reading.

This doesn't mean the Nobel economist will always be right and that the dairy industry shouldn't be trusted. But knowing the expertise and agenda of the source is crucial to your interpretation of what they say. Taking sixty seconds to figure out where it is from *before* reading will help you decide if it is worth your time, and if it is, help you to better understand its significance and trustworthiness.

 

Logo for find better coverage Find Better Coverage 

Sometimes you don’t care about the particular article or video that reaches you. You care about the claim the article is making. You want to know if it is true or false. You want to know if it represents a consensus viewpoint, or if it is the subject of much disagreement.

In this case, your best strategy may be to ignore the source that reached you, and look for trusted reporting or analysis on the claim. If you get an article that says koalas have just been declared extinct from the Save the Koalas Foundation, your best bet might not be to investigate the source, but to go out and find the best source you can on this topic, or, just as importantly, to scan multiple sources and see what the expert consensus seems to be. In these cases we encourage you to “find other coverage” that better suits your needs — more trusted, more in-depth, or maybe just more varied. In lesson two we’ll show you some techniques to do this sort of thing very quickly.

Do you have to agree with the consensus once you find it? Absolutely not! But understanding the context and history of a claim will help you better evaluate it and form a starting point for future investigation.

 

Logo for trace claims Trace claims, quotes, and media back to the original context

Much of what we find on the internet has been stripped of context. Maybe there’s a picture that seems real but the caption could be misleading. Maybe a claim is made about a new medical treatment based on a research finding — but you’re not certain if the cited research paper really said that.

In these cases you have to trace the claim, quote, or media back to the source, so you can see it in it’s original context and get a sense if the version you saw was accurately presented.

 

Caulfield, M. (2019, October 19). SIFT (The Four Moves). https://hapgood.us/2019/06/19/sift-the-four-moves/

WSU Libraries, PO Box 645610, Washington State University, Pullman WA 99164-5610, 509-335-9671, Contact Us