Banner

Research Paper: A step-by-step guide: 7. Evaluating Sources

  • 1. Getting Started
  • 2. Topic Ideas
  • 3. Thesis Statement & Outline
  • 4. Appropriate Sources
  • 5. Search Techniques
  • 6. Taking Notes & Documenting Sources
  • 7. Evaluating Sources
  • 8. Citations & Plagiarism
  • 9. Writing Your Research Paper

alt=" "

Evaluation Criteria

It's very important to evaluate the materials you find to make sure they are appropriate for a research paper.  It's not enough that the information is relevant; it must also be credible.  You will want to find more than enough resources, so that you can pick and choose the best for your paper.   Here are some helpful criteria you can apply to the information you find:

C urrency :

  • When was the information published?
  • Is the source out-of-date for the topic? 
  • Are there new discoveries or important events since the publication date?

R elevancy:

  • How is the information related to your argument? 
  • Is the information too advanced or too simple? 
  • Is the audience focus appropriate for a research paper? 
  • Are there better sources elsewhere?

A uthority :

  • Who is the author? 
  • What is the author's credential in the related field? 
  • Is the publisher well-known in the field? 
  • Did the information go through the peer-review process or some kind of fact-checking?

A ccuracy :

  • Can the information be verified? 
  • Are sources cited? 
  • Is the information factual or opinion based?
  • Is the information biased? 
  • Is the information free of grammatical or spelling errors?
  • What is the motive of providing the information: to inform? to sell? to persuade? to entertain?
  • Does the author or publisher make their intentions clear? Who is the intended audience?

Evaluating Web Sources

Most web pages are not fact-checked or anything like that, so it's especially important to evaluate information you find on the web.  Many articles on websites are fine for information, and many others are distorted or made up.  Check out our media evaluation guide for tips on evaluating what you see on social media, news sites, blogs, and so on.

This three-part video series, in which university students, historians, and pro fact-checkers go head-to-head in checking out online information, is also helpful.

  • << Previous: 6. Taking Notes & Documenting Sources
  • Next: 8. Citations & Plagiarism >>
  • Last Updated: Apr 18, 2023 12:12 PM
  • URL: https://butte.libguides.com/ResearchPaper

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts

Editorial criteria and processes

This document provides an outline of the editorial process involved in publishing a scientific paper (Article) in Nature , and describes how manuscripts are handled by editors between submission and publication.

Editorial processes are described for the following stages: At submission | After submission | After acceptance

At submission

Criteria for publication

The criteria for publication of scientific papers (Articles) in Nature are that they:

  • report original scientific research (the main results and conclusions must not have been published or submitted elsewhere)
  • are of outstanding scientific importance
  • reach a conclusion of interest to an interdisciplinary readership.

Further editorial criteria may be applicable for different kinds of papers, as follows:

  • large dataset papers : should aim to either report a fully comprehensive data set, defined by complete and extensive validation, or provide significant technical advance or scientific insight.
  • technical papers: papers that make solely technical advances will be considered in cases where the technique reported will have significant impacts on communities of fellow researchers.
  • therapeutic papers: in the absence of novel mechanistic insight, therapeutic papers will be considered if the therapeutic effect reported will provide significant impact on an important disease.

Articles published in Nature have an exceptionally wide impact, both among scientists and, frequently, among the general public.

Who decides which papers to publish?

Nature ’s aim is to publish the best research across a wide range of scientific fields, which means it has to be highly selective. As a result, only about 8% of submitted manuscripts will be accepted for publication. Most submissions are declined without being sent out for peer review.

Nature does not employ an editorial board of senior scientists, nor is it affiliated to a scientific society or institution, thus its decisions are independent, unbiased by scientific or national prejudices of particular individuals. Decisions are quicker, and editorial criteria can be made uniform across disciplines. The judgement about which papers will interest a broad readership is made by Nature 's editors, not its referees. One reason is because each referee sees only a tiny fraction of the papers submitted and is deeply knowledgeable about one field, whereas the editors, who see all the papers submitted, can have a broader perspective and a wider context from which to view the paper.

How to submit an Article

Authors should use the formatting guide section to ensure that the level, length and format (particularly the layout of figures and tables and any Supplementary Information) conforms with Nature 's requirements, at submission and each revision stage. This will reduce delays. Manuscripts should be submitted via our online manuscript submission system . Although optional, the cover letter is an excellent opportunity to briefly discuss the importance of the submitted work and why it is appropriate for the journal. Please avoid repeating information that is already present in the abstract and introduction. The cover letter is not shared with the referees, and should be used to provide confidential information such as conflicts of interest and to declare any related work that is in press or submitted elsewhere. All Nature editors report to the Editor of Nature , who sets Nature 's publication policies. Authors submitting to Nature do so on the understanding that they agree to these policies .

After submission

What happens to a submitted article.

The first stage for a newly submitted Article is that the editorial staff consider whether to send it for peer-review. On submission, the manuscript is assigned to an editor covering the subject area, who seeks informal advice from scientific advisors and editorial colleagues, and who makes this initial decision. The criteria for a paper to be sent for peer-review are that the results seem novel, arresting (illuminating, unexpected or surprising), and that the work described has both immediate and far-reaching implications. The initial judgement is not a reflection on the technical validity of the work described, or on its importance to people in the same field. Special attention is paid by the editors to the readability of submitted material. Editors encourage authors in highly technical disciplines to provide a slightly longer summary paragraph that descries clearly the basic background to the work and how the new results have affected the field, in a way that enables nonspecialist readers to understand what is being described. Editors also strongly encourage authors in appropriate disciplines to include a simple schematic summarizing the main conclusion of the paper, which can be published with the paper as Supplementary Information . Such figures can be particularly helpful to nonspecialist readers of cell, molecular and structural biology papers. Once the decision has been made to peer-review the paper, the choice of referees is made by the editor who has been assigned the manuscript, who will be handling other papers in the same field, in consultation with editors handling submissions in related fields when necessary. Most papers are sent to two or three referees, but some are sent to more or, occasionally, just to one. Referees are chosen for the following reasons:

  • independence from the authors and their institutions
  • ability to evaluate the technical aspects of the paper fully and fairly
  • currently or recently assessing related submissions
  • availability to assess the manuscript within the requested time.

Referees' reports

The ideal referee's report indicates

  • who will be interested in the new results and why
  • any technical failings that need to be addressed before the authors' case is established.

Although Nature 's editors themselves judge whether a paper is likely to interest readers outside its own immediate field, referees often give helpful advice, for example if the work described is not as significant as the editors thought or has undersold its significance. Although Nature 's editors regard it as essential that any technical failings noted by referees are addressed, they are not so strictly bound by referees’ editorial opinions as to whether the work belongs in Nature .

Competitors

Some potential referees may be engaged in competing work that could influence their opinion. To avoid such conflicts of interest, Nature requires potential referees to disclose any professional and commercial competing interests before undertaking to review a paper, and requires referees not to copy papers or to circulate them to un-named colleagues.  Although Nature editors go to every effort to ensure manuscripts are assessed fairly, Nature is not responsible for the conduct of its referees. Nature welcomes authors' suggestions for suitable independent referees (with their contact details), but editors are free to decide themselves who to use as referees. Nature editors will normally honour requests that a paper not be sent to one or two (but no more) competing groups for review.

Transparent peer review

Nature  uses a transparent peer review system, where for manuscripts submitted from February 2020 we can publish the reviewer comments to the authors and author rebuttal letters of published original research articles. Authors are provided the opportunity to opt out of this scheme at the completion of the peer review process, before the paper is accepted. If the manuscript was transferred to us from another Nature Research journal, we will not publish reviewer reports or author rebuttals of versions of the manuscript considered by the originating Nature Research journal. The peer review file is published online as a supplementary peer review file. Although we hope that the peer review files will provide a detailed and useful view into our peer review process, it is important to note that these files will not contain all the information considered in the editorial decision making process, such as the discussions between editors, editorial decision letters, or any confidential comments made by reviewers or authors to the editors.

This scheme only applies to original research Articles, and not to Review articles or to other published content. For more information,  please refer to our FAQ page .

Reviewer information

In recognition of the time and expertise our reviewers provide to  Nature ’s editorial process, we formally acknowledge their contribution to the external peer review of articles published in the journal. All peer-reviewed content will carry an anonymous statement of peer reviewer acknowledgement, and for those reviewers who give their consent, we will publish their names alongside the published article. We will continue to publish peer reviewer reports where authors opt in to our separate transparent peer review scheme. In cases where authors opt in to publication of peer reviewer comments and reviewers opt in to being named, we will not link a reviewer’s name to their report unless they choose to sign their comments to the author with their name. For more information,  please refer to our FAQ page .

If the reviewers wish to be named their names will appear in alphabetical order at the end of the paper in a statement as below:

  • Nature  thanks [Name], [Name] and [Name] for their contribution to the peer review of this work.

Any reviewers that wish to remain anonymous will be acknowledged using a slightly modified statement:

  • Nature  thanks [Name], [Name] and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

If no reviewers agree to be named, we will still acknowledge their valuable service using the statement below:

  • Nature  thanks the anonymous reviewers for their contribution to the peer review of this work.

Nature makes decisions about submitted papers as rapidly as possible. All manuscripts are handled electronically throughout the consideration process. Authors are usually informed within a week if the paper is not being considered. Most referees honour their prior agreement with Nature to deliver a report within two weeks or other agreed time limit, and send their reports online. Decisions by editors are routinely made very rapidly after receipt of reports, and Nature offers an advance online publication (AOP) service to an increasing number of manuscripts.

What the decision letter means

All Articles published in Nature go through at least one round of review, usually two or three, sometimes more. At each stage, the editor will discuss the manuscript with editorial colleagues in the light of referees’ reports, and send a letter to the author offering one of the following options:

  • The paper is accepted for publication without any further changes required from the authors.
  • The paper is accepted for publication in principle once the authors have made some revisions in response to the referees’ comments. Under these circumstances, revised papers are not usually sent back to the referees because further technical work has not been required, but are accepted for publication once the editors have checked that the referees’ suggestions have been implemented and the paper is in the required format (the formatting guide section is helpful to this end).
  • A final decision on publication is deferred, pending the authors’ response to the referees’ comments. Under these circumstances, further experiments or technical work are usually required to address some or all of the referees’ concerns, and revised papers are sent back to some or all of the referees for a second opinion. Revised papers should be accompanied by a point-by-point response to all the comments made by all the referees.
  • The paper is rejected because the referees have raised considerable technical objections and/or the authors’ claim has not been adequately established. Under these circumstances, the editor’s letter will state explicitly whether or not a resubmitted version would be considered. If the editor has invited the authors to resubmit, authors must ensure that all the referees’ technical comments have been satisfactorily addressed (not just some of them), unless specifically advised otherwise by the editor in the letter, and must accompany the resubmitted version with a point-by-point response to the referees’ comments. Editors will not send resubmitted papers to the reviewers if it seems that the authors have not made a serious attempt to address all the referees’ criticisms.
  • The paper is rejected with no offer to reconsider a resubmitted version. Under these circumstances, authors are strongly advised not to resubmit a revised version as it will be declined without further review. If the authors feel that they have a strong scientific case for reconsideration (if the referees have missed the point of the paper, for example) they can appeal the decision in writing. But in view of Nature 's extreme space constraints and the large number of papers under active consideration at any one time, editors cannot assign a high priority to consideration of such appeals. The main grounds for a successful appeal for reconsideration are if the author can identify a specific technical or other point of interest which had been missed by the referees and editors previously. Appeals written in general or vague terms, or that contain arguments not relevant to the content of the particular manuscript, are not likely to be successful. Manuscripts cannot be submitted elsewhere while an appeal is being considered.

Editors’ letters also contain detailed guidance about the paper’s format and style where appropriate (see below), which should be read in conjunction with the manuscript formatting guide when revising and resubmitting. In replying to the referees’ comments, authors are advised to use language that would not cause offence when their paper is shown again to the referees, and to bear in mind that if a point was not clear to the referees and/or editors, it is unlikely that it would be clear to the nonspecialist readers of Nature .

If Nature declines to publish a paper and does not suggest resubmission, authors are strongly advised to submit their paper for publication elsewhere. If an author wishes to appeal against Nature 's decision, the appeal must be made in writing, not by telephone, and should be confined to the scientific case for publication. Nature ’s editors are unable to assign high priority to consideration of appeals. Authors often ask for a new referee to be consulted, particularly in cases where two referees have been used and one is negative, the other positive. Nature is reluctant to consult new referees unless there is a particular, relevant area of scientific expertise that was lacking in the referees already used. Authors should note that as Nature is an interdisciplinary journal, referees for a paper are chosen for different reasons, for example a technical expert and a person who has a general overview of a field might both referee the same paper. A referee might be selected for expertise in only one area, for example to judge if a statistical analysis is appropriate, or if a particular technique that is essential to underpin the conclusion has been undertaken properly. This referee’s opinion must be satisfied for the manuscript to be published, but as this referee may not know about the field concerned, an endorsement in isolation from the other referee(s) would not constitute grounds for publication. Editors’ decisions are weighted according to the expertise of the referees, and not by a “voting” procedure. Hence, Nature prefers to stick with the original referees of a particular paper rather than to call in new referees to arbitrate, unless there is some specific way in which the referee can be shown to be technically lacking or biased in judgement. If Nature 's editors agree to reconsider a paper, the other original referee(s) will have the chance to see and comment on the report of the referee who is the subject of the complaint. New referees can often raise new sets of points, which complicates and lengthens the consideration process instead of simplifying it. If an author remains unsatisfied, he or she can write to the Editor , citing the manuscript reference number. In all these cases, it is likely that some time will elapse before Nature can respond, and the paper must not be submitted for publication elsewhere during this time.

After acceptance

See this document for a full description of what happens after acceptance and before publication.

Formats and lengths of papers

Space in Nature is extremely limited, and so format requirements must be strictly observed, as advised by the editor handling the submission, and detailed in the manuscript formatting guide.

Subediting of accepted papers

After a paper is accepted, it is subedited (copyedited) to ensure maximum clarity and reach, a process that enhances the value of papers in various ways. Nature 's subeditors are happy to advise authors about the format of their Articles after acceptance for publication. Their role is to

  • edit the language for maximum clarity and precision for those in other disciplines. Special care is given to papers whose authors’ native language is not English, and special attention is given to summary paragraphs.
  • ensure that the paper is at the length specified by the manuscript editor (including number of figures).
  • ensure that the terminology and notation conform to Nature 's house style.
  • ensure that the figures and tables are clear and will fit in the space available.

Proofs and reprints

Our subeditors send authors the edited text for approval before it is typeset. This enables most queries to be resolved before proof stage. Authors subsequently receive an e-proof, including the figures, and can also download a PDF proof of the layout. We suggest that authors send proofs to co-authors for them to check, but request that changes among the co-authors are coordinated so that only one author communicates with Nature and only one set of corrections is sent. The corresponding (or other single designated) author is responsible on behalf of all co-authors for the accuracy of all content, including spelling of names and current affiliations of all co-authors, so please ensure these are checked carefully. Proofs are cycled between Nature ’s production staff, our typesetter and the author by means of an online production-tracking system. Authors are provided with an encrypted link to this system after their paper has been accepted. Instructions for ordering reprints are provided after the paper is scheduled for publication.

Publication and the media

Nature  papers are assigned to a print issue two weeks before publication, at which time authors will receive an e-mail notifying them of their scheduled print publication date. Many papers are published online ahead of print publication date: corresponding authors of these papers will be informed by e-mail when the online publication date is confirmed, one week ahead of publication

The Journals and Editorial press office distributes embargoed mailings highlighting upcoming content to registered journalists six days in advance of publication. The titles of forthcoming papers will be listed on the mailing, along with the corresponding authors' contact details, which means authors may receive media enquiries relating to their paper during this embargo period. 

Authors are free to discuss their paper with the media from six days before the publication date, and are asked to ensure that Nature Research's embargo conditions are understood by journalists and others. Journalists have embargoed access to papers via the Nature Research press site, and are permitted to show papers to independent specialists a few days in advance of publication, under embargo conditions, solely for the purpose of eliciting comment on the work described. 

Before publication, the Journals and Editorial press office also informs the press / public information officers of authors' institutions to allow them to prepare their own publicity. Authors and their institutions are advised to coordinate any of their own publicity with the Journals and Editorial press office by e-mail after their paper is accepted for publication. 

The content of the press release mailing and papers described therein is embargoed until 1600 London time/1100 US Eastern Time on the day of publication, which is the time at which the research is published and become publicly available. In all cases, authors are expected to abide by the Nature Research press and embargo policies .

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

criteria of research paper

  • Privacy Policy

Research Method

Home » Evaluating Research – Process, Examples and Methods

Evaluating Research – Process, Examples and Methods

Table of Contents

Evaluating Research

Evaluating Research

Definition:

Evaluating Research refers to the process of assessing the quality, credibility, and relevance of a research study or project. This involves examining the methods, data, and results of the research in order to determine its validity, reliability, and usefulness. Evaluating research can be done by both experts and non-experts in the field, and involves critical thinking, analysis, and interpretation of the research findings.

Research Evaluating Process

The process of evaluating research typically involves the following steps:

Identify the Research Question

The first step in evaluating research is to identify the research question or problem that the study is addressing. This will help you to determine whether the study is relevant to your needs.

Assess the Study Design

The study design refers to the methodology used to conduct the research. You should assess whether the study design is appropriate for the research question and whether it is likely to produce reliable and valid results.

Evaluate the Sample

The sample refers to the group of participants or subjects who are included in the study. You should evaluate whether the sample size is adequate and whether the participants are representative of the population under study.

Review the Data Collection Methods

You should review the data collection methods used in the study to ensure that they are valid and reliable. This includes assessing the measures used to collect data and the procedures used to collect data.

Examine the Statistical Analysis

Statistical analysis refers to the methods used to analyze the data. You should examine whether the statistical analysis is appropriate for the research question and whether it is likely to produce valid and reliable results.

Assess the Conclusions

You should evaluate whether the data support the conclusions drawn from the study and whether they are relevant to the research question.

Consider the Limitations

Finally, you should consider the limitations of the study, including any potential biases or confounding factors that may have influenced the results.

Evaluating Research Methods

Evaluating Research Methods are as follows:

  • Peer review: Peer review is a process where experts in the field review a study before it is published. This helps ensure that the study is accurate, valid, and relevant to the field.
  • Critical appraisal : Critical appraisal involves systematically evaluating a study based on specific criteria. This helps assess the quality of the study and the reliability of the findings.
  • Replication : Replication involves repeating a study to test the validity and reliability of the findings. This can help identify any errors or biases in the original study.
  • Meta-analysis : Meta-analysis is a statistical method that combines the results of multiple studies to provide a more comprehensive understanding of a particular topic. This can help identify patterns or inconsistencies across studies.
  • Consultation with experts : Consulting with experts in the field can provide valuable insights into the quality and relevance of a study. Experts can also help identify potential limitations or biases in the study.
  • Review of funding sources: Examining the funding sources of a study can help identify any potential conflicts of interest or biases that may have influenced the study design or interpretation of results.

Example of Evaluating Research

Example of Evaluating Research sample for students:

Title of the Study: The Effects of Social Media Use on Mental Health among College Students

Sample Size: 500 college students

Sampling Technique : Convenience sampling

  • Sample Size: The sample size of 500 college students is a moderate sample size, which could be considered representative of the college student population. However, it would be more representative if the sample size was larger, or if a random sampling technique was used.
  • Sampling Technique : Convenience sampling is a non-probability sampling technique, which means that the sample may not be representative of the population. This technique may introduce bias into the study since the participants are self-selected and may not be representative of the entire college student population. Therefore, the results of this study may not be generalizable to other populations.
  • Participant Characteristics: The study does not provide any information about the demographic characteristics of the participants, such as age, gender, race, or socioeconomic status. This information is important because social media use and mental health may vary among different demographic groups.
  • Data Collection Method: The study used a self-administered survey to collect data. Self-administered surveys may be subject to response bias and may not accurately reflect participants’ actual behaviors and experiences.
  • Data Analysis: The study used descriptive statistics and regression analysis to analyze the data. Descriptive statistics provide a summary of the data, while regression analysis is used to examine the relationship between two or more variables. However, the study did not provide information about the statistical significance of the results or the effect sizes.

Overall, while the study provides some insights into the relationship between social media use and mental health among college students, the use of a convenience sampling technique and the lack of information about participant characteristics limit the generalizability of the findings. In addition, the use of self-administered surveys may introduce bias into the study, and the lack of information about the statistical significance of the results limits the interpretation of the findings.

Note*: Above mentioned example is just a sample for students. Do not copy and paste directly into your assignment. Kindly do your own research for academic purposes.

Applications of Evaluating Research

Here are some of the applications of evaluating research:

  • Identifying reliable sources : By evaluating research, researchers, students, and other professionals can identify the most reliable sources of information to use in their work. They can determine the quality of research studies, including the methodology, sample size, data analysis, and conclusions.
  • Validating findings: Evaluating research can help to validate findings from previous studies. By examining the methodology and results of a study, researchers can determine if the findings are reliable and if they can be used to inform future research.
  • Identifying knowledge gaps: Evaluating research can also help to identify gaps in current knowledge. By examining the existing literature on a topic, researchers can determine areas where more research is needed, and they can design studies to address these gaps.
  • Improving research quality : Evaluating research can help to improve the quality of future research. By examining the strengths and weaknesses of previous studies, researchers can design better studies and avoid common pitfalls.
  • Informing policy and decision-making : Evaluating research is crucial in informing policy and decision-making in many fields. By examining the evidence base for a particular issue, policymakers can make informed decisions that are supported by the best available evidence.
  • Enhancing education : Evaluating research is essential in enhancing education. Educators can use research findings to improve teaching methods, curriculum development, and student outcomes.

Purpose of Evaluating Research

Here are some of the key purposes of evaluating research:

  • Determine the reliability and validity of research findings : By evaluating research, researchers can determine the quality of the study design, data collection, and analysis. They can determine whether the findings are reliable, valid, and generalizable to other populations.
  • Identify the strengths and weaknesses of research studies: Evaluating research helps to identify the strengths and weaknesses of research studies, including potential biases, confounding factors, and limitations. This information can help researchers to design better studies in the future.
  • Inform evidence-based decision-making: Evaluating research is crucial in informing evidence-based decision-making in many fields, including healthcare, education, and public policy. Policymakers, educators, and clinicians rely on research evidence to make informed decisions.
  • Identify research gaps : By evaluating research, researchers can identify gaps in the existing literature and design studies to address these gaps. This process can help to advance knowledge and improve the quality of research in a particular field.
  • Ensure research ethics and integrity : Evaluating research helps to ensure that research studies are conducted ethically and with integrity. Researchers must adhere to ethical guidelines to protect the welfare and rights of study participants and to maintain the trust of the public.

Characteristics Evaluating Research

Characteristics Evaluating Research are as follows:

  • Research question/hypothesis: A good research question or hypothesis should be clear, concise, and well-defined. It should address a significant problem or issue in the field and be grounded in relevant theory or prior research.
  • Study design: The research design should be appropriate for answering the research question and be clearly described in the study. The study design should also minimize bias and confounding variables.
  • Sampling : The sample should be representative of the population of interest and the sampling method should be appropriate for the research question and study design.
  • Data collection : The data collection methods should be reliable and valid, and the data should be accurately recorded and analyzed.
  • Results : The results should be presented clearly and accurately, and the statistical analysis should be appropriate for the research question and study design.
  • Interpretation of results : The interpretation of the results should be based on the data and not influenced by personal biases or preconceptions.
  • Generalizability: The study findings should be generalizable to the population of interest and relevant to other settings or contexts.
  • Contribution to the field : The study should make a significant contribution to the field and advance our understanding of the research question or issue.

Advantages of Evaluating Research

Evaluating research has several advantages, including:

  • Ensuring accuracy and validity : By evaluating research, we can ensure that the research is accurate, valid, and reliable. This ensures that the findings are trustworthy and can be used to inform decision-making.
  • Identifying gaps in knowledge : Evaluating research can help identify gaps in knowledge and areas where further research is needed. This can guide future research and help build a stronger evidence base.
  • Promoting critical thinking: Evaluating research requires critical thinking skills, which can be applied in other areas of life. By evaluating research, individuals can develop their critical thinking skills and become more discerning consumers of information.
  • Improving the quality of research : Evaluating research can help improve the quality of research by identifying areas where improvements can be made. This can lead to more rigorous research methods and better-quality research.
  • Informing decision-making: By evaluating research, we can make informed decisions based on the evidence. This is particularly important in fields such as medicine and public health, where decisions can have significant consequences.
  • Advancing the field : Evaluating research can help advance the field by identifying new research questions and areas of inquiry. This can lead to the development of new theories and the refinement of existing ones.

Limitations of Evaluating Research

Limitations of Evaluating Research are as follows:

  • Time-consuming: Evaluating research can be time-consuming, particularly if the study is complex or requires specialized knowledge. This can be a barrier for individuals who are not experts in the field or who have limited time.
  • Subjectivity : Evaluating research can be subjective, as different individuals may have different interpretations of the same study. This can lead to inconsistencies in the evaluation process and make it difficult to compare studies.
  • Limited generalizability: The findings of a study may not be generalizable to other populations or contexts. This limits the usefulness of the study and may make it difficult to apply the findings to other settings.
  • Publication bias: Research that does not find significant results may be less likely to be published, which can create a bias in the published literature. This can limit the amount of information available for evaluation.
  • Lack of transparency: Some studies may not provide enough detail about their methods or results, making it difficult to evaluate their quality or validity.
  • Funding bias : Research funded by particular organizations or industries may be biased towards the interests of the funder. This can influence the study design, methods, and interpretation of results.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Contribution

Research Contribution – Thesis Guide

Thesis

Thesis – Structure, Example and Writing Guide

Critical Analysis

Critical Analysis – Types, Examples and Writing...

Research Summary

Research Summary – Structure, Examples and...

Informed Consent in Research

Informed Consent in Research – Types, Templates...

Research Results

Research Results Section – Writing Guide and...

Page Content

Overview of the review report format, the first read-through, first read considerations, spotting potential major flaws, concluding the first reading, rejection after the first reading, before starting the second read-through, doing the second read-through, the second read-through: section by section guidance, how to structure your report, on presentation and style, criticisms & confidential comments to editors, the recommendation, when recommending rejection, additional resources, step by step guide to reviewing a manuscript.

When you receive an invitation to peer review, you should be sent a copy of the paper's abstract to help you decide whether you wish to do the review. Try to respond to invitations promptly - it will prevent delays. It is also important at this stage to declare any potential Conflict of Interest.

The structure of the review report varies between journals. Some follow an informal structure, while others have a more formal approach.

" Number your comments!!! " (Jonathon Halbesleben, former Editor of Journal of Occupational and Organizational Psychology)

Informal Structure

Many journals don't provide criteria for reviews beyond asking for your 'analysis of merits'. In this case, you may wish to familiarize yourself with examples of other reviews done for the journal, which the editor should be able to provide or, as you gain experience, rely on your own evolving style.

Formal Structure

Other journals require a more formal approach. Sometimes they will ask you to address specific questions in your review via a questionnaire. Or they might want you to rate the manuscript on various attributes using a scorecard. Often you can't see these until you log in to submit your review. So when you agree to the work, it's worth checking for any journal-specific guidelines and requirements. If there are formal guidelines, let them direct the structure of your review.

In Both Cases

Whether specifically required by the reporting format or not, you should expect to compile comments to authors and possibly confidential ones to editors only.

Reviewing with Empathy

Following the invitation to review, when you'll have received the article abstract, you should already understand the aims, key data and conclusions of the manuscript. If you don't, make a note now that you need to feedback on how to improve those sections.

The first read-through is a skim-read. It will help you form an initial impression of the paper and get a sense of whether your eventual recommendation will be to accept or reject the paper.

Keep a pen and paper handy when skim-reading.

Try to bear in mind the following questions - they'll help you form your overall impression:

  • What is the main question addressed by the research? Is it relevant and interesting?
  • How original is the topic? What does it add to the subject area compared with other published material?
  • Is the paper well written? Is the text clear and easy to read?
  • Are the conclusions consistent with the evidence and arguments presented? Do they address the main question posed?
  • If the author is disagreeing significantly with the current academic consensus, do they have a substantial case? If not, what would be required to make their case credible?
  • If the paper includes tables or figures, what do they add to the paper? Do they aid understanding or are they superfluous?

While you should read the whole paper, making the right choice of what to read first can save time by flagging major problems early on.

Editors say, " Specific recommendations for remedying flaws are VERY welcome ."

Examples of possibly major flaws include:

  • Drawing a conclusion that is contradicted by the author's own statistical or qualitative evidence
  • The use of a discredited method
  • Ignoring a process that is known to have a strong influence on the area under study

If experimental design features prominently in the paper, first check that the methodology is sound - if not, this is likely to be a major flaw.

You might examine:

  • The sampling in analytical papers
  • The sufficient use of control experiments
  • The precision of process data
  • The regularity of sampling in time-dependent studies
  • The validity of questions, the use of a detailed methodology and the data analysis being done systematically (in qualitative research)
  • That qualitative research extends beyond the author's opinions, with sufficient descriptive elements and appropriate quotes from interviews or focus groups

Major Flaws in Information

If methodology is less of an issue, it's often a good idea to look at the data tables, figures or images first. Especially in science research, it's all about the information gathered. If there are critical flaws in this, it's very likely the manuscript will need to be rejected. Such issues include:

  • Insufficient data
  • Unclear data tables
  • Contradictory data that either are not self-consistent or disagree with the conclusions
  • Confirmatory data that adds little, if anything, to current understanding - unless strong arguments for such repetition are made

If you find a major problem, note your reasoning and clear supporting evidence (including citations).

After the initial read and using your notes, including those of any major flaws you found, draft the first two paragraphs of your review - the first summarizing the research question addressed and the second the contribution of the work. If the journal has a prescribed reporting format, this draft will still help you compose your thoughts.

The First Paragraph

This should state the main question addressed by the research and summarize the goals, approaches, and conclusions of the paper. It should:

  • Help the editor properly contextualize the research and add weight to your judgement
  • Show the author what key messages are conveyed to the reader, so they can be sure they are achieving what they set out to do
  • Focus on successful aspects of the paper so the author gets a sense of what they've done well

The Second Paragraph

This should provide a conceptual overview of the contribution of the research. So consider:

  • Is the paper's premise interesting and important?
  • Are the methods used appropriate?
  • Do the data support the conclusions?

After drafting these two paragraphs, you should be in a position to decide whether this manuscript is seriously flawed and should be rejected (see the next section). Or whether it is publishable in principle and merits a detailed, careful read through.

Even if you are coming to the opinion that an article has serious flaws, make sure you read the whole paper. This is very important because you may find some really positive aspects that can be communicated to the author. This could help them with future submissions.

A full read-through will also make sure that any initial concerns are indeed correct and fair. After all, you need the context of the whole paper before deciding to reject. If you still intend to recommend rejection, see the section "When recommending rejection."

Once the paper has passed your first read and you've decided the article is publishable in principle, one purpose of the second, detailed read-through is to help prepare the manuscript for publication. You may still decide to recommend rejection following a second reading.

" Offer clear suggestions for how the authors can address the concerns raised. In other words, if you're going to raise a problem, provide a solution ." (Jonathon Halbesleben, Editor of Journal of Occupational and Organizational Psychology)

Preparation

To save time and simplify the review:

  • Don't rely solely upon inserting comments on the manuscript document - make separate notes
  • Try to group similar concerns or praise together
  • If using a review program to note directly onto the manuscript, still try grouping the concerns and praise in separate notes - it helps later
  • Note line numbers of text upon which your notes are based - this helps you find items again and also aids those reading your review

Now that you have completed your preparations, you're ready to spend an hour or so reading carefully through the manuscript.

As you're reading through the manuscript for a second time, you'll need to keep in mind the argument's construction, the clarity of the language and content.

With regard to the argument’s construction, you should identify:

  • Any places where the meaning is unclear or ambiguous
  • Any factual errors
  • Any invalid arguments

You may also wish to consider:

  • Does the title properly reflect the subject of the paper?
  • Does the abstract provide an accessible summary of the paper?
  • Do the keywords accurately reflect the content?
  • Is the paper an appropriate length?
  • Are the key messages short, accurate and clear?

Not every submission is well written. Part of your role is to make sure that the text’s meaning is clear.

Editors say, " If a manuscript has many English language and editing issues, please do not try and fix it. If it is too bad, note that in your review and it should be up to the authors to have the manuscript edited ."

If the article is difficult to understand, you should have rejected it already. However, if the language is poor but you understand the core message, see if you can suggest improvements to fix the problem:

  • Are there certain aspects that could be communicated better, such as parts of the discussion?
  • Should the authors consider resubmitting to the same journal after language improvements?
  • Would you consider looking at the paper again once these issues are dealt with?

On Grammar and Punctuation

Your primary role is judging the research content. Don't spend time polishing grammar or spelling. Editors will make sure that the text is at a high standard before publication. However, if you spot grammatical errors that affect clarity of meaning, then it's important to highlight these. Expect to suggest such amendments - it's rare for a manuscript to pass review with no corrections.

A 2010 study of nursing journals found that 79% of recommendations by reviewers were influenced by grammar and writing style (Shattel, et al., 2010).

1. The Introduction

A well-written introduction:

  • Sets out the argument
  • Summarizes recent research related to the topic
  • Highlights gaps in current understanding or conflicts in current knowledge
  • Establishes the originality of the research aims by demonstrating the need for investigations in the topic area
  • Gives a clear idea of the target readership, why the research was carried out and the novelty and topicality of the manuscript

Originality and Topicality

Originality and topicality can only be established in the light of recent authoritative research. For example, it's impossible to argue that there is a conflict in current understanding by referencing articles that are 10 years old.

Authors may make the case that a topic hasn't been investigated in several years and that new research is required. This point is only valid if researchers can point to recent developments in data gathering techniques or to research in indirectly related fields that suggest the topic needs revisiting. Clearly, authors can only do this by referencing recent literature. Obviously, where older research is seminal or where aspects of the methodology rely upon it, then it is perfectly appropriate for authors to cite some older papers.

Editors say, "Is the report providing new information; is it novel or just confirmatory of well-known outcomes ?"

It's common for the introduction to end by stating the research aims. By this point you should already have a good impression of them - if the explicit aims come as a surprise, then the introduction needs improvement.

2. Materials and Methods

Academic research should be replicable, repeatable and robust - and follow best practice.

Replicable Research

This makes sufficient use of:

  • Control experiments
  • Repeated analyses
  • Repeated experiments

These are used to make sure observed trends are not due to chance and that the same experiment could be repeated by other researchers - and result in the same outcome. Statistical analyses will not be sound if methods are not replicable. Where research is not replicable, the paper should be recommended for rejection.

Repeatable Methods

These give enough detail so that other researchers are able to carry out the same research. For example, equipment used or sampling methods should all be described in detail so that others could follow the same steps. Where methods are not detailed enough, it's usual to ask for the methods section to be revised.

Robust Research

This has enough data points to make sure the data are reliable. If there are insufficient data, it might be appropriate to recommend revision. You should also consider whether there is any in-built bias not nullified by the control experiments.

Best Practice

During these checks you should keep in mind best practice:

  • Standard guidelines were followed (e.g. the CONSORT Statement for reporting randomized trials)
  • The health and safety of all participants in the study was not compromised
  • Ethical standards were maintained

If the research fails to reach relevant best practice standards, it's usual to recommend rejection. What's more, you don't then need to read any further.

3. Results and Discussion

This section should tell a coherent story - What happened? What was discovered or confirmed?

Certain patterns of good reporting need to be followed by the author:

  • They should start by describing in simple terms what the data show
  • They should make reference to statistical analyses, such as significance or goodness of fit
  • Once described, they should evaluate the trends observed and explain the significance of the results to wider understanding. This can only be done by referencing published research
  • The outcome should be a critical analysis of the data collected

Discussion should always, at some point, gather all the information together into a single whole. Authors should describe and discuss the overall story formed. If there are gaps or inconsistencies in the story, they should address these and suggest ways future research might confirm the findings or take the research forward.

4. Conclusions

This section is usually no more than a few paragraphs and may be presented as part of the results and discussion, or in a separate section. The conclusions should reflect upon the aims - whether they were achieved or not - and, just like the aims, should not be surprising. If the conclusions are not evidence-based, it's appropriate to ask for them to be re-written.

5. Information Gathered: Images, Graphs and Data Tables

If you find yourself looking at a piece of information from which you cannot discern a story, then you should ask for improvements in presentation. This could be an issue with titles, labels, statistical notation or image quality.

Where information is clear, you should check that:

  • The results seem plausible, in case there is an error in data gathering
  • The trends you can see support the paper's discussion and conclusions
  • There are sufficient data. For example, in studies carried out over time are there sufficient data points to support the trends described by the author?

You should also check whether images have been edited or manipulated to emphasize the story they tell. This may be appropriate but only if authors report on how the image has been edited (e.g. by highlighting certain parts of an image). Where you feel that an image has been edited or manipulated without explanation, you should highlight this in a confidential comment to the editor in your report.

6. List of References

You will need to check referencing for accuracy, adequacy and balance.

Where a cited article is central to the author's argument, you should check the accuracy and format of the reference - and bear in mind different subject areas may use citations differently. Otherwise, it's the editor’s role to exhaustively check the reference section for accuracy and format.

You should consider if the referencing is adequate:

  • Are important parts of the argument poorly supported?
  • Are there published studies that show similar or dissimilar trends that should be discussed?
  • If a manuscript only uses half the citations typical in its field, this may be an indicator that referencing should be improved - but don't be guided solely by quantity
  • References should be relevant, recent and readily retrievable

Check for a well-balanced list of references that is:

  • Helpful to the reader
  • Fair to competing authors
  • Not over-reliant on self-citation
  • Gives due recognition to the initial discoveries and related work that led to the work under assessment

You should be able to evaluate whether the article meets the criteria for balanced referencing without looking up every reference.

7. Plagiarism

By now you will have a deep understanding of the paper's content - and you may have some concerns about plagiarism.

Identified Concern

If you find - or already knew of - a very similar paper, this may be because the author overlooked it in their own literature search. Or it may be because it is very recent or published in a journal slightly outside their usual field.

You may feel you can advise the author how to emphasize the novel aspects of their own study, so as to better differentiate it from similar research. If so, you may ask the author to discuss their aims and results, or modify their conclusions, in light of the similar article. Of course, the research similarities may be so great that they render the work unoriginal and you have no choice but to recommend rejection.

"It's very helpful when a reviewer can point out recent similar publications on the same topic by other groups, or that the authors have already published some data elsewhere ." (Editor feedback)

Suspected Concern

If you suspect plagiarism, including self-plagiarism, but cannot recall or locate exactly what is being plagiarized, notify the editor of your suspicion and ask for guidance.

Most editors have access to software that can check for plagiarism.

Editors are not out to police every paper, but when plagiarism is discovered during peer review it can be properly addressed ahead of publication. If plagiarism is discovered only after publication, the consequences are worse for both authors and readers, because a retraction may be necessary.

For detailed guidelines see COPE's Ethical guidelines for reviewers and Wiley's Best Practice Guidelines on Publishing Ethics .

8. Search Engine Optimization (SEO)

After the detailed read-through, you will be in a position to advise whether the title, abstract and key words are optimized for search purposes. In order to be effective, good SEO terms will reflect the aims of the research.

A clear title and abstract will improve the paper's search engine rankings and will influence whether the user finds and then decides to navigate to the main article. The title should contain the relevant SEO terms early on. This has a major effect on the impact of a paper, since it helps it appear in search results. A poor abstract can then lose the reader's interest and undo the benefit of an effective title - whilst the paper's abstract may appear in search results, the potential reader may go no further.

So ask yourself, while the abstract may have seemed adequate during earlier checks, does it:

  • Do justice to the manuscript in this context?
  • Highlight important findings sufficiently?
  • Present the most interesting data?

Editors say, " Does the Abstract highlight the important findings of the study ?"

If there is a formal report format, remember to follow it. This will often comprise a range of questions followed by comment sections. Try to answer all the questions. They are there because the editor felt that they are important. If you're following an informal report format you could structure your report in three sections: summary, major issues, minor issues.

  • Give positive feedback first. Authors are more likely to read your review if you do so. But don't overdo it if you will be recommending rejection
  • Briefly summarize what the paper is about and what the findings are
  • Try to put the findings of the paper into the context of the existing literature and current knowledge
  • Indicate the significance of the work and if it is novel or mainly confirmatory
  • Indicate the work's strengths, its quality and completeness
  • State any major flaws or weaknesses and note any special considerations. For example, if previously held theories are being overlooked

Major Issues

  • Are there any major flaws? State what they are and what the severity of their impact is on the paper
  • Has similar work already been published without the authors acknowledging this?
  • Are the authors presenting findings that challenge current thinking? Is the evidence they present strong enough to prove their case? Have they cited all the relevant work that would contradict their thinking and addressed it appropriately?
  • If major revisions are required, try to indicate clearly what they are
  • Are there any major presentational problems? Are figures & tables, language and manuscript structure all clear enough for you to accurately assess the work?
  • Are there any ethical issues? If you are unsure it may be better to disclose these in the confidential comments section

Minor Issues

  • Are there places where meaning is ambiguous? How can this be corrected?
  • Are the correct references cited? If not, which should be cited instead/also? Are citations excessive, limited, or biased?
  • Are there any factual, numerical or unit errors? If so, what are they?
  • Are all tables and figures appropriate, sufficient, and correctly labelled? If not, say which are not

Your review should ultimately help the author improve their article. So be polite, honest and clear. You should also try to be objective and constructive, not subjective and destructive.

You should also:

  • Write clearly and so you can be understood by people whose first language is not English
  • Avoid complex or unusual words, especially ones that would even confuse native speakers
  • Number your points and refer to page and line numbers in the manuscript when making specific comments
  • If you have been asked to only comment on specific parts or aspects of the manuscript, you should indicate clearly which these are
  • Treat the author's work the way you would like your own to be treated

Most journals give reviewers the option to provide some confidential comments to editors. Often this is where editors will want reviewers to state their recommendation - see the next section - but otherwise this area is best reserved for communicating malpractice such as suspected plagiarism, fraud, unattributed work, unethical procedures, duplicate publication, bias or other conflicts of interest.

However, this doesn't give reviewers permission to 'backstab' the author. Authors can't see this feedback and are unable to give their side of the story unless the editor asks them to. So in the spirit of fairness, write comments to editors as though authors might read them too.

Reviewers should check the preferences of individual journals as to where they want review decisions to be stated. In particular, bear in mind that some journals will not want the recommendation included in any comments to authors, as this can cause editors difficulty later - see Section 11 for more advice about working with editors.

You will normally be asked to indicate your recommendation (e.g. accept, reject, revise and resubmit, etc.) from a fixed-choice list and then to enter your comments into a separate text box.

Recommending Acceptance

If you're recommending acceptance, give details outlining why, and if there are any areas that could be improved. Don't just give a short, cursory remark such as 'great, accept'. See Improving the Manuscript

Recommending Revision

Where improvements are needed, a recommendation for major or minor revision is typical. You may also choose to state whether you opt in or out of the post-revision review too. If recommending revision, state specific changes you feel need to be made. The author can then reply to each point in turn.

Some journals offer the option to recommend rejection with the possibility of resubmission – this is most relevant where substantial, major revision is necessary.

What can reviewers do to help? " Be clear in their comments to the author (or editor) which points are absolutely critical if the paper is given an opportunity for revisio n." (Jonathon Halbesleben, Editor of Journal of Occupational and Organizational Psychology)

Recommending Rejection

If recommending rejection or major revision, state this clearly in your review (and see the next section, 'When recommending rejection').

Where manuscripts have serious flaws you should not spend any time polishing the review you've drafted or give detailed advice on presentation.

Editors say, " If a reviewer suggests a rejection, but her/his comments are not detailed or helpful, it does not help the editor in making a decision ."

In your recommendations for the author, you should:

  • Give constructive feedback describing ways that they could improve the research
  • Keep the focus on the research and not the author. This is an extremely important part of your job as a reviewer
  • Avoid making critical confidential comments to the editor while being polite and encouraging to the author - the latter may not understand why their manuscript has been rejected. Also, they won't get feedback on how to improve their research and it could trigger an appeal

Remember to give constructive criticism even if recommending rejection. This helps developing researchers improve their work and explains to the editor why you felt the manuscript should not be published.

" When the comments seem really positive, but the recommendation is rejection…it puts the editor in a tough position of having to reject a paper when the comments make it sound like a great paper ." (Jonathon Halbesleben, Editor of Journal of Occupational and Organizational Psychology)

Visit our Wiley Author Learning and Training Channel for expert advice on peer review.

Watch the video, Ethical considerations of Peer Review

Logo for M Libraries Publishing

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

12.1 Creating a Rough Draft for a Research Paper

Learning objectives.

  • Apply strategies for drafting an effective introduction and conclusion.
  • Identify when and how to summarize, paraphrase, and directly quote information from research sources.
  • Apply guidelines for citing sources within the body of the paper and the bibliography.
  • Use primary and secondary research to support ideas.
  • Identify the purposes for which writers use each type of research.

At last, you are ready to begin writing the rough draft of your research paper. Putting your thinking and research into words is exciting. It can also be challenging. In this section, you will learn strategies for handling the more challenging aspects of writing a research paper, such as integrating material from your sources, citing information correctly, and avoiding any misuse of your sources.

The Structure of a Research Paper

Research papers generally follow the same basic structure: an introduction that presents the writer’s thesis, a body section that develops the thesis with supporting points and evidence, and a conclusion that revisits the thesis and provides additional insights or suggestions for further research.

Your writing voice will come across most strongly in your introduction and conclusion, as you work to attract your readers’ interest and establish your thesis. These sections usually do not cite sources at length. They focus on the big picture, not specific details. In contrast, the body of your paper will cite sources extensively. As you present your ideas, you will support your points with details from your research.

Writing Your Introduction

There are several approaches to writing an introduction, each of which fulfills the same goals. The introduction should get readers’ attention, provide background information, and present the writer’s thesis. Many writers like to begin with one of the following catchy openers:

  • A surprising fact
  • A thought-provoking question
  • An attention-getting quote
  • A brief anecdote that illustrates a larger concept
  • A connection between your topic and your readers’ experiences

The next few sentences place the opening in context by presenting background information. From there, the writer builds toward a thesis, which is traditionally placed at the end of the introduction. Think of your thesis as a signpost that lets readers know in what direction the paper is headed.

Jorge decided to begin his research paper by connecting his topic to readers’ daily experiences. Read the first draft of his introduction. The thesis is underlined. Note how Jorge progresses from the opening sentences to background information to his thesis.

Beyond the Hype: Evaluating Low-Carb Diets

I. Introduction

Over the past decade, increasing numbers of Americans have jumped on the low-carb bandwagon. Some studies estimate that approximately 40 million Americans, or about 20 percent of the population, are attempting to restrict their intake of food high in carbohydrates (Sanders and Katz, 2004; Hirsch, 2004). Proponents of low-carb diets say they are not only the most effective way to lose weight, but they also yield health benefits such as lower blood pressure and improved cholesterol levels. Meanwhile, some doctors claim that low-carb diets are overrated and caution that their long-term effects are unknown. Although following a low-carbohydrate diet can benefit some people, these diets are not necessarily the best option for everyone who wants to lose weight or improve their health.

Write the introductory paragraph of your research paper. Try using one of the techniques listed in this section to write an engaging introduction. Be sure to include background information about the topic that leads to your thesis.

Writers often work out of sequence when writing a research paper. If you find yourself struggling to write an engaging introduction, you may wish to write the body of your paper first. Writing the body sections first will help you clarify your main points. Writing the introduction should then be easier. You may have a better sense of how to introduce the paper after you have drafted some or all of the body.

Writing Your Conclusion

In your introduction, you tell readers where they are headed. In your conclusion, you recap where they have been. For this reason, some writers prefer to write their conclusions soon after they have written their introduction. However, this method may not work for all writers. Other writers prefer to write their conclusion at the end of the paper, after writing the body paragraphs. No process is absolutely right or absolutely wrong; find the one that best suits you.

No matter when you compose the conclusion, it should sum up your main ideas and revisit your thesis. The conclusion should not simply echo the introduction or rely on bland summary statements, such as “In this paper, I have demonstrated that.…” In fact, avoid repeating your thesis verbatim from the introduction. Restate it in different words that reflect the new perspective gained through your research. That helps keep your ideas fresh for your readers. An effective writer might conclude a paper by asking a new question the research inspired, revisiting an anecdote presented earlier, or reminding readers of how the topic relates to their lives.

Writing at Work

If your job involves writing or reading scientific papers, it helps to understand how professional researchers use the structure described in this section. A scientific paper begins with an abstract that briefly summarizes the entire paper. The introduction explains the purpose of the research, briefly summarizes previous research, and presents the researchers’ hypothesis. The body provides details about the study, such as who participated in it, what the researchers measured, and what results they recorded. The conclusion presents the researchers’ interpretation of the data, or what they learned.

Using Source Material in Your Paper

One of the challenges of writing a research paper is successfully integrating your ideas with material from your sources. Your paper must explain what you think, or it will read like a disconnected string of facts and quotations. However, you also need to support your ideas with research, or they will seem insubstantial. How do you strike the right balance?

You have already taken a step in the right direction by writing your introduction. The introduction and conclusion function like the frame around a picture. They define and limit your topic and place your research in context.

In the body paragraphs of your paper, you will need to integrate ideas carefully at the paragraph level and at the sentence level. You will use topic sentences in your paragraphs to make sure readers understand the significance of any facts, details, or quotations you cite. You will also include sentences that transition between ideas from your research, either within a paragraph or between paragraphs. At the sentence level, you will need to think carefully about how you introduce paraphrased and quoted material.

Earlier you learned about summarizing, paraphrasing, and quoting when taking notes. In the next few sections, you will learn how to use these techniques in the body of your paper to weave in source material to support your ideas.

Summarizing Sources

When you summarize material from a source, you zero in on the main points and restate them concisely in your own words. This technique is appropriate when only the major ideas are relevant to your paper or when you need to simplify complex information into a few key points for your readers.

Be sure to review the source material as you summarize it. Identify the main idea and restate it as concisely as you can—preferably in one sentence. Depending on your purpose, you may also add another sentence or two condensing any important details or examples. Check your summary to make sure it is accurate and complete.

In his draft, Jorge summarized research materials that presented scientists’ findings about low-carbohydrate diets. Read the following passage from a trade magazine article and Jorge’s summary of the article.

Assessing the Efficacy of Low-Carbohydrate Diets

Adrienne Howell, Ph.D.

Over the past few years, a number of clinical studies have explored whether high-protein, low-carbohydrate diets are more effective for weight loss than other frequently recommended diet plans, such as diets that drastically curtail fat intake (Pritikin) or that emphasize consuming lean meats, grains, vegetables, and a moderate amount of unsaturated fats (the Mediterranean diet). A 2009 study found that obese teenagers who followed a low-carbohydrate diet lost an average of 15.6 kilograms over a six-month period, whereas teenagers following a low-fat diet or a Mediterranean diet lost an average of 11.1 kilograms and 9.3 kilograms respectively. Two 2010 studies that measured weight loss for obese adults following these same three diet plans found similar results. Over three months, subjects on the low-carbohydrate diet plan lost anywhere from four to six kilograms more than subjects who followed other diet plans.

In three recent studies, researchers compared outcomes for obese subjects who followed either a low-carbohydrate diet, a low-fat diet, or a Mediterranean diet and found that subjects following a low-carbohydrate diet lost more weight in the same time (Howell, 2010).

A summary restates ideas in your own words—but for specialized or clinical terms, you may need to use terms that appear in the original source. For instance, Jorge used the term obese in his summary because related words such as heavy or overweight have a different clinical meaning.

On a separate sheet of paper, practice summarizing by writing a one-sentence summary of the same passage that Jorge already summarized.

Paraphrasing Sources

When you paraphrase material from a source, restate the information from an entire sentence or passage in your own words, using your own original sentence structure. A paraphrased source differs from a summarized source in that you focus on restating the ideas, not condensing them.

Again, it is important to check your paraphrase against the source material to make sure it is both accurate and original. Inexperienced writers sometimes use the thesaurus method of paraphrasing—that is, they simply rewrite the source material, replacing most of the words with synonyms. This constitutes a misuse of sources. A true paraphrase restates ideas using the writer’s own language and style.

In his draft, Jorge frequently paraphrased details from sources. At times, he needed to rewrite a sentence more than once to ensure he was paraphrasing ideas correctly. Read the passage from a website. Then read Jorge’s initial attempt at paraphrasing it, followed by the final version of his paraphrase.

Dieters nearly always get great results soon after they begin following a low-carbohydrate diet, but these results tend to taper off after the first few months, particularly because many dieters find it difficult to follow a low-carbohydrate diet plan consistently.

People usually see encouraging outcomes shortly after they go on a low-carbohydrate diet, but their progress slows down after a short while, especially because most discover that it is a challenge to adhere to the diet strictly (Heinz, 2009).

After reviewing the paraphrased sentence, Jorge realized he was following the original source too closely. He did not want to quote the full passage verbatim, so he again attempted to restate the idea in his own style.

Because it is hard for dieters to stick to a low-carbohydrate eating plan, the initial success of these diets is short-lived (Heinz, 2009).

On a separate sheet of paper, follow these steps to practice paraphrasing.

  • Choose an important idea or detail from your notes.
  • Without looking at the original source, restate the idea in your own words.
  • Check your paraphrase against the original text in the source. Make sure both your language and your sentence structure are original.
  • Revise your paraphrase if necessary.

Quoting Sources Directly

Most of the time, you will summarize or paraphrase source material instead of quoting directly. Doing so shows that you understand your research well enough to write about it confidently in your own words. However, direct quotes can be powerful when used sparingly and with purpose.

Quoting directly can sometimes help you make a point in a colorful way. If an author’s words are especially vivid, memorable, or well phrased, quoting them may help hold your reader’s interest. Direct quotations from an interviewee or an eyewitness may help you personalize an issue for readers. And when you analyze primary sources, such as a historical speech or a work of literature, quoting extensively is often necessary to illustrate your points. These are valid reasons to use quotations.

Less experienced writers, however, sometimes overuse direct quotations in a research paper because it seems easier than paraphrasing. At best, this reduces the effectiveness of the quotations. At worst, it results in a paper that seems haphazardly pasted together from outside sources. Use quotations sparingly for greater impact.

When you do choose to quote directly from a source, follow these guidelines:

  • Make sure you have transcribed the original statement accurately.
  • Represent the author’s ideas honestly. Quote enough of the original text to reflect the author’s point accurately.
  • Never use a stand-alone quotation. Always integrate the quoted material into your own sentence.
  • Use ellipses (…) if you need to omit a word or phrase. Use brackets [ ] if you need to replace a word or phrase.
  • Make sure any omissions or changed words do not alter the meaning of the original text. Omit or replace words only when absolutely necessary to shorten the text or to make it grammatically correct within your sentence.
  • Remember to include correctly formatted citations that follow the assigned style guide.

Jorge interviewed a dietician as part of his research, and he decided to quote her words in his paper. Read an excerpt from the interview and Jorge’s use of it, which follows.

Personally, I don’t really buy into all of the hype about low-carbohydrate miracle diets like Atkins and so on. Sure, for some people, they are great, but for most, any sensible eating and exercise plan would work just as well.

Registered dietician Dana Kwon (2010) admits, “Personally, I don’t really buy into all of the hype.…Sure, for some people, [low-carbohydrate diets] are great, but for most, any sensible eating and exercise plan would work just as well.”

Notice how Jorge smoothly integrated the quoted material by starting the sentence with an introductory phrase. His use of ellipses and brackets did not change the source’s meaning.

Documenting Source Material

Throughout the writing process, be scrupulous about documenting information taken from sources. The purpose of doing so is twofold:

  • To give credit to other writers or researchers for their ideas
  • To allow your reader to follow up and learn more about the topic if desired

You will cite sources within the body of your paper and at the end of the paper in your bibliography. For this assignment, you will use the citation format used by the American Psychological Association (also known as APA style). For information on the format used by the Modern Language Association (MLA style), see Chapter 13 “APA and MLA Documentation and Formatting” .

Citing Sources in the Body of Your Paper

In-text citations document your sources within the body of your paper. These include two vital pieces of information: the author’s name and the year the source material was published. When quoting a print source, also include in the citation the page number where the quoted material originally appears. The page number will follow the year in the in-text citation. Page numbers are necessary only when content has been directly quoted, not when it has been summarized or paraphrased.

Within a paragraph, this information may appear as part of your introduction to the material or as a parenthetical citation at the end of a sentence. Read the examples that follow. For more information about in-text citations for other source types, see Chapter 13 “APA and MLA Documentation and Formatting” .

Leibowitz (2008) found that low-carbohydrate diets often helped subjects with Type II diabetes maintain a healthy weight and control blood-sugar levels.

The introduction to the source material includes the author’s name followed by the year of publication in parentheses.

Low-carbohydrate diets often help subjects with Type II diabetes maintain a healthy weight and control blood-sugar levels (Leibowitz, 2008).

The parenthetical citation at the end of the sentence includes the author’s name, a comma, and the year the source was published. The period at the end of the sentence comes after the parentheses.

Creating a List of References

Each of the sources you cite in the body text will appear in a references list at the end of your paper. While in-text citations provide the most basic information about the source, your references section will include additional publication details. In general, you will include the following information:

  • The author’s last name followed by his or her first (and sometimes middle) initial
  • The year the source was published
  • The source title
  • For articles in periodicals, the full name of the periodical, along with the volume and issue number and the pages where the article appeared

Additional information may be included for different types of sources, such as online sources. For a detailed guide to APA or MLA citations, see Chapter 13 “APA and MLA Documentation and Formatting” . A sample reference list is provided with the final draft of Jorge’s paper later in this chapter.

Using Primary and Secondary Research

As you write your draft, be mindful of how you are using primary and secondary source material to support your points. Recall that primary sources present firsthand information. Secondary sources are one step removed from primary sources. They present a writer’s analysis or interpretation of primary source materials. How you balance primary and secondary source material in your paper will depend on the topic and assignment.

Using Primary Sources Effectively

Some types of research papers must use primary sources extensively to achieve their purpose. Any paper that analyzes a primary text or presents the writer’s own experimental research falls in this category. Here are a few examples:

  • A paper for a literature course analyzing several poems by Emily Dickinson
  • A paper for a political science course comparing televised speeches delivered by two presidential candidates
  • A paper for a communications course discussing gender biases in television commercials
  • A paper for a business administration course that discusses the results of a survey the writer conducted with local businesses to gather information about their work-from-home and flextime policies
  • A paper for an elementary education course that discusses the results of an experiment the writer conducted to compare the effectiveness of two different methods of mathematics instruction

For these types of papers, primary research is the main focus. If you are writing about a work (including nonprint works, such as a movie or a painting), it is crucial to gather information and ideas from the original work, rather than relying solely on others’ interpretations. And, of course, if you take the time to design and conduct your own field research, such as a survey, a series of interviews, or an experiment, you will want to discuss it in detail. For example, the interviews may provide interesting responses that you want to share with your reader.

Using Secondary Sources Effectively

For some assignments, it makes sense to rely more on secondary sources than primary sources. If you are not analyzing a text or conducting your own field research, you will need to use secondary sources extensively.

As much as possible, use secondary sources that are closely linked to primary research, such as a journal article presenting the results of the authors’ scientific study or a book that cites interviews and case studies. These sources are more reliable and add more value to your paper than sources that are further removed from primary research. For instance, a popular magazine article on junk-food addiction might be several steps removed from the original scientific study on which it is loosely based. As a result, the article may distort, sensationalize, or misinterpret the scientists’ findings.

Even if your paper is largely based on primary sources, you may use secondary sources to develop your ideas. For instance, an analysis of Alfred Hitchcock’s films would focus on the films themselves as a primary source, but might also cite commentary from critics. A paper that presents an original experiment would include some discussion of similar prior research in the field.

Jorge knew he did not have the time, resources, or experience needed to conduct original experimental research for his paper. Because he was relying on secondary sources to support his ideas, he made a point of citing sources that were not far removed from primary research.

Some sources could be considered primary or secondary sources, depending on the writer’s purpose for using them. For instance, if a writer’s purpose is to inform readers about how the No Child Left Behind legislation has affected elementary education, a Time magazine article on the subject would be a secondary source. However, suppose the writer’s purpose is to analyze how the news media has portrayed the effects of the No Child Left Behind legislation. In that case, articles about the legislation in news magazines like Time , Newsweek , and US News & World Report would be primary sources. They provide firsthand examples of the media coverage the writer is analyzing.

Avoiding Plagiarism

Your research paper presents your thinking about a topic, supported and developed by other people’s ideas and information. It is crucial to always distinguish between the two—as you conduct research, as you plan your paper, and as you write. Failure to do so can lead to plagiarism.

Intentional and Accidental Plagiarism

Plagiarism is the act of misrepresenting someone else’s work as your own. Sometimes a writer plagiarizes work on purpose—for instance, by purchasing an essay from a website and submitting it as original course work. In other cases, a writer may commit accidental plagiarism due to carelessness, haste, or misunderstanding. To avoid unintentional plagiarism, follow these guidelines:

  • Understand what types of information must be cited.
  • Understand what constitutes fair use of a source.
  • Keep source materials and notes carefully organized.
  • Follow guidelines for summarizing, paraphrasing, and quoting sources.

When to Cite

Any idea or fact taken from an outside source must be cited, in both the body of your paper and the references list. The only exceptions are facts or general statements that are common knowledge. Common-knowledge facts or general statements are commonly supported by and found in multiple sources. For example, a writer would not need to cite the statement that most breads, pastas, and cereals are high in carbohydrates; this is well known and well documented. However, if a writer explained in detail the differences among the chemical structures of carbohydrates, proteins, and fats, a citation would be necessary. When in doubt, cite.

In recent years, issues related to the fair use of sources have been prevalent in popular culture. Recording artists, for example, may disagree about the extent to which one has the right to sample another’s music. For academic purposes, however, the guidelines for fair use are reasonably straightforward.

Writers may quote from or paraphrase material from previously published works without formally obtaining the copyright holder’s permission. Fair use means that the writer legitimately uses brief excerpts from source material to support and develop his or her own ideas. For instance, a columnist may excerpt a few sentences from a novel when writing a book review. However, quoting or paraphrasing another’s work at excessive length, to the extent that large sections of the writing are unoriginal, is not fair use.

As he worked on his draft, Jorge was careful to cite his sources correctly and not to rely excessively on any one source. Occasionally, however, he caught himself quoting a source at great length. In those instances, he highlighted the paragraph in question so that he could go back to it later and revise. Read the example, along with Jorge’s revision.

Heinz (2009) found that “subjects in the low-carbohydrate group (30% carbohydrates; 40% protein, 30% fat) had a mean weight loss of 10 kg (22 lbs) over a 4-month period.” These results were “noticeably better than results for subjects on a low-fat diet (45% carbohydrates, 35% protein, 20% fat)” whose average weight loss was only “7 kg (15.4 lbs) in the same period.” From this, it can be concluded that “low-carbohydrate diets obtain more rapid results.” Other researchers agree that “at least in the short term, patients following low-carbohydrate diets enjoy greater success” than those who follow alternative plans (Johnson & Crowe, 2010).

After reviewing the paragraph, Jorge realized that he had drifted into unoriginal writing. Most of the paragraph was taken verbatim from a single article. Although Jorge had enclosed the material in quotation marks, he knew it was not an appropriate way to use the research in his paper.

Low-carbohydrate diets may indeed be superior to other diet plans for short-term weight loss. In a study comparing low-carbohydrate diets and low-fat diets, Heinz (2009) found that subjects who followed a low-carbohydrate plan (30% of total calories) for 4 months lost, on average, about 3 kilograms more than subjects who followed a low-fat diet for the same time. Heinz concluded that these plans yield quick results, an idea supported by a similar study conducted by Johnson and Crowe (2010). What remains to be seen, however, is whether this initial success can be sustained for longer periods.

As Jorge revised the paragraph, he realized he did not need to quote these sources directly. Instead, he paraphrased their most important findings. He also made sure to include a topic sentence stating the main idea of the paragraph and a concluding sentence that transitioned to the next major topic in his essay.

Working with Sources Carefully

Disorganization and carelessness sometimes lead to plagiarism. For instance, a writer may be unable to provide a complete, accurate citation if he didn’t record bibliographical information. A writer may cut and paste a passage from a website into her paper and later forget where the material came from. A writer who procrastinates may rush through a draft, which easily leads to sloppy paraphrasing and inaccurate quotations. Any of these actions can create the appearance of plagiarism and lead to negative consequences.

Carefully organizing your time and notes is the best guard against these forms of plagiarism. Maintain a detailed working bibliography and thorough notes throughout the research process. Check original sources again to clear up any uncertainties. Allow plenty of time for writing your draft so there is no temptation to cut corners.

Citing other people’s work appropriately is just as important in the workplace as it is in school. If you need to consult outside sources to research a document you are creating, follow the general guidelines already discussed, as well as any industry-specific citation guidelines. For more extensive use of others’ work—for instance, requesting permission to link to another company’s website on your own corporate website—always follow your employer’s established procedures.

Academic Integrity

The concepts and strategies discussed in this section of Chapter 12 “Writing a Research Paper” connect to a larger issue—academic integrity. You maintain your integrity as a member of an academic community by representing your work and others’ work honestly and by using other people’s work only in legitimately accepted ways. It is a point of honor taken seriously in every academic discipline and career field.

Academic integrity violations have serious educational and professional consequences. Even when cheating and plagiarism go undetected, they still result in a student’s failure to learn necessary research and writing skills. Students who are found guilty of academic integrity violations face consequences ranging from a failing grade to expulsion from the university. Employees may be fired for plagiarism and do irreparable damage to their professional reputation. In short, it is never worth the risk.

Key Takeaways

  • An effective research paper focuses on the writer’s ideas. The introduction and conclusion present and revisit the writer’s thesis. The body of the paper develops the thesis and related points with information from research.
  • Ideas and information taken from outside sources must be cited in the body of the paper and in the references section.
  • Material taken from sources should be used to develop the writer’s ideas. Summarizing and paraphrasing are usually most effective for this purpose.
  • A summary concisely restates the main ideas of a source in the writer’s own words.
  • A paraphrase restates ideas from a source using the writer’s own words and sentence structures.
  • Direct quotations should be used sparingly. Ellipses and brackets must be used to indicate words that were omitted or changed for conciseness or grammatical correctness.
  • Always represent material from outside sources accurately.
  • Plagiarism has serious academic and professional consequences. To avoid accidental plagiarism, keep research materials organized, understand guidelines for fair use and appropriate citation of sources, and review the paper to make sure these guidelines are followed.

Writing for Success Copyright © 2015 by University of Minnesota is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

How to Write and Publish a Research Paper for a Peer-Reviewed Journal

  • Open access
  • Published: 30 April 2020
  • Volume 36 , pages 909–913, ( 2021 )

Cite this article

You have full access to this open access article

criteria of research paper

  • Clara Busse   ORCID: orcid.org/0000-0002-0178-1000 1 &
  • Ella August   ORCID: orcid.org/0000-0001-5151-1036 1 , 2  

282k Accesses

17 Citations

709 Altmetric

Explore all metrics

Communicating research findings is an essential step in the research process. Often, peer-reviewed journals are the forum for such communication, yet many researchers are never taught how to write a publishable scientific paper. In this article, we explain the basic structure of a scientific paper and describe the information that should be included in each section. We also identify common pitfalls for each section and recommend strategies to avoid them. Further, we give advice about target journal selection and authorship. In the online resource 1 , we provide an example of a high-quality scientific paper, with annotations identifying the elements we describe in this article.

Similar content being viewed by others

criteria of research paper

How to Choose the Right Journal

criteria of research paper

The Point Is…to Publish?

criteria of research paper

Writing and publishing a scientific paper

Explore related subjects.

  • Artificial Intelligence

Avoid common mistakes on your manuscript.

Introduction

Writing a scientific paper is an important component of the research process, yet researchers often receive little formal training in scientific writing. This is especially true in low-resource settings. In this article, we explain why choosing a target journal is important, give advice about authorship, provide a basic structure for writing each section of a scientific paper, and describe common pitfalls and recommendations for each section. In the online resource 1 , we also include an annotated journal article that identifies the key elements and writing approaches that we detail here. Before you begin your research, make sure you have ethical clearance from all relevant ethical review boards.

Select a Target Journal Early in the Writing Process

We recommend that you select a “target journal” early in the writing process; a “target journal” is the journal to which you plan to submit your paper. Each journal has a set of core readers and you should tailor your writing to this readership. For example, if you plan to submit a manuscript about vaping during pregnancy to a pregnancy-focused journal, you will need to explain what vaping is because readers of this journal may not have a background in this topic. However, if you were to submit that same article to a tobacco journal, you would not need to provide as much background information about vaping.

Information about a journal’s core readership can be found on its website, usually in a section called “About this journal” or something similar. For example, the Journal of Cancer Education presents such information on the “Aims and Scope” page of its website, which can be found here: https://www.springer.com/journal/13187/aims-and-scope .

Peer reviewer guidelines from your target journal are an additional resource that can help you tailor your writing to the journal and provide additional advice about crafting an effective article [ 1 ]. These are not always available, but it is worth a quick web search to find out.

Identify Author Roles Early in the Process

Early in the writing process, identify authors, determine the order of authors, and discuss the responsibilities of each author. Standard author responsibilities have been identified by The International Committee of Medical Journal Editors (ICMJE) [ 2 ]. To set clear expectations about each team member’s responsibilities and prevent errors in communication, we also suggest outlining more detailed roles, such as who will draft each section of the manuscript, write the abstract, submit the paper electronically, serve as corresponding author, and write the cover letter. It is best to formalize this agreement in writing after discussing it, circulating the document to the author team for approval. We suggest creating a title page on which all authors are listed in the agreed-upon order. It may be necessary to adjust authorship roles and order during the development of the paper. If a new author order is agreed upon, be sure to update the title page in the manuscript draft.

In the case where multiple papers will result from a single study, authors should discuss who will author each paper. Additionally, authors should agree on a deadline for each paper and the lead author should take responsibility for producing an initial draft by this deadline.

Structure of the Introduction Section

The introduction section should be approximately three to five paragraphs in length. Look at examples from your target journal to decide the appropriate length. This section should include the elements shown in Fig.  1 . Begin with a general context, narrowing to the specific focus of the paper. Include five main elements: why your research is important, what is already known about the topic, the “gap” or what is not yet known about the topic, why it is important to learn the new information that your research adds, and the specific research aim(s) that your paper addresses. Your research aim should address the gap you identified. Be sure to add enough background information to enable readers to understand your study. Table 1 provides common introduction section pitfalls and recommendations for addressing them.

figure 1

The main elements of the introduction section of an original research article. Often, the elements overlap

Methods Section

The purpose of the methods section is twofold: to explain how the study was done in enough detail to enable its replication and to provide enough contextual detail to enable readers to understand and interpret the results. In general, the essential elements of a methods section are the following: a description of the setting and participants, the study design and timing, the recruitment and sampling, the data collection process, the dataset, the dependent and independent variables, the covariates, the analytic approach for each research objective, and the ethical approval. The hallmark of an exemplary methods section is the justification of why each method was used. Table 2 provides common methods section pitfalls and recommendations for addressing them.

Results Section

The focus of the results section should be associations, or lack thereof, rather than statistical tests. Two considerations should guide your writing here. First, the results should present answers to each part of the research aim. Second, return to the methods section to ensure that the analysis and variables for each result have been explained.

Begin the results section by describing the number of participants in the final sample and details such as the number who were approached to participate, the proportion who were eligible and who enrolled, and the number of participants who dropped out. The next part of the results should describe the participant characteristics. After that, you may organize your results by the aim or by putting the most exciting results first. Do not forget to report your non-significant associations. These are still findings.

Tables and figures capture the reader’s attention and efficiently communicate your main findings [ 3 ]. Each table and figure should have a clear message and should complement, rather than repeat, the text. Tables and figures should communicate all salient details necessary for a reader to understand the findings without consulting the text. Include information on comparisons and tests, as well as information about the sample and timing of the study in the title, legend, or in a footnote. Note that figures are often more visually interesting than tables, so if it is feasible to make a figure, make a figure. To avoid confusing the reader, either avoid abbreviations in tables and figures, or define them in a footnote. Note that there should not be citations in the results section and you should not interpret results here. Table 3 provides common results section pitfalls and recommendations for addressing them.

Discussion Section

Opposite the introduction section, the discussion should take the form of a right-side-up triangle beginning with interpretation of your results and moving to general implications (Fig.  2 ). This section typically begins with a restatement of the main findings, which can usually be accomplished with a few carefully-crafted sentences.

figure 2

Major elements of the discussion section of an original research article. Often, the elements overlap

Next, interpret the meaning or explain the significance of your results, lifting the reader’s gaze from the study’s specific findings to more general applications. Then, compare these study findings with other research. Are these findings in agreement or disagreement with those from other studies? Does this study impart additional nuance to well-accepted theories? Situate your findings within the broader context of scientific literature, then explain the pathways or mechanisms that might give rise to, or explain, the results.

Journals vary in their approach to strengths and limitations sections: some are embedded paragraphs within the discussion section, while some mandate separate section headings. Keep in mind that every study has strengths and limitations. Candidly reporting yours helps readers to correctly interpret your research findings.

The next element of the discussion is a summary of the potential impacts and applications of the research. Should these results be used to optimally design an intervention? Does the work have implications for clinical protocols or public policy? These considerations will help the reader to further grasp the possible impacts of the presented work.

Finally, the discussion should conclude with specific suggestions for future work. Here, you have an opportunity to illuminate specific gaps in the literature that compel further study. Avoid the phrase “future research is necessary” because the recommendation is too general to be helpful to readers. Instead, provide substantive and specific recommendations for future studies. Table 4 provides common discussion section pitfalls and recommendations for addressing them.

Follow the Journal’s Author Guidelines

After you select a target journal, identify the journal’s author guidelines to guide the formatting of your manuscript and references. Author guidelines will often (but not always) include instructions for titles, cover letters, and other components of a manuscript submission. Read the guidelines carefully. If you do not follow the guidelines, your article will be sent back to you.

Finally, do not submit your paper to more than one journal at a time. Even if this is not explicitly stated in the author guidelines of your target journal, it is considered inappropriate and unprofessional.

Your title should invite readers to continue reading beyond the first page [ 4 , 5 ]. It should be informative and interesting. Consider describing the independent and dependent variables, the population and setting, the study design, the timing, and even the main result in your title. Because the focus of the paper can change as you write and revise, we recommend you wait until you have finished writing your paper before composing the title.

Be sure that the title is useful for potential readers searching for your topic. The keywords you select should complement those in your title to maximize the likelihood that a researcher will find your paper through a database search. Avoid using abbreviations in your title unless they are very well known, such as SNP, because it is more likely that someone will use a complete word rather than an abbreviation as a search term to help readers find your paper.

After you have written a complete draft, use the checklist (Fig. 3 ) below to guide your revisions and editing. Additional resources are available on writing the abstract and citing references [ 5 ]. When you feel that your work is ready, ask a trusted colleague or two to read the work and provide informal feedback. The box below provides a checklist that summarizes the key points offered in this article.

figure 3

Checklist for manuscript quality

Data Availability

Michalek AM (2014) Down the rabbit hole…advice to reviewers. J Cancer Educ 29:4–5

Article   Google Scholar  

International Committee of Medical Journal Editors. Defining the role of authors and contributors: who is an author? http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authosrs-and-contributors.html . Accessed 15 January, 2020

Vetto JT (2014) Short and sweet: a short course on concise medical writing. J Cancer Educ 29(1):194–195

Brett M, Kording K (2017) Ten simple rules for structuring papers. PLoS ComputBiol. https://doi.org/10.1371/journal.pcbi.1005619

Lang TA (2017) Writing a better research article. J Public Health Emerg. https://doi.org/10.21037/jphe.2017.11.06

Download references

Acknowledgments

Ella August is grateful to the Sustainable Sciences Institute for mentoring her in training researchers on writing and publishing their research.

Code Availability

Not applicable.

Author information

Authors and affiliations.

Department of Maternal and Child Health, University of North Carolina Gillings School of Global Public Health, 135 Dauer Dr, 27599, Chapel Hill, NC, USA

Clara Busse & Ella August

Department of Epidemiology, University of Michigan School of Public Health, 1415 Washington Heights, Ann Arbor, MI, 48109-2029, USA

Ella August

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Ella August .

Ethics declarations

Conflicts of interests.

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

(PDF 362 kb)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Busse, C., August, E. How to Write and Publish a Research Paper for a Peer-Reviewed Journal. J Canc Educ 36 , 909–913 (2021). https://doi.org/10.1007/s13187-020-01751-z

Download citation

Published : 30 April 2020

Issue Date : October 2021

DOI : https://doi.org/10.1007/s13187-020-01751-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Manuscripts
  • Scientific writing
  • Find a journal
  • Publish with us
  • Track your research

criteria of research paper

Online Students

For All Online Programs

International Students

On Campus, need or have Visa

Campus Students

For All Campus Programs

What a Thesis Paper is and How to Write One

A student sitting at her laptop working on her college thesis paper.

From choosing a topic and conducting research to crafting a strong argument, writing a thesis paper can be a rewarding experience.

It can also be a challenging experience. If you've never written a thesis paper before, you may not know where to start. You may not even be sure exactly what a thesis paper is. But don't worry; the right support and resources can help you navigate this writing process.

What is a Thesis Paper?

Shana Chartier,  director of information literacy at SNHU.

A thesis paper is a type of academic essay that you might write as a graduation requirement for certain bachelor's, master's or honors programs. Thesis papers present your own original research or analysis on a specific topic related to your field.

“In some ways, a thesis paper can look a lot like a novella,” said Shana Chartier , director of information literacy at Southern New Hampshire University (SNHU). “It’s too short to be a full-length novel, but with the standard size of 40-60 pages (for a bachelor’s) and 60-100 pages (for a master’s), it is a robust exploration of a topic, explaining one’s understanding of a topic based on personal research.”

Chartier has worked in academia for over 13 years and at SNHU for nearly eight. In her role as an instructor and director, Chartier has helped to guide students through the writing process, like editing and providing resources.

Chartier has written and published academic papers such as "Augmented Reality Gamifies the Library: A Ride Through the Technological Frontier" and "Going Beyond the One-Shot: Spiraling Information Literacy Across Four Years." Both of these academic papers required Chartier to have hands-on experience with the subject matter. Like a thesis paper, they also involved hypothesizing and doing original research to come to a conclusion.

“When writing a thesis paper, the importance of staying organized cannot be overstated,” said Chartier. “Mapping out each step of the way, making firm and soft deadlines... and having other pairs of eyes on your work to ensure academic accuracy and clean editing are crucial to writing a successful paper.”

How Do I Choose a Topic For My Thesis Paper?

Rochelle Attari, a peer tutor at SNHU.

What your thesis paper is for will determine some of the specific requirements and steps you might take, but the first step is usually the same: Choosing a topic.

“Choosing a topic can be daunting," said Rochelle Attari , a peer tutor at SNHU. "But if (you) stick with a subject (you're) interested in... choosing a topic is much more manageable.”

Similar to a thesis, Attari recently finished the capstone  for her bachelor’s in psychology . Her bachelor’s concentration is in forensics, and her capstone focused on the topic of using a combined therapy model for inmates who experience substance abuse issues to reduce recidivism.

“The hardest part was deciding what I wanted to focus on,” Attari said. “But once I nailed down my topic, each milestone was more straightforward.”

In her own writing experience, Attari said brainstorming was an important step when choosing her topic. She recommends writing down different ideas on a piece of paper and doing some preliminary research on what’s already been written on your topic.

By doing this exercise, you can narrow or broaden your ideas until you’ve found a topic you’re excited about. " Brainstorming is essential when writing a paper and is not a last-minute activity,” Attari said.

How Do I Structure My Thesis Paper?

An icon of a white-outlined checklist with three items checked off

Thesis papers tend to have a standard format with common sections as the building blocks.

While the structure Attari describes below will work for many theses, it’s important to double-check with your program to see if there are any specific requirements. Writing a thesis for a Master of Fine Arts, for example, might actually look more like a fiction novel.

According to Attari, a thesis paper is often structured with the following major sections:

Introduction

  • Literature review
  • Methods, results

Now, let’s take a closer look at what each different section should include.

A blue and white icon of a pencil writing on lines

Your introduction is your opportunity to present the topic of your thesis paper. In this section, you can explain why that topic is important. The introduction is also the place to include your thesis statement, which shows your stance in the paper.

Attari said that writing an introduction can be tricky, especially when you're trying to capture your reader’s attention and state your argument.

“I have found that starting with a statement of truth about a topic that pertains to an issue I am writing about typically does the trick,” Attari said. She demonstrated this advice in an example introduction she wrote for a paper on the effects of daylight in Alaska:

In the continental United States, we can always count on the sun rising and setting around the same time each day, but in Alaska, during certain times of the year, the sun rises and does not set for weeks. Research has shown that the sun provides vitamin D and is an essential part of our health, but little is known about how daylight twenty-four hours a day affects the circadian rhythm and sleep.

In the example Attari wrote, she introduces the topic and informs the reader what the paper will cover. Somewhere in her intro, she said she would also include her thesis statement, which might be:

Twenty-four hours of daylight over an extended period does not affect sleep patterns in humans and is not the cause of daytime fatigue in northern Alaska .

Literature Review

In the literature review, you'll look at what information is already out there about your topic. “This is where scholarly articles  about your topic are essential,” said Attari. “These articles will help you find the gap in research that you have identified and will also support your thesis statement."

Telling your reader what research has already been done will help them see how your research fits into the larger conversation. Most university libraries offer databases of scholarly/peer-reviewed articles that can be helpful in your search.

In the methods section of your thesis paper, you get to explain how you learned what you learned. This might include what experiment you conducted as a part of your independent research.

“For instance,” Attari said, “if you are a psychology major and have identified a gap in research on which therapies are effective for anxiety, your methods section would consist of the number of participants, the type of experiment and any other particulars you would use for that experiment.”

In this section, you'll explain the results of your study. For example, building on the psychology example Attari outlined, you might share self-reported anxiety levels for participants trying different kinds of therapies. To help you communicate your results clearly, you might include data, charts, tables or other visualizations.

The discussion section of your thesis paper is where you will analyze and interpret the results you presented in the previous section. This is where you can discuss what your findings really mean or compare them to the research you found in your literature review.

The discussion section is your chance to show why the data you collected matters and how it fits into bigger conversations in your field.

The conclusion of your thesis paper is your opportunity to sum up your argument and leave your reader thinking about why your research matters.

Attari breaks the conclusion down into simple parts. “You restate the original issue and thesis statement, explain the experiment's results and discuss possible next steps for further research,” she said.

Find Your Program

Resources to help write your thesis paper.

an icon of a computer's keyboard

While your thesis paper may be based on your independent research, writing it doesn’t have to be a solitary process. Asking for help and using the resources that are available to you can make the process easier.

If you're writing a thesis paper, some resources Chartier encourages you to use are:

  • Citation Handbooks: An online citation guide or handbook can help you ensure your citations are correct. APA , MLA and Chicago styles have all published their own guides.
  • Citation Generators: There are many citation generator tools that help you to create citations. Some — like RefWorks — even let you directly import citations from library databases as you research.
  • Your Library's Website: Many academic and public libraries allow patrons to access resources like databases or FAQs. Some FAQs at the SNHU library that might be helpful in your thesis writing process include “ How do I read a scholarly article? ” or “ What is a research question and how do I develop one? ”

It can also be helpful to check out what coaching or tutoring options are available through your school. At SNHU, for example, the Academic Support Center offers writing and grammar workshops , and students can access 24/7 tutoring and 1:1 sessions with peer tutors, like Attari.

"Students can even submit their papers and receive written feedback... like revisions and editing suggestions," she said.

If you are writing a thesis paper, there are many resources available to you. It's a long paper, but with the right mindset and support, you can successfully navigate the process.

“Pace yourself,” said Chartier. “This is a marathon, not a sprint. Setting smaller goals to get to the big finish line can make the process seem less daunting, and remember to be proud of yourself and celebrate your accomplishment once you’re done. Writing a thesis is no small task, and it’s important work for the scholarly community.”

A degree can change your life. Choose your program  from 200+ SNHU degrees that can take you where you want to go.

Meg Palmer ’18 is a writer and scholar by trade who loves reading, riding her bike and singing in a barbershop quartet. She earned her bachelor’s degree in English, language and literature at Southern New Hampshire University (SNHU) and her master’s degree in writing, rhetoric and discourse at DePaul University (’20). While attending SNHU, she served as the editor-in-chief of the campus student newspaper, The Penmen Press, where she deepened her passion for writing. Meg is an adjunct professor at Johnson and Wales University, where she teaches first year writing, honors composition, and public speaking. Connect with her on LinkedIn .

Explore more content like this article

A person with a laptop and notebook, considering the difference between a bachelor's degree and a master's degree.

What is the Difference Between Bachelor’s and Master’s Degrees?

 A student holding a stack of books in a library working on academic referencing for their research paper.

Academic Referencing: How to Cite a Research Paper

A student at a desk, typing on a computer

What is Considered Plagiarism And How to Avoid It

About southern new hampshire university.

Two students walking in front of Monadnock Hall

SNHU is a nonprofit, accredited university with a mission to make high-quality education more accessible and affordable for everyone.

Founded in 1932, and online since 1995, we’ve helped countless students reach their goals with flexible, career-focused programs . Our 300-acre campus in Manchester, NH is home to over 3,000 students, and we serve over 135,000 students online. Visit our about SNHU  page to learn more about our mission, accreditations, leadership team, national recognitions and awards.

Cart

  • SUGGESTED TOPICS
  • The Magazine
  • Newsletters
  • Managing Yourself
  • Managing Teams
  • Work-life Balance
  • The Big Idea
  • Data & Visuals
  • Reading Lists
  • Case Selections
  • HBR Learning
  • Topic Feeds
  • Account Settings
  • Email Preferences

Research: How to Build Consensus Around a New Idea

  • Devon Proudfoot
  • Wayne Johnson

criteria of research paper

Strategies for overcoming the disagreements that can stymie innovation.

Previous research has found that new ideas are seen as risky and are often rejected. New research suggests that this rejection can be due to people’s lack of shared criteria or reference points when evaluating a potential innovation’s value. In a new paper, the authors find that the more novel the idea, the more people differ on their perception of its value. They also found that disagreement itself can make people view ideas as risky and make them less likely to support them, regardless of how novel the idea is. To help teams get on the same page when it comes to new ideas, they suggest gathering information about evaluator’s reference points and developing criteria that can lead to more focused discussions.

Picture yourself in a meeting where a new idea has just been pitched, representing a major departure from your company’s standard practices. The presenter is confident about moving forward, but their voice is quickly overtaken by a cacophony of opinions from firm opposition to enthusiastic support. How can you make sense of the noise? What weight do you give each of these opinions? And what does this disagreement say about the idea?

criteria of research paper

  • DP Devon Proudfoot is an Associate Professor of Human Resource Studies at Cornell’s ILR School. She studies topics related to diversity and creativity at work.
  • Wayne Johnson is a researcher at the Utah Eccles School of Business. He focuses on evaluations and decisions about new information, including persuasion regarding creative ideas and belief change.

Partner Center

  • Skip to Guides Search
  • Skip to breadcrumb
  • Skip to main content
  • Skip to footer
  • Skip to chat link
  • Report accessibility issues and get help
  • Go to Penn Libraries Home
  • Go to Franklin catalog

CWP: Craft of Prose: Researching the White Paper

  • Getting started
  • News and Opinion Sites
  • Academic Sources
  • Grey Literature
  • Substantive News Sources
  • What to Do When You Are Stuck
  • Understanding a citation
  • Examples of Quotation
  • Examples of Paraphrase
  • Chicago Manual of Style: Citing Images
  • Researching the Op-Ed
  • Researching Prospective Employers
  • Resume Resources
  • Cover Letter Resources

Research the White Paper

Researching the white paper:.

The process of researching and composing a white paper shares some similarities with the kind of research and writing one does for a high school or college research paper. What’s important for writers of white papers to grasp, however, is how much this genre differs from a research paper.  First, the author of a white paper already recognizes that there is a problem to be solved, a decision to be made, and the job of the author is to provide readers with substantive information to help them make some kind of decision--which may include a decision to do more research because major gaps remain. 

Thus, a white paper author would not “brainstorm” a topic. Instead, the white paper author would get busy figuring out how the problem is defined by those who are experiencing it as a problem. Typically that research begins in popular culture--social media, surveys, interviews, newspapers. Once the author has a handle on how the problem is being defined and experienced, its history and its impact, what people in the trenches believe might be the best or worst ways of addressing it, the author then will turn to academic scholarship as well as “grey” literature (more about that later).  Unlike a school research paper, the author does not set out to argue for or against a particular position, and then devote the majority of effort to finding sources to support the selected position.  Instead, the author sets out in good faith to do as much fact-finding as possible, and thus research is likely to present multiple, conflicting, and overlapping perspectives. When people research out of a genuine desire to understand and solve a problem, they listen to every source that may offer helpful information. They will thus have to do much more analysis, synthesis, and sorting of that information, which will often not fall neatly into a “pro” or “con” camp:  Solution A may, for example, solve one part of the problem but exacerbate another part of the problem. Solution C may sound like what everyone wants, but what if it’s built on a set of data that have been criticized by another reliable source?  And so it goes. 

For example, if you are trying to write a white paper on the opioid crisis, you may focus on the value of  providing free, sterilized needles--which do indeed reduce disease, and also provide an opportunity for the health care provider distributing them to offer addiction treatment to the user. However, the free needles are sometimes discarded on the ground, posing a danger to others; or they may be shared; or they may encourage more drug usage. All of those things can be true at once; a reader will want to know about all of these considerations in order to make an informed decision. That is the challenging job of the white paper author.     
 The research you do for your white paper will require that you identify a specific problem, seek popular culture sources to help define the problem, its history, its significance and impact for people affected by it.  You will then delve into academic and grey literature to learn about the way scholars and others with professional expertise answer these same questions. In this way, you will create creating a layered, complex portrait that provides readers with a substantive exploration useful for deliberating and decision-making. You will also likely need to find or create images, including tables, figures, illustrations or photographs, and you will document all of your sources. 

Latin American Studies Librarian

Profile Photo

Connect to a Librarian Live Chat or "Ask a Question"

  • Librarians staff live chat from 9-5 Monday through Friday . You can also text to chat: 215-543-7674
  • You can submit a question 24 hours a day and we aim to respond within 24 hours 
  • You can click the "Schedule Appointment" button above in librarian's profile box (to the left), to schedule a consultation with her in person or by video conference.  
  • You can also make an appointment with a  Librarian by subject specialization . 
  • Connect by email with a subject librarian

Find more easy contacts at our Quick Start Guide

  • Next: Getting started >>
  • Last Updated: Aug 26, 2024 1:21 PM
  • URL: https://guides.library.upenn.edu/c.php?g=1419866

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

  • Knowledge Base
  • Working with sources
  • Evaluating Sources | Methods & Examples

Evaluating Sources | Methods & Examples

Published on June 2, 2022 by Eoghan Ryan . Revised on May 31, 2023.

The sources you use are an important component of your research. It’s important to evaluate the sources you’re considering using, in order to:

  • Ensure that they’re credible
  • Determine whether they’re relevant to your topic
  • Assess the quality of their arguments

Table of contents

Evaluating a source’s credibility, evaluating a source’s relevance, evaluating a source’s arguments, other interesting articles, frequently asked questions about evaluating sources.

Evaluating the credibility of a source is an important way of sifting out misinformation and determining whether you should use it in your research. Useful approaches include the CRAAP test and lateral reading .

One of the best ways to evaluate source credibility is the CRAAP test . This stands for:

  • Currency: Does the source reflect recent research?
  • Relevance: Is the source related to your research topic?
  • Authority: Is it a respected publication? Is the author an expert in their field?
  • Accuracy: Does the source support its arguments and conclusions with evidence?
  • Purpose: What is the author’s intention?

How you evaluate a source using these criteria will depend on your subject and focus. It’s important to understand the types of sources and how you should use them in your field of research.

Lateral reading

Lateral reading is the act of evaluating the credibility of a source by comparing it to other sources. This allows you to:

  • Verify evidence
  • Contextualize information
  • Find potential weaknesses

If a source is using methods or drawing conclusions that are incompatible with other research in its field, it may not be reliable.

Rather than taking these figures at face value, you decide to determine the accuracy of the source’s claims by cross-checking them with official statistics such as census reports and figures compiled by the Department of Homeland Security’s Office of Immigration Statistics.

Prevent plagiarism. Run a free check.

How you evaluate the relevance of a source will depend on your topic, and on where you are in the research process . Preliminary evaluation helps you to pick out relevant sources in your search, while in-depth evaluation allows you to understand how they’re related.

Preliminary evaluation

As you cannot possibly read every source related to your topic, you can use preliminary evaluation to determine which sources might be relevant. This is especially important when you’re surveying a large number of sources (e.g., in a literature review or systematic review ).

One way to do this is to look at paratextual material, or the parts of a work other than the text itself.

  • Look at the table of contents to determine the scope of the work.
  • Consult the index for key terms or the names of important scholars.

You can also read abstracts , prefaces , introductions , and conclusions . These will give you a clear idea of the author’s intentions, the parameters of the research, and even the conclusions they draw.

Preliminary evaluation is useful as it allows you to:

  • Determine whether a source is worth examining in more depth
  • Quickly move on to more relevant sources
  • Increase the quality of the information you consume

While this preliminary evaluation is an important step in the research process, you should engage with sources more deeply in order to adequately understand them.

In-depth evaluation

Begin your in-depth evaluation with any landmark studies in your field of research, or with sources that you’re sure are related to your research topic.

As you read, try to understand the connections between the sources. Look for:

  • Key debates: What topics or questions are currently influencing research? How does the source respond to these key debates?
  • Major publications or critics: Are there any specific texts or scholars that have greatly influenced the field? How does the source engage with them?
  • Trends: Is the field currently dominated by particular theories or research methods ? How does the source respond to these?
  • Gaps: Are there any oversights or weaknesses in the research?

Even sources whose conclusions you disagree with can be relevant, as they can strengthen your argument by offering alternative perspectives.

Every source should contribute to the debate about its topic by taking a clear position. This position and the conclusions the author comes to should be supported by evidence from direct observation or from other sources.

Most sources will use a mix of primary and secondary sources to form an argument . It is important to consider how the author uses these sources. A good argument should be based on analysis and critique, and there should be a logical relationship between evidence and conclusions.

To assess an argument’s strengths and weaknesses, ask:

  • Does the evidence support the claim?
  • How does the author use evidence? What theories, methods, or models do they use?
  • Could the evidence be used to draw other conclusions? Can it be interpreted differently?
  • How does the author situate their argument in the field? Do they agree or disagree with other scholars? Do they confirm or challenge established knowledge?

Situating a source in relation to other sources ( lateral reading ) can help you determine whether the author’s arguments and conclusions are reliable and how you will respond to them in your own writing.

If you want to know more about ChatGPT, AI tools , citation , and plagiarism , make sure to check out some of our other articles with explanations and examples.

  • ChatGPT vs human editor
  • ChatGPT citations
  • Is ChatGPT trustworthy?
  • Using ChatGPT for your studies
  • What is ChatGPT?
  • Chicago style
  • Paraphrasing

 Plagiarism

  • Types of plagiarism
  • Self-plagiarism
  • Avoiding plagiarism
  • Academic integrity
  • Consequences of plagiarism
  • Common knowledge

Don't submit your assignments before you do this

The academic proofreading tool has been trained on 1000s of academic texts. Making it the most accurate and reliable proofreading tool for students. Free citation check included.

criteria of research paper

Try for free

As you cannot possibly read every source related to your topic, it’s important to evaluate sources to assess their relevance. Use preliminary evaluation to determine whether a source is worth examining in more depth.

This involves:

  • Reading abstracts , prefaces, introductions , and conclusions
  • Looking at the table of contents to determine the scope of the work
  • Consulting the index for key terms or the names of important scholars

Lateral reading is the act of evaluating the credibility of a source by comparing it with other sources. This allows you to:

A credible source should pass the CRAAP test  and follow these guidelines:

  • The information should be up to date and current.
  • The author and publication should be a trusted authority on the subject you are researching.
  • The sources the author cited should be easy to find, clear, and unbiased.
  • For a web source, the URL and layout should signify that it is trustworthy.

The CRAAP test is an acronym to help you evaluate the credibility of a source you are considering using. It is an important component of information literacy .

The CRAAP test has five main components:

  • Currency: Is the source up to date?
  • Relevance: Is the source relevant to your research?
  • Authority: Where is the source published? Who is the author? Are they considered reputable and trustworthy in their field?
  • Accuracy: Is the source supported by evidence? Are the claims cited correctly?
  • Purpose: What was the motive behind publishing this source?

Scholarly sources are written by experts in their field and are typically subjected to peer review . They are intended for a scholarly audience, include a full bibliography, and use scholarly or technical language. For these reasons, they are typically considered credible sources .

Popular sources like magazines and news articles are typically written by journalists. These types of sources usually don’t include a bibliography and are written for a popular, rather than academic, audience. They are not always reliable and may be written from a biased or uninformed perspective, but they can still be cited in some contexts.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Ryan, E. (2023, May 31). Evaluating Sources | Methods & Examples. Scribbr. Retrieved September 3, 2024, from https://www.scribbr.com/working-with-sources/evaluating-sources/

Is this article helpful?

Eoghan Ryan

Eoghan Ryan

Other students also liked, student guide: information literacy | meaning & examples, types of sources explained | examples & tips, what are credible sources & how to spot them | examples, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

  • Skip to main content
  • Skip to search
  • Skip to footer

Products and Services

criteria of research paper

Partnerships that make everything possible

A Cisco partnership provides you exclusive benefits like programs and specializations made to reward you, training and enablement that modernize your practice, and opportunities to transform your capabilities and selling motions.

Register as a Cisco partner or affiliate your account

For new companies.

Log in with your Cisco account and register your company as a Cisco partner to gain access to exclusive partner content.

For individuals

Log in with your Cisco account and associate that account with an existing Cisco partner company to gain access to exclusive partner content.

Your profitability is our number 1 goal

criteria of research paper

Partner Program

A program that is flexibly structured around how you deliver value to customers.

criteria of research paper

Marketing Velocity

Training to help modernize your marketing approach, customizable campaigns, and access to a top-tier digital community.

criteria of research paper

Paths to transformation

Explore the possibilities of how Cisco can help you build new capabilities and evolving customer needs.

Cisco partners bring real results

The stadium of the future.

Successful businesses don't always play by the rules. Cisco Partner AmpThink isn’t just playing the game, they’re redefining it—and they’re winning.

Paving the way for others

One of the first members of the African American Cisco Partner Community, TGS is helping to open doors for other black-owned companies.

Find a partner

Partners work to integrate, build, buy, and consult on solutions, software, and services for their customers.

@CiscoPartners

Cisco Partner

Cisco Partners

Partner Blogs

This week: the arXiv Accessibility Forum

Help | Advanced Search

Computer Science > Computation and Language

Title: awes, laws, and flaws from today's llm research.

Abstract: We perform a critical examination of the scientific methodology behind contemporary large language model (LLM) research. For this we assess over 2,000 research works based on criteria typical of what is considered good research (e.g. presence of statistical tests and reproducibility) and cross-validate it with arguments that are at the centre of controversy (e.g., claims of emergent behaviour, the use of LLMs as evaluators). We find multiple trends, such as declines in claims of emergent behaviour and ethics disclaimers; the rise of LLMs as evaluators in spite of a lack of consensus from the community about their useability; and an increase of claims of LLM reasoning abilities, typically without leveraging human evaluation. This paper underscores the need for more scrutiny and rigour by and from this field to live up to the fundamentals of a responsible scientific method that is ethical, reproducible, systematic, and open to criticism.
Comments: Under review -- v1 was an old draft with an unrevised abstract (oops)
Subjects: Computation and Language (cs.CL)
Cite as: [cs.CL]
  (or [cs.CL] for this version)
  Focus to learn more arXiv-issued DOI via DataCite

Submission history

Access paper:.

  • HTML (experimental)
  • Other Formats

license icon

References & Citations

  • Google Scholar
  • Semantic Scholar

BibTeX formatted citation

BibSonomy logo

Bibliographic and Citation Tools

Code, data and media associated with this article, recommenders and search tools.

  • Institution

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs .

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • ScientificWorldJournal
  • v.2024; 2024
  • PMC10807936

Logo of tswj

Writing a Scientific Review Article: Comprehensive Insights for Beginners

Ayodeji amobonye.

1 Department of Biotechnology and Food Science, Faculty of Applied Sciences, Durban University of Technology, P.O. Box 1334, KwaZulu-Natal, Durban 4000, South Africa

2 Writing Centre, Durban University of Technology, P.O. Box 1334 KwaZulu-Natal, Durban 4000, South Africa

Japareng Lalung

3 School of Industrial Technology, Universiti Sains Malaysia, Gelugor 11800, Pulau Pinang, Malaysia

Santhosh Pillai

Associated data.

The data and materials that support the findings of this study are available from the corresponding author upon reasonable request.

Review articles present comprehensive overview of relevant literature on specific themes and synthesise the studies related to these themes, with the aim of strengthening the foundation of knowledge and facilitating theory development. The significance of review articles in science is immeasurable as both students and researchers rely on these articles as the starting point for their research. Interestingly, many postgraduate students are expected to write review articles for journal publications as a way of demonstrating their ability to contribute to new knowledge in their respective fields. However, there is no comprehensive instructional framework to guide them on how to analyse and synthesise the literature in their niches into publishable review articles. The dearth of ample guidance or explicit training results in students having to learn all by themselves, usually by trial and error, which often leads to high rejection rates from publishing houses. Therefore, this article seeks to identify these challenges from a beginner's perspective and strives to plug the identified gaps and discrepancies. Thus, the purpose of this paper is to serve as a systematic guide for emerging scientists and to summarise the most important information on how to write and structure a publishable review article.

1. Introduction

Early scientists, spanning from the Ancient Egyptian civilization to the Scientific Revolution of the 16 th /17 th century, based their research on intuitions, personal observations, and personal insights. Thus, less time was spent on background reading as there was not much literature to refer to. This is well illustrated in the case of Sir Isaac Newton's apple tree and the theory of gravity, as well as Gregor Mendel's pea plants and the theory of inheritance. However, with the astronomical expansion in scientific knowledge and the emergence of the information age in the last century, new ideas are now being built on previously published works, thus the periodic need to appraise the huge amount of already published literature [ 1 ]. According to Birkle et al. [ 2 ], the Web of Science—an authoritative database of research publications and citations—covered more than 80 million scholarly materials. Hence, a critical review of prior and relevant literature is indispensable for any research endeavour as it provides the necessary framework needed for synthesising new knowledge and for highlighting new insights and perspectives [ 3 ].

Review papers are generally considered secondary research publications that sum up already existing works on a particular research topic or question and relate them to the current status of the topic. This makes review articles distinctly different from scientific research papers. While the primary aim of the latter is to develop new arguments by reporting original research, the former is focused on summarising and synthesising previous ideas, studies, and arguments, without adding new experimental contributions. Review articles basically describe the content and quality of knowledge that are currently available, with a special focus on the significance of the previous works. To this end, a review article cannot simply reiterate a subject matter, but it must contribute to the field of knowledge by synthesising available materials and offering a scholarly critique of theory [ 4 ]. Typically, these articles critically analyse both quantitative and qualitative studies by scrutinising experimental results, the discussion of the experimental data, and in some instances, previous review articles to propose new working theories. Thus, a review article is more than a mere exhaustive compilation of all that has been published on a topic; it must be a balanced, informative, perspective, and unbiased compendium of previous studies which may also include contrasting findings, inconsistencies, and conventional and current views on the subject [ 5 ].

Hence, the essence of a review article is measured by what is achieved, what is discovered, and how information is communicated to the reader [ 6 ]. According to Steward [ 7 ], a good literature review should be analytical, critical, comprehensive, selective, relevant, synthetic, and fully referenced. On the other hand, a review article is considered to be inadequate if it is lacking in focus or outcome, overgeneralised, opinionated, unbalanced, and uncritical [ 7 ]. Most review papers fail to meet these standards and thus can be viewed as mere summaries of previous works in a particular field of study. In one of the few studies that assessed the quality of review articles, none of the 50 papers that were analysed met the predefined criteria for a good review [ 8 ]. However, beginners must also realise that there is no bad writing in the true sense; there is only writing in evolution and under refinement. Literally, every piece of writing can be improved upon, right from the first draft until the final published manuscript. Hence, a paper can only be referred to as bad and unfixable when the author is not open to corrections or when the writer gives up on it.

According to Peat et al. [ 9 ], “everything is easy when you know how,” a maxim which applies to scientific writing in general and review writing in particular. In this regard, the authors emphasized that the writer should be open to learning and should also follow established rules instead of following a blind trial-and-error approach. In contrast to the popular belief that review articles should only be written by experienced scientists and researchers, recent trends have shown that many early-career scientists, especially postgraduate students, are currently expected to write review articles during the course of their studies. However, these scholars have little or no access to formal training on how to analyse and synthesise the research literature in their respective fields [ 10 ]. Consequently, students seeking guidance on how to write or improve their literature reviews are less likely to find published works on the subject, particularly in the science fields. Although various publications have dealt with the challenges of searching for literature, or writing literature reviews for dissertation/thesis purposes, there is little or no information on how to write a comprehensive review article for publication. In addition to the paucity of published information to guide the potential author, the lack of understanding of what constitutes a review paper compounds their challenges. Thus, the purpose of this paper is to serve as a guide for writing review papers for journal publishing. This work draws on the experience of the authors to assist early-career scientists/researchers in the “hard skill” of authoring review articles. Even though there is no single path to writing scientifically, or to writing reviews in particular, this paper attempts to simplify the process by looking at this subject from a beginner's perspective. Hence, this paper highlights the differences between the types of review articles in the sciences while also explaining the needs and purpose of writing review articles. Furthermore, it presents details on how to search for the literature as well as how to structure the manuscript to produce logical and coherent outputs. It is hoped that this work will ease prospective scientific writers into the challenging but rewarding art of writing review articles.

2. Benefits of Review Articles to the Author

Analysing literature gives an overview of the “WHs”: WHat has been reported in a particular field or topic, WHo the key writers are, WHat are the prevailing theories and hypotheses, WHat questions are being asked (and answered), and WHat methods and methodologies are appropriate and useful [ 11 ]. For new or aspiring researchers in a particular field, it can be quite challenging to get a comprehensive overview of their respective fields, especially the historical trends and what has been studied previously. As such, the importance of review articles to knowledge appraisal and contribution cannot be overemphasised, which is reflected in the constant demand for such articles in the research community. However, it is also important for the author, especially the first-time author, to recognise the importance of his/her investing time and effort into writing a quality review article.

Generally, literature reviews are undertaken for many reasons, mainly for publication and for dissertation purposes. The major purpose of literature reviews is to provide direction and information for the improvement of scientific knowledge. They also form a significant component in the research process and in academic assessment [ 12 ]. There may be, however, a thin line between a dissertation literature review and a published review article, given that with some modifications, a literature review can be transformed into a legitimate and publishable scholarly document. According to Gülpınar and Güçlü [ 6 ], the basic motivation for writing a review article is to make a comprehensive synthesis of the most appropriate literature on a specific research inquiry or topic. Thus, conducting a literature review assists in demonstrating the author's knowledge about a particular field of study, which may include but not be limited to its history, theories, key variables, vocabulary, phenomena, and methodologies [ 10 ]. Furthermore, publishing reviews is beneficial as it permits the researchers to examine different questions and, as a result, enhances the depth and diversity of their scientific reasoning [ 1 ]. In addition, writing review articles allows researchers to share insights with the scientific community while identifying knowledge gaps to be addressed in future research. The review writing process can also be a useful tool in training early-career scientists in leadership, coordination, project management, and other important soft skills necessary for success in the research world [ 13 ]. Another important reason for authoring reviews is that such publications have been observed to be remarkably influential, extending the reach of an author in multiple folds of what can be achieved by primary research papers [ 1 ]. The trend in science is for authors to receive more citations from their review articles than from their original research articles. According to Miranda and Garcia-Carpintero [ 14 ], review articles are, on average, three times more frequently cited than original research articles; they also asserted that a 20% increase in review authorship could result in a 40–80% increase in citations of the author. As a result, writing reviews can significantly impact a researcher's citation output and serve as a valuable channel to reach a wider scientific audience. In addition, the references cited in a review article also provide the reader with an opportunity to dig deeper into the topic of interest. Thus, review articles can serve as a valuable repository for consultation, increasing the visibility of the authors and resulting in more citations.

3. Types of Review Articles

The first step in writing a good literature review is to decide on the particular type of review to be written; hence, it is important to distinguish and understand the various types of review articles. Although scientific review articles have been classified according to various schemes, however, they are broadly categorised into narrative reviews, systematic reviews, and meta-analyses [ 15 ]. It was observed that more authors—as well as publishers—were leaning towards systematic reviews and meta-analysis while downplaying narrative reviews; however, the three serve different aims and should all be considered equally important in science [ 1 ]. Bibliometric reviews and patent reviews, which are closely related to meta-analysis, have also gained significant attention recently. However, from another angle, a review could also be of two types. In the first class, authors could deal with a widely studied topic where there is already an accumulated body of knowledge that requires analysis and synthesis [ 3 ]. At the other end of the spectrum, the authors may have to address an emerging issue that would benefit from exposure to potential theoretical foundations; hence, their contribution would arise from the fresh theoretical foundations proposed in developing a conceptual model [ 3 ].

3.1. Narrative Reviews

Narrative reviewers are mainly focused on providing clarification and critical analysis on a particular topic or body of literature through interpretative synthesis, creativity, and expert judgement. According to Green et al. [ 16 ], a narrative review can be in the form of editorials, commentaries, and narrative overviews. However, editorials and commentaries are usually expert opinions; hence, a beginner is more likely to write a narrative overview, which is more general and is also referred to as an unsystematic narrative review. Similarly, the literature review section of most dissertations and empirical papers is typically narrative in nature. Typically, narrative reviews combine results from studies that may have different methodologies to address different questions or to formulate a broad theoretical formulation [ 1 ]. They are largely integrative as strong focus is placed on the assimilation and synthesis of various aspects in the review, which may involve comparing and contrasting research findings or deriving structured implications [ 17 ]. In addition, they are also qualitative studies because they do not follow strict selection processes; hence, choosing publications is relatively more subjective and unsystematic [ 18 ]. However, despite their popularity, there are concerns about their inherent subjectivity. In many instances, when the supporting data for narrative reviews are examined more closely, the evaluations provided by the author(s) become quite questionable [ 19 ]. Nevertheless, if the goal of the author is to formulate a new theory that connects diverse strands of research, a narrative method is most appropriate.

3.2. Systematic Reviews

In contrast to narrative reviews, which are generally descriptive, systematic reviews employ a systematic approach to summarise evidence on research questions. Hence, systematic reviews make use of precise and rigorous criteria to identify, evaluate, and subsequently synthesise all relevant literature on a particular topic [ 12 , 20 ]. As a result, systematic reviews are more likely to inspire research ideas by identifying knowledge gaps or inconsistencies, thus helping the researcher to clearly define the research hypotheses or questions [ 21 ]. Furthermore, systematic reviews may serve as independent research projects in their own right, as they follow a defined methodology to search and combine reliable results to synthesise a new database that can be used for a variety of purposes [ 22 ]. Typically, the peculiarities of the individual reviewer, different search engines, and information databases used all ensure that no two searches will yield the same systematic results even if the searches are conducted simultaneously and under identical criteria [ 11 ]. Hence, attempts are made at standardising the exercise via specific methods that would limit bias and chance effects, prevent duplications, and provide more accurate results upon which conclusions and decisions can be made.

The most established of these methods is the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines which objectively defined statements, guidelines, reporting checklists, and flowcharts for undertaking systematic reviews as well as meta-analysis [ 23 ]. Though mainly designed for research in medical sciences, the PRISMA approach has gained wide acceptance in other fields of science and is based on eight fundamental propositions. These include the explicit definition of the review question, an unambiguous outline of the study protocol, an objective and exhaustive systematic review of reputable literature, and an unambiguous identification of included literature based on defined selection criteria [ 24 ]. Other considerations include an unbiased appraisal of the quality of the selected studies (literature), organic synthesis of the evidence of the study, preparation of the manuscript based on the reporting guidelines, and periodic update of the review as new data emerge [ 24 ]. Other methods such as PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols), MOOSE (Meta-analysis Of Observational Studies in Epidemiology), and ROSES (Reporting Standards for Systematic Evidence Syntheses) have since been developed for systematic reviews (and meta-analysis), with most of them being derived from PRISMA.

Consequently, systematic reviews—unlike narrative reviews—must contain a methodology section which in addition to all that was highlighted above must fully describe the precise criteria used in formulating the research question and setting the inclusion or exclusion criteria used in selecting/accessing the literature. Similarly, the criteria for evaluating the quality of the literature included in the review as well as for analysing, synthesising, and disseminating the findings must be fully described in the methodology section.

3.3. Meta-Analysis

Meta-analyses are considered as more specialised forms of systematic reviews. Generally, they combine the results of many studies that use similar or closely related methods to address the same question or share a common quantitative evaluation method [ 25 ]. However, meta-analyses are also a step higher than other systematic reviews as they are focused on numerical data and involve the use of statistics in evaluating different studies and synthesising new knowledge. The major advantage of this type of review is the increased statistical power leading to more reliable results for inferring modest associations and a more comprehensive understanding of the true impact of a research study [ 26 ]. Unlike in traditional systematic reviews, research topics covered in meta-analyses must be mature enough to allow the inclusion of sufficient homogeneous empirical research in terms of subjects, interventions, and outcomes [ 27 , 28 ].

Being an advanced form of systematic review, meta-analyses must also have a distinct methodology section; hence, the standard procedures involved in the traditional systematic review (especially PRISMA) also apply in meta-analyses [ 23 ]. In addition to the common steps in formulating systematic reviews, meta-analyses are required to describe how nested and missing data are handled, the effect observed in each study, the confidence interval associated with each synthesised effect, and any potential for bias presented within the sample(s) [ 17 ]. According to Paul and Barari [ 28 ], a meta-analysis must also detail the final sample, the meta-analytic model, and the overall analysis, moderator analysis, and software employed. While the overall analysis involves the statistical characterization of the relationships between variables in the meta-analytic framework and their significance, the moderator analysis defines the different variables that may affect variations in the original studies [ 28 , 29 ]. It must also be noted that the accuracy and reliability of meta-analyses have both been significantly enhanced by the incorporation of statistical approaches such as Bayesian analysis [ 30 ], network analysis [ 31 ], and more recently, machine learning [ 32 ].

3.4. Bibliometric Review

A bibliometric review, commonly referred to as bibliometric analysis, is a systematic evaluation of published works within a specific field or discipline [ 33 ]. This bibliometric methodology involves the use of quantitative methods to analyse bibliometric data such as the characteristics and numbers of publications, units of citations, authorship, co-authorship, and journal impact factors [ 34 ]. Academics use bibliometric analysis with different objectives in mind, which includes uncovering emerging trends in article and journal performance, elaborating collaboration patterns and research constituents, evaluating the impact and influence of particular authors, publications, or research groups, and highlighting the intellectual framework of a certain field [ 35 ]. It is also used to inform policy and decision-making. Similarly to meta-analysis, bibliometric reviews rely upon quantitative techniques, thus avoiding the interpretation bias that could arise from the qualitative techniques of other types of reviews [ 36 ]. However, while bibliometric analysis synthesises the bibliometric and intellectual structure of a field by examining the social and structural linkages between various research parts, meta-analysis focuses on summarising empirical evidence by probing the direction and strength of effects and relationships among variables, especially in open research questions [ 37 , 38 ]. However, similarly to systematic review and meta-analysis, a bibliometric review also requires a well-detailed methodology section. The amount of data to be analysed in bibliometric analysis is quite massive, running to hundreds and tens of thousands in some cases. Although the data are objective in nature (e.g., number of citations and publications and occurrences of keywords and topics), the interpretation is usually carried out through both objective (e.g., performance analysis) and subjective (e.g., thematic analysis) evaluations [ 35 ]. However, the invention and availability of bibliometric software such as BibExcel, Gephi, Leximancer, and VOSviewer and scientific databases such as Dimensions, Web of Science, and Scopus have made this type of analysis more feasible.

3.5. Patent Review

Patent reviews provide a comprehensive analysis and critique of a specific patent or a group of related patents, thus presenting a concise understanding of the technology or innovation that is covered by the patent [ 39 ]. This type of article is useful for researchers as it also enhances their understanding of the legal, technical, and commercial aspects of an intellectual property/innovation; in addition, it is also important for stakeholders outside the research community including IP (intellectual property) specialists, legal professionals, and technology-transfer officers [ 40 ]. Typically, patent reviews encompass the scope, background, claims, legal implications, technical specifications, and potential commercial applications of the patent(s). The article may also include a discussion of the patent's strengths and weaknesses, as well as its potential impact on the industry or field in which it operates. Most times, reviews are time specified, they may be regionalised, and the data are usually retrieved via patent searches on databases such as that of the European Patent Office ( https://www.epo.org/searching.html ), United States Patent and Trademark Office ( https://patft.uspto.gov/ ), the World Intellectual Property Organization's PATENTSCOPE ( https://patentscope.wipo.int/search/en/structuredSearch.jsf ), Google Patent ( https://www.google.com/?tbm=pts ), and China National Intellectual Property Administration ( https://pss-system.cponline.cnipa.gov.cn/conventionalSearch ). According to Cerimi et al. [ 41 ], the retrieved data and analysed may include the patent number, patent status, filing date, application date, grant dates, inventor, assignee, and pending applications. While data analysis is usually carried out by general data software such as Microsoft Excel, an intelligence software solely dedicated to patent research and analysis, Orbit Intelligence has been found to be more efficient [ 39 ]. It is also mandatory to include a methodology section in a patent review, and this should be explicit, thorough, and precise to allow a clear understanding of how the analysis was carried out and how the conclusions were arrived at.

4. Searching Literature

One of the most challenging tasks in writing a review article on a subject is the search for relevant literature to populate the manuscript as the author is required to garner information from an endless number of sources. This is even more challenging as research outputs have been increasing astronomically, especially in the last decade, with thousands of new articles published annually in various fields. It is therefore imperative that the author must not only be aware of the overall trajectory in a field of investigation but must also be cognizant of recent studies so as not to publish outdated research or review articles. Basically, the search for the literature involves a coherent conceptual structuring of the topic itself and a thorough collation of evidence under the common themes which might reflect the histories, conflicts, standoffs, revolutions, and/or evolutions in the field [ 7 ]. To start the search process, the author must carefully identify and select broad keywords relevant to the subject; subsequently, the keywords should be developed to refine the search into specific subheadings that would facilitate the structure of the review.

Two main tactics have been identified for searching the literature, namely, systematic and snowballing [ 42 ]. The systematic approach involves searching literature with specific keywords (for example, cancer, antioxidant, and nanoparticles), which leads to an almost unmanageable and overwhelming list of possible sources [ 43 ]. The snowballing approach, however, involves the identification of a particular publication, followed by the compilation of a bibliography of articles based on the reference list of the identified publication [ 44 ]. Many times, it might be necessary to combine both approaches, but irrespective, the author must keep an accurate track and record of papers cited in the search. A simple and efficient strategy for populating the bibliography of review articles is to go through the abstract (and sometimes the conclusion) of a paper; if the abstract is related to the topic of discourse, the author might go ahead and read the entire article; otherwise, he/she is advised to move on [ 45 ]. Winchester and Salji [ 5 ] noted that to learn the background of the subject/topic to be reviewed, starting literature searches with academic textbooks or published review articles is imperative, especially for beginners. Furthermore, it would also assist in compiling the list of keywords, identifying areas of further exploration, and providing a glimpse of the current state of the research. However, past reviews ideally are not to serve as the foundation of a new review as they are written from someone else's viewpoint, which might have been tainted with some bias. Fortunately, the accessibility and search for the literature have been made relatively easier than they were a few decades ago as the current information age has placed an enormous volume of knowledge right at our fingertips [ 46 ]. Nevertheless, when gathering the literature from the Internet, authors should exercise utmost caution as much of the information may not be verified or peer-reviewed and thus may be unregulated and unreliable. For instance, Wikipedia, despite being a large repository of information with more than 6.7 million articles in the English language alone, is considered unreliable for scientific literature reviews, due to its openness to public editing [ 47 ]. However, in addition to peer-reviewed journal publications—which are most ideal—reviews can also be drawn from a wide range of other sources such as technical documents, in-house reports, conference abstracts, and conference proceedings. Similarly, “Google Scholar”—as against “Google” and other general search engines—is more appropriate as its searches are restricted to only academic articles produced by scholarly societies or/and publishers [ 48 ]. Furthermore, the various electronic databases, such as ScienceDirect, Web of Science, PubMed, and MEDLINE, many of which focus on specific fields of research, are also ideal options [ 49 ]. Advancement in computer indexing has remarkably expanded the ease and ability to search large databases for every potentially relevant article. In addition to searching by topic, literature search can be modified by time; however, there must be a balance between old papers and recent ones. The general consensus in science is that publications less than five years old are considered recent.

It is important, especially in systematic reviews and meta-analyses, that the specific method of running the computer searches be properly documented as there is the need to include this in the method (methodology) section of such papers. Typically, the method details the keywords, databases explored, search terms used, and the inclusion/exclusion criteria applied in the selection of data and any other specific decision/criteria. All of these will ensure the reproducibility and thoroughness of the search and the selection procedure. However, Randolph [ 10 ] noted that Internet searches might not give the exhaustive list of articles needed for a review article; hence, it is advised that authors search through the reference lists of articles that were obtained initially from the Internet search. After determining the relevant articles from the list, the author should read through the references of these articles and repeat the cycle until saturation is reached [ 10 ]. After populating the articles needed for the literature review, the next step is to analyse them individually and in their whole entirety. A systematic approach to this is to identify the key information within the papers, examine them in depth, and synthesise original perspectives by integrating the information and making inferences based on the findings. In this regard, it is imperative to link one source to the other in a logical manner, for instance, taking note of studies with similar methodologies, papers that agree, or results that are contradictory [ 42 ].

5. Structuring the Review Article

The title and abstract are the main selling points of a review article, as most readers will only peruse these two elements and usually go on to read the full paper if they are drawn in by either or both of the two. Tullu [ 50 ] recommends that the title of a scientific paper “should be descriptive, direct, accurate, appropriate, interesting, concise, precise, unique, and not be misleading.” In addition to providing “just enough details” to entice the reader, words in the titles are also used by electronic databases, journal websites, and search engines to index and retrieve a particular paper during a search [ 51 ]. Titles are of different types and must be chosen according to the topic under review. They are generally classified as descriptive, declarative, or interrogative and can also be grouped into compound, nominal, or full-sentence titles [ 50 ]. The subject of these categorisations has been extensively discussed in many articles; however, the reader must also be aware of the compound titles, which usually contain a main title and a subtitle. Typically, subtitles provide additional context—to the main title—and they may specify the geographic scope of the research, research methodology, or sample size [ 52 ].

Just like primary research articles, there are many debates about the optimum length of a review article's title. However, the general consensus is to keep the title as brief as possible while not being too general. A title length between 10 and 15 words is recommended, since longer titles can be more challenging to comprehend. Paiva et al. [ 53 ] observed that articles which contain 95 characters or less get more views and citations. However, emphasis must be placed on conciseness as the audience will be more satisfied if they can understand what exactly the review has contributed to the field, rather than just a hint about the general topic area. Authors should also endeavour to stick to the journal's specific requirements, especially regarding the length of the title and what they should or should not contain [ 9 ]. Thus, avoidance of filler words such as “a review on/of,” “an observation of,” or “a study of” is a very simple way to limit title length. In addition, abbreviations or acronyms should be avoided in the title, except the standard or commonly interpreted ones such as AIDS, DNA, HIV, and RNA. In summary, to write an effective title, the authors should consider the following points. What is the paper about? What was the methodology used? What were the highlights and major conclusions? Subsequently, the author should list all the keywords from these answers, construct a sentence from these keywords, and finally delete all redundant words from the sentence title. It is also possible to gain some ideas by scanning indices and article titles in major journals in the field. It is important to emphasise that a title is not chosen and set in stone, and the title is most likely to be continually revised and adjusted until the end of the writing process.

5.2. Abstract

The abstract, also referred to as the synopsis, is a summary of the full research paper; it is typically independent and can stand alone. For most readers, a publication does not exist beyond the abstract, partly because abstracts are often the only section of a paper that is made available to the readers at no cost, whereas the full paper may attract a payment or subscription [ 54 ]. Thus, the abstract is supposed to set the tone for the few readers who wish to read the rest of the paper. It has also been noted that the abstract gives the first impression of a research work to journal editors, conference scientific committees, or referees, who might outright reject the paper if the abstract is poorly written or inadequate [ 50 ]. Hence, it is imperative that the abstract succinctly represents the entire paper and projects it positively. Just like the title, abstracts have to be balanced, comprehensive, concise, functional, independent, precise, scholarly, and unbiased and not be misleading [ 55 ]. Basically, the abstract should be formulated using keywords from all the sections of the main manuscript. Thus, it is pertinent that the abstract conveys the focus, key message, rationale, and novelty of the paper without any compromise or exaggeration. Furthermore, the abstract must be consistent with the rest of the paper; as basic as this instruction might sound, it is not to be taken for granted. For example, a study by Vrijhoef and Steuten [ 56 ] revealed that 18–68% of 264 abstracts from some scientific journals contained information that was inconsistent with the main body of the publications.

Abstracts can either be structured or unstructured; in addition, they can further be classified as either descriptive or informative. Unstructured abstracts, which are used by many scientific journals, are free flowing with no predefined subheadings, while structured abstracts have specific subheadings/subsections under which the abstract needs to be composed. Structured abstracts have been noted to be more informative and are usually divided into subsections which include the study background/introduction, objectives, methodology design, results, and conclusions [ 57 ]. No matter the style chosen, the author must carefully conform to the instructions provided by the potential journal of submission, which may include but are not limited to the format, font size/style, word limit, and subheadings [ 58 ]. The word limit for abstracts in most scientific journals is typically between 150 and 300 words. It is also a general rule that abstracts do not contain any references whatsoever.

Typically, an abstract should be written in the active voice, and there is no such thing as a perfect abstract as it could always be improved on. It is advised that the author first makes an initial draft which would contain all the essential parts of the paper, which could then be polished subsequently. The draft should begin with a brief background which would lead to the research questions. It might also include a general overview of the methodology used (if applicable) and importantly, the major results/observations/highlights of the review paper. The abstract should end with one or few sentences about any implications, perspectives, or future research that may be developed from the review exercise. Finally, the authors should eliminate redundant words and edit the abstract to the correct word count permitted by the journal [ 59 ]. It is always beneficial to read previous abstracts published in the intended journal, related topics/subjects from other journals, and other reputable sources. Furthermore, the author should endeavour to get feedback on the abstract especially from peers and co-authors. As the abstract is the face of the whole paper, it is best that it is the last section to be finalised, as by this time, the author would have developed a clearer understanding of the findings and conclusions of the entire paper.

5.3. Graphical Abstracts

Since the mid-2000s, an increasing number of journals now require authors to provide a graphical abstract (GA) in addition to the traditional written abstract, to increase the accessibility of scientific publications to readers [ 60 ]. A study showed that publications with GA performed better than those without it, when the abstract views, total citations, and downloads were compared [ 61 ]. However, the GA should provide “a single, concise pictorial, and visual summary of the main findings of an article” [ 62 ]. Although they are meant to be a stand-alone summary of the whole paper, it has been noted that they are not so easily comprehensible without having read through the traditionally written abstract [ 63 ]. It is important to note that, like traditional abstracts, many reputable journals require GAs to adhere to certain specifications such as colour, dimension, quality, file size, and file format (usually JPEG/JPG, PDF, PNG, or TIFF). In addition, it is imperative to use engaging and accurate figures, all of which must be synthesised in order to accurately reflect the key message of the paper. Currently, there are various online or downloadable graphical tools that can be used for creating GAs, such as Microsoft Paint or PowerPoint, Mindthegraph, ChemDraw, CorelDraw, and BioRender.

5.4. Keywords

As a standard practice, journals require authors to select 4–8 keywords (or phrases), which are typically listed below the abstract. A good set of keywords will enable indexers and search engines to find relevant papers more easily and can be considered as a very concise abstract [ 64 ]. According to Dewan and Gupta [ 51 ], the selection of appropriate keywords will significantly enhance the retrieval, accession, and consequently, the citation of the review paper. Ideally, keywords can be variants of the terms/phrases used in the title, the abstract, and the main text, but they should ideally not be the exact words in the main title. Choosing the most appropriate keywords for a review article involves listing down the key terms and phrases in the article, including abbreviations. Subsequently, a quick review of the glossary/vocabulary/term list or indexing standard in the specific discipline will assist in selecting the best and most precise keywords that match those used in the databases from the list drawn. In addition, the keywords should not be broad or general terms (e.g., DNA, biology, and enzymes) but must be specific to the field or subfield of study as well as to the particular paper [ 65 ].

5.5. Introduction

The introduction of an article is the first major section of the manuscript, and it presents basic information to the reader without compelling them to study past publications. In addition, the introduction directs the reader to the main arguments and points developed in the main body of the article while clarifying the current state of knowledge in that particular area of research [ 12 ]. The introduction part of a review article is usually sectionalised into background information, a description of the main topic and finally a statement of the main purpose of the review [ 66 ]. Authors may begin the introduction with brief general statements—which provide background knowledge on the subject matter—that lead to more specific ones [ 67 ]. It is at this point that the reader's attention must be caught as the background knowledge must highlight the importance and justification for the subject being discussed, while also identifying the major problem to be addressed [ 68 ]. In addition, the background should be broad enough to attract even nonspecialists in the field to maximise the impact and widen the reach of the article. All of these should be done in the light of current literature; however, old references may also be used for historical purposes. A very important aspect of the introduction is clearly stating and establishing the research problem(s) and how a review of the particular topic contributes to those problem(s). Thus, the research gap which the paper intends to fill, the limitations of previous works and past reviews, if available, and the new knowledge to be contributed must all be highlighted. Inadequate information and the inability to clarify the problem will keep readers (who have the desire to obtain new information) from reading beyond the introduction [ 69 ]. It is also pertinent that the author establishes the purpose of reviewing the literature and defines the scope as well as the major synthesised point of view. Furthermore, a brief insight into the criteria used to select, evaluate, and analyse the literature, as well as the outline or sequence of the review, should be provided in the introduction. Subsequently, the specific objectives of the review article must be presented. The last part of the “introduction” section should focus on the solution, the way forward, the recommendations, and the further areas of research as deduced from the whole review process. According to DeMaria [ 70 ], clearly expressed or recommended solutions to an explicitly revealed problem are very important for the wholesomeness of the “introduction” section. It is believed that following these steps will give readers the opportunity to track the problems and the corresponding solution from their own perspective in the light of current literature. As against some suggestions that the introduction should be written only in present tenses, it is also believed that it could be done with other tenses in addition to the present tense. In this regard, general facts should be written in the present tense, specific research/work should be in the past tense, while the concluding statement should be in the past perfect or simple past. Furthermore, many of the abbreviations to be used in the rest of the manuscript and their explanations should be defined in this section.

5.6. Methodology

Writing a review article is equivalent to conducting a research study, with the information gathered by the author (reviewer) representing the data. Like all major studies, it involves conceptualisation, planning, implementation, and dissemination [ 71 ], all of which may be detailed in a methodology section, if necessary. Hence, the methodological section of a review paper (which can also be referred to as the review protocol) details how the relevant literature was selected and how it was analysed as well as summarised. The selection details may include, but are not limited to, the database consulted and the specific search terms used together with the inclusion/exclusion criteria. As earlier highlighted in Section 3 , a description of the methodology is required for all types of reviews except for narrative reviews. This is partly because unlike narrative reviews, all other review articles follow systematic approaches which must ensure significant reproducibility [ 72 ]. Therefore, where necessary, the methods of data extraction from the literature and data synthesis must also be highlighted as well. In some cases, it is important to show how data were combined by highlighting the statistical methods used, measures of effect, and tests performed, as well as demonstrating heterogeneity and publication bias [ 73 ].

The methodology should also detail the major databases consulted during the literature search, e.g., Dimensions, ScienceDirect, Web of Science, MEDLINE, and PubMed. For meta-analysis, it is imperative to highlight the software and/or package used, which could include Comprehensive Meta-Analysis, OpenMEE, Review Manager (RevMan), Stata, SAS, and R Studio. It is also necessary to state the mathematical methods used for the analysis; examples of these include the Bayesian analysis, the Mantel–Haenszel method, and the inverse variance method. The methodology should also state the number of authors that carried out the initial review stage of the study, as it has been recommended that at least two reviews should be done blindly and in parallel, especially when it comes to the acquisition and synthesis of data [ 74 ]. Finally, the quality and validity assessment of the publication used in the review must be stated and well clarified [ 73 ].

5.7. Main Body of the Review

Ideally, the main body of a publishable review should answer these questions: What is new (contribution)? Why so (logic)? So what (impact)? How well it is done (thoroughness)? The flow of the main body of a review article must be well organised to adequately maintain the attention of the readers as well as guide them through the section. It is recommended that the author should consider drawing a conceptual scheme of the main body first, using methods such as mind-mapping. This will help create a logical flow of thought and presentation, while also linking the various sections of the manuscript together. According to Moreira [ 75 ], “reports do not simply yield their findings, rather reviewers make them yield,” and thus, it is the author's responsibility to transform “resistant” texts into “docile” texts. Hence, after the search for the literature, the essential themes and key concepts of the review paper must be identified and synthesised together. This synthesis primarily involves creating hypotheses about the relationships between the concepts with the aim of increasing the understanding of the topic being reviewed. The important information from the various sources should not only be summarised, but the significance of studies must be related back to the initial question(s) posed by the review article. Furthermore, MacLure [ 76 ] stated that data are not just to be plainly “extracted intact” and “used exactly as extracted,” but must be modified, reconfigured, transformed, transposed, converted, tabulated, graphed, or manipulated to enable synthesis, combination, and comparison. Therefore, different pieces of information must be extracted from the reports in which they were previously deposited and then refined into the body of the new article [ 75 ]. To this end, adequate comparison and combination might require that “qualitative data be quantified” or/and “quantitative data may be qualitized” [ 77 ]. In order to accomplish all of these goals, the author may have to transform, paraphrase, generalize, specify, and reorder the text [ 78 ]. For comprehensiveness, the body paragraphs should be arranged in a similar order as it was initially stated in the abstract or/and introduction. Thus, the main body could be divided into thematic areas, each of which could be independently comprehensive and treated as a mini review. Similarly, the sections can also be arranged chronologically depending on the focus of the review. Furthermore, the abstractions should proceed from a wider general view of the literature being reviewed and then be narrowed down to the specifics. In the process, deep insights should also be provided between the topic of the review and the wider subject area, e.g., fungal enzymes and enzymes in general. The abstractions must also be discussed in more detail by presenting more specific information from the identified sources (with proper citations of course!). For example, it is important to identify and highlight contrary findings and rival interpretations as well as to point out areas of agreement or debate among different bodies of literature. Often, there are previous reviews on the same topic/concept; however, this does not prevent a new author from writing one on the same topic, especially if the previous reviews were written many years ago. However, it is important that the body of the new manuscript be written from a new angle that was not adequately covered in the past reviews and should also incorporate new studies that have accumulated since the last review(s). In addition, the new review might also highlight the approaches, limitations, and conclusions of the past studies. But the authors must not be excessively critical of the past reviews as this is regarded by many authors as a sign of poor professionalism [ 3 , 79 ]. Daft [ 79 ] emphasized that it is more important for a reviewer to state how their research builds on previous work instead of outright claiming that previous works are incompetent and inadequate. However, if a series of related papers on one topic have a common error or research flaw that needs rectification, the reviewer must point this out with the aim of moving the field forward [ 3 ]. Like every other scientific paper, the main body of a review article also needs to be consistent in style, for example, in the choice of passive vs. active voice and present vs. past tense. It is also important to note that tables and figures can serve as a powerful tool for highlighting key points in the body of the review, and they are now considered core elements of reviews. For more guidance and insights into what should make up the contents of a good review article, readers are also advised to get familiarised with the Boote and Beile [ 80 ] literature review scoring rubric as well as the review article checklist of Short [ 81 ].

5.8. Tables and Figures

An ideal review article should be logically structured and efficiently utilise illustrations, in the form of tables and figures, to convey the key findings and relationships in the study. According to Tay [ 13 ], illustrations often take a secondary role in review papers when compared to primary research papers which are focused on illustrations. However, illustrations are very important in review articles as they can serve as succinct means of communicating major findings and insights. Franzblau and Chung [ 82 ] pointed out that illustrations serve three major purposes in a scientific article: they simplify complex data and relationships for better understanding, they minimise reading time by summarising and bringing to focus on the key findings (or trends), and last, they help to reduce the overall word count. Hence, inserting and constructing illustrations in a review article is as meticulous as it is important. However, important decisions should be made on whether the charts, figures, or tables to be potentially inserted in the manuscript are indeed needed and how best to design them [ 83 ]. Illustrations should enhance the text while providing necessary information; thus, the information described in illustrations should not contradict that in the main text and should also not be a repetition of texts [ 84 ]. Furthermore, illustrations must be autonomous, meaning they ought to be intelligible without having to read the text portion of the manuscript; thus, the reader does not have to flip back and forth between the illustration and the main text in order to understand it [ 85 ]. It should be noted that tables or figures that directly reiterate the main text or contain extraneous information will only make a mess of the manuscript and discourage readers [ 86 ].

Kotz and Cals [ 87 ] recommend that the layout of tables and figures should be carefully designed in a clear manner with suitable layouts, which will allow them to be referred to logically and chronologically in the text. In addition, illustrations should only contain simple text, as lengthy details would contradict their initial objective, which was to provide simple examples or an overview. Furthermore, the use of abbreviations in illustrations, especially tables, should be avoided if possible. If not, the abbreviations should be defined explicitly in the footnotes or legends of the illustration [ 88 ]. Similarly, numerical values in tables and graphs should also be correctly approximated [ 84 ]. It is recommended that the number of tables and figures in the manuscript should not exceed the target journal's specification. According to Saver [ 89 ], they ideally should not account for more than one-third of the manuscript. Finally, the author(s) must seek permission and give credits for using an already published illustration when necessary. However, none of these are needed if the graphic is originally created by the author, but if it is a reproduced or an adapted illustration, the author must obtain permission from the copyright owner and include the necessary credit. One of the very important tools for designing illustrations is Creative Commons, a platform that provides a wide range of creative works which are available to the public for use and modification.

5.9. Conclusion/Future Perspectives

It has been observed that many reviews end abruptly with a short conclusion; however, a lot more can be included in this section in addition to what has been said in the major sections of the paper. Basically, the conclusion section of a review article should provide a summary of key findings from the main body of the manuscript. In this section, the author needs to revisit the critical points of the paper as well as highlight the accuracy, validity, and relevance of the inferences drawn in the article review. A good conclusion should highlight the relationship between the major points and the author's hypothesis as well as the relationship between the hypothesis and the broader discussion to demonstrate the significance of the review article in a larger context. In addition to giving a concise summary of the important findings that describe current knowledge, the conclusion must also offer a rationale for conducting future research [ 12 ]. Knowledge gaps should be identified, and themes should be logically developed in order to construct conceptual frameworks as well as present a way forward for future research in the field of study [ 11 ].

Furthermore, the author may have to justify the propositions made earlier in the manuscript, demonstrate how the paper extends past research works, and also suggest ways that the expounded theories can be empirically examined [ 3 ]. Unlike experimental studies which can only draw either a positive conclusion or ambiguous failure to reject the null hypothesis, four possible conclusions can be drawn from review articles [ 1 ]. First, the theory/hypothesis propounded may be correct after being proven from current evidence; second, the hypothesis may not be explicitly proven but is most probably the best guess. The third conclusion is that the currently available evidence does not permit a confident conclusion or a best guess, while the last conclusion is that the theory or hypothesis is false [ 1 ]. It is important not to present new information in the conclusion section which has link whatsoever with the rest of the manuscript. According to Harris et al. [ 90 ], the conclusions should, in essence, answer the question: if a reader were to remember one thing about the review, what would it be?

5.10. References

As it has been noted in different parts of this paper, authors must give the required credit to any work or source(s) of information that was included in the review article. This must include the in-text citations in the main body of the paper and the corresponding entries in the reference list. Ideally, this full bibliographical list is the last part of the review article, and it should contain all the books, book chapters, journal articles, reports, and other media, which were utilised in the manuscript. It has been noted that most journals and publishers have their own specific referencing styles which are all derived from the more popular styles such as the American Psychological Association (APA), Chicago, Harvard, Modern Language Association (MLA), and Vancouver styles. However, all these styles may be categorised into either the parenthetical or numerical referencing style. Although a few journals do not have strict referencing rules, it is the responsibility of the author to reference according to the style and instructions of the journal. Omissions and errors must be avoided at all costs, and this can be easily achieved by going over the references many times for due diligence [ 11 ]. According to Cronin et al. [ 12 ], a separate file for references can be created, and any work used in the manuscript can be added to this list immediately after being cited in the text [ 12 ]. In recent times, the emergence of various referencing management software applications such as Endnote, RefWorks, Mendeley, and Zotero has even made referencing easier. The majority of these software applications require little technical expertise, and many of them are free to use, while others may require a subscription. It is imperative, however, that even after using these software packages, the author must manually curate the references during the final draft, in order to avoid any errors, since these programs are not impervious to errors, particularly formatting errors.

6. Concluding Remarks

Writing a review article is a skill that needs to be learned; it is a rigorous but rewarding endeavour as it can provide a useful platform to project the emerging researcher or postgraduate student into the gratifying world of publishing. Thus, the reviewer must develop the ability to think critically, spot patterns in a large volume of information, and must be invested in writing without tiring. The prospective author must also be inspired and dedicated to the successful completion of the article while also ensuring that the review article is not just a mere list or summary of previous research. It is also important that the review process must be focused on the literature and not on the authors; thus, overt criticism of existing research and personal aspersions must be avoided at all costs. All ideas, sentences, words, and illustrations should be constructed in a way to avoid plagiarism; basically, this can be achieved by paraphrasing, summarising, and giving the necessary acknowledgments. Currently, there are many tools to track and detect plagiarism in manuscripts, ensuring that they fall within a reasonable similarity index (which is typically 15% or lower for most journals). Although the more popular of these tools, such as Turnitin and iThenticate, are subscription-based, there are many freely available web-based options as well. An ideal review article is supposed to motivate the research topic and describe its key concepts while delineating the boundaries of research. In this regard, experience-based information on how to methodologically develop acceptable and impactful review articles has been detailed in this paper. Furthermore, for a beginner, this guide has detailed “the why” and “the how” of authoring a good scientific review article. However, the information in this paper may as a whole or in parts be also applicable to other fields of research and to other writing endeavours such as writing literature review in theses, dissertations, and primary research articles. Finally, the intending authors must put all the basic rules of scientific writing and writing in general into cognizance. A comprehensive study of the articles cited within this paper and other related articles focused on scientific writing will further enhance the ability of the motivated beginner to deliver a good review article.

Acknowledgments

This work was supported by the National Research Foundation of South Africa under grant number UID 138097. The authors would like to thank the Durban University of Technology for funding the postdoctoral fellowship of the first author, Dr. Ayodeji Amobonye.

Data Availability

Conflicts of interest.

The authors declare that they have no conflicts of interest.

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

pathogens-logo

Article Menu

criteria of research paper

  • Subscribe SciFeed
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

The impact of climate on human dengue infections in the caribbean.

criteria of research paper

Graphical Abstract

1. Introduction

2.1. bibliographic search, 2.2. selection criteria, 2.3. search string, 2.4. study selection and quality assessment, 3.1. bibliographic search, 3.2. selected studies.

StudyQualityStudy
Location
Study DesignTime PeriodClimatic VariablesOutcomeCO-FACTORSStatistical MethodsResults
Keating et al., 2001 [ ]+Puerto RicoMultivariate linear regression 1988–1992Seasonal temperaturesDengue casesNoneRegression analysis and Durbin–Watson testTemperature has a positive effect on dengue cases reported each month with a lag of 12 weeks or 3 months. Other factors may be influencing seasonal dengue incidence.
Schreiber et al., 2001 [ ]+ Multivariate stochastic models1988–1993Temperature, rainfallDengue casesNonePearson’s product–moment correlation coefficientThe mean seasonal variation in dengue is highly related (R = 88.1%) to the mean seasonal climate variation, with those thermal and energy variables immediately preceding the dengue response showing the strongest relationships. However, moisture variables, predominantly in the form of surplus, are more influential many weeks in advance. For the interannual model (R = 44.1%), energy change, thermal change, and moisture variables are significant across the 8-week period, with moisture variables playing a stronger role than in the intra-annual model.
Jury, 2008 [ ]+ Bayesian model1979–2005Rainfall, wind speed, temperature, and air pressureDengue casesNoneK function analysis and Barton David KnoxA positive association of rainfall with dengue was observed with no appreciable lag time. While temperature was positively associated with year-to-year variability of dengue cases.
Johansson et al., 2009a [ ]++ DLM1986–2006Temperature and rainfallDengue casesSocial vulnerability (household income and % persons below poverty line)95% CITemperature influences dengue incidence in cooler mountain regions. Rainfall’s strongest influence is in the dry southwestern coast. Areas with higher poverty index had more dengue cases.
Johansson et al., 2009b [ ]++ Wavelet analysis1993–2016Temperature, precipitation, and ENSO indexDengue casesNoneMonte Carlo test of durationTemperature and rainfall strongly coherent with dengue with 1 y periodicity. A strong link with ENSO and dengue incidence was observed from 1995 to 2002 but must be taken cautiously.
Méndez-Lázaro et al., 2014 [ ]+Puerto RicoPCA and bivariate analysis1995–2009SLP, MSL, Temperature, Wind, SST, and rainfallDengue casesNonePearson’s correlation, Mann–Kendall trend test, and logistic regressionsA positive association of precipitation and forested and scrubland habitats with dengue cases was observed.
Buczak et al., 2018 [ ]+ SARIMA and Ensemble models1990–2009Rainfall and temperatureDengue cases RMSE and MAEMixed results for Puerto Rico
Puggioni et al., 2020 [ ]++ Hierarchical Bayesian1990–2004Rainfall and temperatureDengue casesSpatiotemporal factorsRMSE
Nova et al., 2021 [ ]++ Empirical Dynamic Modeling1990–2009Rainfall and temperatureDengue casesSusceptibles index (λ)Pearson’s correlation coefficient and RMSERainfall and susceptibles index were significant drivers of dengue incidence beyond seasonality. However, temperature was not a significant driver beyond seasonality. High host susceptibility allows seasonal climate suitability to fuel large dengue epidemics in San Juan, Puerto Rico.
Depradine and Lovell, 2004 [ ]+BarbadosLagged cross-correlation and multiple regression analysis1995–2000Rainfall, temperature, and VPDengue casesNone99% CIVP had the strongest correlation with dengue cases at 6 weeks lag, minimum temperature at 12 weeks lag and max. temperature at 16 weeks lag while there was a negative correlation with wind speed and rainfall with dengue cases.
Parker and Holman, 2014 [ ]++ Logistic model1992–1996Rainfall and temperatureDengue casesDrought, floods, and stormsCI, SE, and AICMean monthly temperature was the most important factor affecting the duration of both inter-epidemic spells (β = 0.543; confidence interval (CI) 0.4954, 0.5906) and epidemic spells (β = −0.648; CI −0.7553, −0.5405). Drought conditions increased the time between epidemics. Increased temperature hastened the onset of an epidemic, and during an epidemic, higher mean temperature increased the duration of the epidemic.
Lowe et al., 2018 [ ]++BarbadosDLNM and Bayesian model1999–2016Rainfall and temperatureDengue casesNoneArea under the curve ROC (AUC)Low rainfall/drought is positively associated with dengue incidence and increased rainfall after 1–5 months of drought. Failure to predict 2 outbreak peaks of CHIKV and ZIKV.
Douglas et al., 2020 [ ]+ Cross-sectional epidemiology2008–2016Seasonality (rainfall)Dengue casesAge, sex, and location95% CIPeak dengue incidence was observed during the wet season.
Henry and de Assi Mendonça et al., 2020 [ ]+JamaicaWADI1995–2018Rainfall, temperature, and LSTDengue casesWADI Socioeconomic (GIS, urban, and RCP)SCMEHigh vulnerability in urban vs. rural areas, expansion to higher latitudes. RCP8.5
Francis et al., 2023 [ ]+GrenadaNegative binomial regression2010–2020Rainfall and temperatureDengue casesNone95% CIIn 2013, 2018, and 2020, the driest years, the highest number of DF cases were observed. Other factors may explain these high numbers of DF cases: (1) frequent sporadic heavy rainfall and (2) poor water storage practices in dry season.
Petrone et al., 2021 [ ]++Dominican RepublicIndex P (Bayesian)2012–2018Temperature and relative humidityDengue casesR , AaS scores, CHIKV, and ZIKVPearson’s R correlation coefficient Temperature and humidity analysis (Index P) showed that dengue outbreaks peaked after a period characterized by high transmission potential, just as transmission potential was beginning to wane. Variability in seasonal weather patterns and vectorial capacity did not account for differences in the timing of emerging disease outbreaks.
Bultó et al., 2006 [ ]+CubaEOF1961–2003Temperature, rainfall, VP, and relative humidityDengue casesBultó index, life quality, and degree of povertyEOF analysisMore frequent outbreaks, changes in seasons and spatial patterns, and less climate variability inland were observed.
Díaz-Quijano and Waldman, 2012 [ ]+Spanish-speaking Caribbean and Non-Spanish-speaking CaribbeanPoisson regression1995–2009RainfallDengue casesHDI, population density, per capita GEH95% CIRainfall, the sole climatic variable investigated, was associated with dengue mortality (RR = 1.9 [per 10 L/m ]; 95% CI = 1.78–2.02) along with population density.
Gharbi et al., 2011 [ ]++GuadeloupeSARIMA2000–2007Temperature, humidity, and rainfallDengue casesNoneRMSE, Wilcoxon signed ranks test, and Pearson’s correlationTemperature was associated with increased model predictability of dengue incidence forecasting more than rainfall and humidity. Rainfall was not correlated. Minimum temperature at lag 5 weeks was best—RMSE = 0.72.
Limper et al., 2016 [ ]++CuraçaoDNLM and GAM1999–2009Temperature, humidity, and rainfallDengue casesNone95% CI and RR, chi-squared test, and RRIncreases in mean temperature are associated with lower dengue incidence but lower temperatures with higher dengue incidence. Rainfall decreased dengue incidence.
Limper et al., 2010 [ ]+ Non-parametric Spearman’s correlation test1999–2009Temperature, rainfall, and humidityDengue casesNoneNon-parametric Spearman’s correlation test
Chadee et al., 2007 [ ]+TrinidadPopulation-based2002–2004Rainfall and temperatureDengue casesBreteau indexNoneRainfall strongly correlated with dengue disease but no correlation with temperature.
Amarakoon et al., 2008 [ ]++Trinidad, Barbados, and JamaicaCorrelation analysis including lag1980–2003Rainfall and temperatureDengue casesMAT, AMAT, A , and D Correlation coefficient (r)The yearly patterns of dengue exhibited a well-defined seasonality, with epidemics occurring in the latter half of the year following the onset of rainfall and increasing temperature and a higher probability of epidemics occurring during El Niño periods.
Boston and Kurup, 2017 [ ]+GuyanaCorrelation analysis2009–2014Rainfall, temperature, and humidityDengue casesMalaria and leptospirosisPearson’s R correlation and correlation coefficient (r)Rainfall strongly associated with dengue incidence but not temperature and humidity.
Ferreira et al., 2014 [ ]+Guyana, Suriname, Cuba, and multiple Caribbean countriesCorrelation analysis1995–2004ENSO indexDengue casesSouth Oscillation index (SOI)Correlation coefficients (r)A higher DF incidence was noted in Cuba, confirming a possible positive ENSO influence.
Gagnon et al., 2001 [ ]+Suriname and French GuianaCorrelation analysis1965–1992Rainfall, temperature, and ENSO cyclesDengue casesMonthly river heightFisher’s exact test, Fisher’s z-transformation, and Quenouille’s methodA statistically significant relationship was observed between El Niño and dengue epidemics in Colombia, French Guiana, Indonesia, and Surinam. The number of DHF cases is highest when a prolonged drought precedes the rainy season.
Adde et al., 2016 [ ]++French GuianaLagged correlation and logistic regression 1991–2013SST and SLPDengue casesSOI and MEIStudent’s t test, Spearman’s lagged correlation, AIC, and AUCThe climatic indices assessed in this study were important for DF monitoring and for predicting outbreaks in French Guiana over a period of 2–3 months. An important rainfall deficit at the end of the dry season enhances the risk of epidemic in the following year.
StudyQualityStudy LocationStudy DesignStatistical MethodsMetric Best Model ValueWorst Model Value
Keating et al., 2001 [ ]++Puerto RicoMultivariate linear regression Regression analysis and Durbin–Watson testR-squared0.710.62
F-value49.9467.22
SE102.8116.9
Schreiber et al., 2001 [ ]++ Multivariate stochastic modelsPearson’s product–moment correlation coefficientAdjusted R-squared0.880.14
Jury, 2008 [ ]+ 0.020.0001
Johansson et al., 2009a [ ]+ Poisson regression models N/AN/AN/A
Johansson et al., 2009b [ ]+ Wavelet analysisMonte Carlo (MC) significanceMC significance0.0060.006
Méndez-Lárazo et al., 2014 [ ]+ Principal Component Analysis Logistic regressionp-valueN/AN/A
Pearson correlation coefficient
Mann–Kendall trend test
Logistic regression
Buczak et al., 2018 [ ]++ SARIMA and Ensemble modelsTime series methodsLog loss−1.8 −6.4
Puggioni et al., 2020 [ ]++ Hierarchical Bayesian Mean squared error8.63214,055.18
Mean absolute percentage error2.663372.01
Mean absolute error2.22886.56
Relative bias−0.0010.49
Relative mean separation0.4360.97
Root mean squared error2.951118.11
Nova et al., 2021 [ ]++ Empirical Dynamic ModelingCorrelation analysisPearson’s correlation coefficient0.96970.38
Root mean squared error37.1457.34
Depradine and Lovell, 2004 [ ]+Barbados
Lagged cross-correlation and multiple regression analysisCorrelation analysisPearson’s correlation coefficient0.70.25
Parker and Holman, 2014 [ ]++ Logistic modelAkaike information criterion (AIC) and 99% CIN/A (no comparison made)N/AN/A
Standard error0.0001172.4
Lowe et al., 2018 [ ]++ DLNM and Bayesian modelArea under the curve ROC (AUC)AUC0.900.75
Likelihood ratio R-squaredR _LR0.680.23
Deviance information criterionDIC1664.941801.36
Barbados
Douglas et al., 2020 [ ]+ Cross-sectional epidemiology95% CICIN/AN/A
Henry and de Assi Mendonça et al., 2020 [ ]+JamaicaWater-Associated Disease IndexColor-coded vulnerabilityN/AN/AN/A
Amarakoon et al., 2008 [ ]+ Time series analysisCorrelation analysisPearson’s correlation coefficient>0.71N/A
Francis et al., 2023 [ ]+GrenadaNegative binomial regression95% CICIN/AN/A
Díaz-Quijano and Waldman, 2012 [ ]++CubaPoisson regressionCorrelation coefficient, rate ratio, CIPseudo R 49.8%48.3%
Bultó et al., 2006 [ ]++ Statistical variability analysisBultó indexIB index18.771109
Boston and Kurup, 2017 [ ]+GuyanaCorrelation and regression analysisCorrelation coefficientr0.70.1
Ferreira et al., 2014 [ ]+Guyana, Belize, Suriname, Cuba, and multiple Caribbean countriesFrequency analysisAnnual dengue frequencyMean annual frequency18.27N/A
Adde et al., 2016 [ ]++French GuianaLogistic binomial regression modelAkaike information criterion (AIC)AIC2731
Area under curve (AUC)AUC0.880.75
Standard errorSE0.021.42

4. Discussion

4.1. rainfall or precipitation factor, 4.2. temperature factor, 4.3. multiple co-factors, 4.3.1. mosquito vector distribution, 4.3.2. human and social factors, 4.3.3. infrastructure, 4.3.4. travel and trade, 4.4. limitations, 5. conclusions, supplementary materials, author contributions, institutional review board statement, data availability statement, acknowledgments, conflicts of interest.

  • Was a clear focus issue addressed?—Yes/Unsure/No Follow on and ask some of these other questions to evaluate the rating.
  • Which study design was utilized?
  • Was the appropriate method used to answer the question posed?
  • Was/Were the climate exposure factor(s) accurately measured to minimize bias?
  • Was the outcome accurately measured to minimize bias?
  • Were all the important confounding factors identified?
  • Are these confounding factors addressed in the design and or analysis?
  • What are the results of this study?—Yes/Unsure/No Follow and ask some of these other questions to evaluate the rating.
  • What is the level of precision of the results? What is the level of precision for the risk estimate used?
  • Are the results believable based on statistics?
  • How was this study funded?
  • Does this study answer the question posed by this systematic review?—Yes/Unsure/No Follow on and ask some of these other questions to evaluate the rating.
  • Are the results believable?
  • Murray, N.E.A.; Quam, M.B.; Wilder-Smith, A. Epidemiology of dengue: Past, present and future prospects. Clin. Epidemiol. 2013 , 5 , 299. [ Google Scholar ] [ PubMed ]
  • Vasilakis, N.; Cardosa, J.; Hanley, K.A.; Holmes, E.C.; Weaver, S.C. Fever from the forest: Prospects for the continued emergence of sylvatic dengue virus and its impact on public health. Nat. Rev. Microbiol. 2011 , 9 , 532–541. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Cattarino, L.; Rodriguez-Barraquer, I.; Imai, N.; Cummings, D.A.; Ferguson, N.M. Mapping global variation in dengue transmission intensity. Sci. Transl. Med. 2020 , 12 , eaax4144. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Sweileh, W.M. Bibliometric analysis of peer-reviewed literature on climate change and human health with an emphasis on infectious diseases. Glob. Health 2020 , 16 , 1–17. [ Google Scholar ] [ CrossRef ]
  • Añez, G.; Volkova, E.; Jiang, Z.; Heisey, D.A.; Chancey, C.; Fares, R.C.; Rios, M.; Group, C.S. Collaborative study to establish World Health Organization international reference reagents for dengue virus Types 1 to 4 RNA for use in nucleic acid testing. Transfusion 2017 , 57 , 1977–1987. [ Google Scholar ] [ CrossRef ]
  • PAHO. PAHO Urges Countries to Strengthen Dengue Prevention in Central America, Mexico and the Caribbean ; Pan American Health Organisation (PAHO): Washington DC, USA, 2024; Website; Available online: https://www.paho.org/en/news/24-5-2024-paho-urges-countries-strengthen-dengue-prevention-central-america-mexico-and#:~:text=As%20of%20mid%2DMay%202024,%2C%20Peru%2C%20Colombia%20and%20Mexico (accessed on 28 July 2024).
  • BGIS. Health Ministry’s Updates on Dengue Fever, Gastro & Respiratory Illnesses Government Blog Update ; Barbados Government Information Service (BGIS): Saint Michael, Barbados, 2024. Available online: https://www.health.gov.bb/News/Press-Releases/Health-Ministry-s-Updates-On-Dengu#:~:text=Up%20to%20the%20week%20ending,cases%2C%20and%20105%20confirmed%20cases (accessed on 28 July 2024).
  • Ramos-Castaneda, J.; Barreto dos Santos, F.; Martinez-Vega, R.; Galvão de Araujo, J.M.; Joint, G.; Sarti, E. Dengue in Latin America: Systematic review of molecular epidemiological trends. PLoS Negl. Trop. Dis. 2017 , 11 , e0005224. [ Google Scholar ] [ CrossRef ]
  • Salazar, M.I.; Richardson, J.H.; Sánchez-Vargas, I.; Olson, K.E.; Beaty, B.J. Dengue virus type 2: Replication and tropisms in orally infected Aedes aegypti mosquitoes. BMC Microbiol. 2007 , 7 , 9. [ Google Scholar ] [ CrossRef ]
  • Wei Xiang, B.W.; Saron, W.A.; Stewart, J.C.; Hain, A.; Walvekar, V.; Missé, D.; Thomas, F.; Kini, R.M.; Roche, B.; Claridge-Chang, A. Dengue virus infection modifies mosquito blood-feeding behavior to increase transmission to the host. Proc. Natl. Acad. Sci. USA 2022 , 119 , e2117589119. [ Google Scholar ] [ CrossRef ]
  • Kelman, I. Islandness within climate change narratives of small island developing states (SIDS). Isl. Stud. J. 2018 , 13 , 149–166. [ Google Scholar ] [ CrossRef ]
  • Tukuitonga, C.; Vivili, P. Climate effects on health in Small Islands Developing States. Lancet Planet. Health 2021 , 5 , e69–e70. [ Google Scholar ] [ CrossRef ]
  • Douglas, K.O.; Payne, K.; Sabino-Santos, G., Jr.; Agard, J. Influence of climatic factors on human hantavirus infections in Latin America and the Caribbean: A systematic review. Pathogens 2021 , 11 , 15. [ Google Scholar ] [ CrossRef ]
  • McCarthy, J.J.; Canziani, O.F.; Leary, N.A.; Dokken, D.J.; White, K.S. Climate Change 2001: Impacts, Adaptation, and Vulnerability: Contribution of Working Group II to the Third Assessment Report of the Intergovernmental Panel on Climate Change ; Cambridge University Press: Cambridge, UK, 2001; Volume 2. [ Google Scholar ]
  • Parry, M.; Parry, M.L.; Canziani, O.; Palutikof, J.; Van der Linden, P.; Hanson, C. Climate Change 2007—Impacts, Adaptation and Vulnerability: Working Group II Contribution to the Fourth Assessment Report of the IPCC ; Cambridge University Press: Cambridge, UK, 2007; Volume 4. [ Google Scholar ]
  • Cashman, A.; Nurse, L.; John, C. Climate change in the Caribbean: The water management implications. J. Environ. Dev. 2010 , 19 , 42–67. [ Google Scholar ] [ CrossRef ]
  • Alarcón-Elbal, P.M.; Rodríguez-Sosa, M.A.; Ruiz-Matuk, C.; Tapia, L.; Arredondo Abreu, C.A.; Fernández González, A.A.; Rodríguez Lauzurique, R.M.; Paulino-Ramírez, R. Breeding Sites of Synanthropic Mosquitoes in Zika-Affected Areas of the Dominican Republic. J. Am. Mosq. Control Assoc. 2021 , 37 , 10–19. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Taylor, M.A.; Clarke, L.A.; Centella, A.; Bezanilla, A.; Stephenson, T.S.; Jones, J.J.; Campbell, J.D.; Vichot, A.; Charlery, J. Future Caribbean climates in a world of rising temperatures: The 1.5 vs 2.0 dilemma. J. Clim. 2018 , 31 , 2907–2926. [ Google Scholar ] [ CrossRef ]
  • Rawlins, S.; Hinds, A.; Rawlins, J. Malaria and its vectors in the Caribbean: The continuing challenge of the disease forty-five years after eradication from the islands. West Indian Med. J. 2008 , 57 , 462–469. [ Google Scholar ] [ PubMed ]
  • Toan, N.T.; Rossi, S.; Prisco, G.; Nante, N.; Viviani, S. Dengue epidemiology in selected endemic countries: Factors influencing expansion factors as estimates of underreporting. Trop. Med. Int. Health 2015 , 20 , 840–863. [ Google Scholar ] [ CrossRef ]
  • Colón-González, F.J.; Peres, C.A.; Steiner São Bernardo, C.; Hunter, P.R.; Lake, I.R. After the epidemic: Zika virus projections for Latin America and the Caribbean. PLoS Negl. Trop. Dis. 2017 , 11 , e0006007. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Lippi, C.A.; Stewart-Ibarra, A.M.; Romero, M.; Lowe, R.; Mahon, R.; Van Meerbeeck, C.J.; Rollock, L.; Hilaire, M.G.-S.; Trotman, A.R.; Holligan, D. Spatiotemporal tools for emerging and endemic disease hotspots in small areas: An analysis of dengue and chikungunya in Barbados, 2013–2016. Am. J. Trop. Med. Hyg. 2020 , 103 , 149. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Gonzalez-Escobar, G.; Churaman, C.; Rampersad, C.; Singh, R.; Nathaniel, S. Mayaro virus detection in patients from rural and urban areas in Trinidad and Tobago during the Chikungunya and Zika virus outbreaks. Pathog. Glob. Health 2021 , 115 , 188–195. [ Google Scholar ] [ CrossRef ]
  • Morales, I.; Salje, H.; Saha, S.; Gurley, E.S. Seasonal Distribution and Climatic Correlates of Dengue Disease in Dhaka, Bangladesh. Am. J. Trop. Med. Hyg. 2016 , 94 , 1359–1361. [ Google Scholar ] [ CrossRef ]
  • Yu, J.; Li, T.; Jiang, L. Why Does a Stronger El Niño Favor Developing towards the Eastern Pacific while a Stronger La Niña Favors Developing towards the Central Pacific? Atmosphere 2023 , 14 , 1185. [ Google Scholar ] [ CrossRef ]
  • Roelofs, B.; Vos, D.; Halabi, Y.; Gerstenbluth, I.; Duits, A.; Grillet, M.E.; Tami, A.; Vincenti-Gonzalez, M.F. Spatial and temporal trends of dengue infections in Curaçao: A 21-year analysis. Parasite Epidemiol. Control 2024 , 24 , e00338. [ Google Scholar ] [ CrossRef ]
  • Cazelles, B.; Cazelles, K.; Tian, H.; Chavez, M.; Pascual, M. Disentangling local and global climate drivers in the population dynamics of mosquito-borne infections. Sci. Adv. 2023 , 9 , eadf7202. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Ryan, S.J.; Lippi, C.A.; Caplan, T.; Diaz, A.; Dunbar, W.; Grover, S.; Johnson, S.; Knowles, R.; Lowe, R.; Mateen, B.A. The current landscape of software tools for the climate-sensitive infectious disease modelling community. Lancet Planet. Health 2023 , 7 , e527–e536. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Littell, J.H.; Corcoran, J.; Pillai, V. Systematic Reviews and Meta-Analysis ; Oxford University Press: Oxford, UK, 2008. [ Google Scholar ]
  • Roda Gracia, J.; Schumann, B.; Seidler, A. Climate variability and the occurrence of human puumala hantavirus infections in Europe: A systematic review. Zoonoses Public Health 2015 , 62 , 465–478. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Stocker, T. Climate Change 2013: The Physical Science Basis: Working Group I Contribution to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change ; Cambridge University Press: Cambridge, UK, 2014. [ Google Scholar ]
  • Petrone, M.E.; Earnest, R.; Lourenço, J.; Kraemer, M.U.; Paulino-Ramirez, R.; Grubaugh, N.D.; Tapia, L. Asynchronicity of endemic and emerging mosquito-borne disease outbreaks in the Dominican Republic. Nat. Commun. 2021 , 12 , 151. [ Google Scholar ] [ CrossRef ]
  • Depradine, C.; Lovell, E. Climatological variables and the incidence of Dengue fever in Barbados. Int. J. Environ. Health Res. 2004 , 14 , 429–441. [ Google Scholar ] [ CrossRef ]
  • Limper, M.; Van de Weg, C.; Koraka, P.; Halabi, Y.; Gerstenbluth, I.; Boekhoudt, J.; Martis, A.; Martina, B.; Duits, A.; Osterhaus, A. The 2008 dengue epidemic on Curaçao: Correlation with climatological factors. Int. J. Infect. Dis. 2010 , 14 , e376–e377. [ Google Scholar ] [ CrossRef ]
  • Adde, A.; Roucou, P.; Mangeas, M.; Ardillon, V.; Desenclos, J.-C.; Rousset, D.; Girod, R.; Briolant, S.; Quenel, P.; Flamand, C. Predicting dengue fever outbreaks in French Guiana using climate indicators. PLoS Negl. Trop. Dis. 2016 , 10 , e0004681. [ Google Scholar ] [ CrossRef ]
  • Francis, K.; Edwards, O.; Telesford, L. Climate and dengue transmission in Grenada for the period 2010–2020: Should we be concerned? PLOS Clim. 2023 , 2 , e0000122. [ Google Scholar ] [ CrossRef ]
  • Lowe, R.; Gasparrini, A.; Van Meerbeeck, C.J.; Lippi, C.A.; Mahon, R.; Trotman, A.R.; Rollock, L.; Hinds, A.Q.; Ryan, S.J.; Stewart-Ibarra, A.M. Nonlinear and delayed impacts of climate on dengue risk in Barbados: A modelling study. PLoS Med. 2018 , 15 , e1002613. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Jury, M.R. Climate influence on dengue epidemics in Puerto Rico. Int. J. Environ. Health Res. 2008 , 18 , 323–334. [ Google Scholar ] [ CrossRef ]
  • Johansson, M.A.; Dominici, F.; Glass, G.E. Local and global effects of climate on dengue transmission in Puerto Rico. PLoS Negl. Trop. Dis. 2009 , 3 , e382. [ Google Scholar ] [ CrossRef ]
  • Johansson, M.A.; Cummings, D.A.; Glass, G.E. Multiyear climate variability and dengue—El Nino southern oscillation, weather, and dengue incidence in Puerto Rico, Mexico, and Thailand: A longitudinal data analysis. PLoS Med. 2009 , 6 , e1000168. [ Google Scholar ] [ CrossRef ]
  • Mendez-Lazaro, P.; Muller-Karger, F.E.; Otis, D.; McCarthy, M.J.; Pena-Orellana, M. Assessing climate variability effects on dengue incidence in San Juan, Puerto Rico. Int. J. Environ. Res. Public Health 2014 , 11 , 9409–9428. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Nova, N.; Deyle, E.R.; Shocket, M.S.; MacDonald, A.J.; Childs, M.L.; Rypdal, M.; Sugihara, G.; Mordecai, E.A. Susceptible host availability modulates climate effects on dengue dynamics. Ecol. Lett. 2021 , 24 , 415–425. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Douglas, K.O.; Dutta, S.K.; Martina, B.; Anfasa, F.; Samuels, T.A.; Gittens-St. Hilaire, M. Dengue fever and severe dengue in Barbados, 2008–2016. Trop. Med. Infect. Dis. 2020 , 5 , 68. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Díaz-Quijano, F.A.; Waldman, E.A. Factors associated with dengue mortality in Latin America and the Caribbean, 1995–2009: An ecological study. Am. J. Trop. Med. Hyg. 2012 , 86 , 328. [ Google Scholar ] [ CrossRef ]
  • Chadee, D.; Shivnauth, B.; Rawlins, S.; Chen, A. Climate, mosquito indices and the epidemiology of dengue fever in Trinidad (2002–2004). Ann. Trop. Med. Parasitol. 2007 , 101 , 69–77. [ Google Scholar ] [ CrossRef ]
  • Boston, C.; Kurup, R. Estimated Effects of Climate Variables on Transmission of Malaria, Dengue and Leptospirosis within Georgetown, Guyana. West Indian Med. J. 2017 , 65 , 43. [ Google Scholar ] [ CrossRef ]
  • Gagnon, A.S.; Bush, A.B.; Smoyer-Tomic, K.E. Dengue epidemics and the El Niño southern oscillation. Clim. Res. 2001 , 19 , 35–43. [ Google Scholar ] [ CrossRef ]
  • Amarakoon, D.; Chen, A.; Rawlins, S.; Chadee, D.D.; Taylor, M.; Stennett, R. Dengue epidemics in the Caribbean-temperature indices to gauge the potential for onset of dengue. Mitig. Adapt. Strateg. Glob. Chang. 2008 , 13 , 341–357. [ Google Scholar ] [ CrossRef ]
  • Limper, M.; Thai, K.; Gerstenbluth, I.; Osterhaus, A.; Duits, A.; van Gorp, E. Climate factors as important determinants of dengue incidence in Curaçao. Zoonoses Public Health 2016 , 63 , 129–137. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Gharbi, M.; Quenel, P.; Gustave, J.; Cassadou, S.; Ruche, G.L.; Girdary, L.; Marrama, L. Time series analysis of dengue incidence in Guadeloupe, French West Indies: Forecasting models using climate variables as predictors. BMC Infect. Dis. 2011 , 11 , 1–13. [ Google Scholar ] [ CrossRef ]
  • Parker, D.; Holman, D. Event history analysis of dengue fever epidemic and inter-epidemic spells in Barbados, Brazil, and Thailand. Int. J. Infect. Dis. 2012 , 16 , e793–e798. [ Google Scholar ] [ CrossRef ]
  • Keating, J. An investigation into the cyclical incidence of dengue fever. Soc. Sci. Med. 2001 , 53 , 1587–1597. [ Google Scholar ] [ CrossRef ]
  • Schreiber, K.V. An investigation of relationships between climate and dengue using a water budgeting technique. Int. J. Biometeorol. 2001 , 45 , 81–89. [ Google Scholar ] [ CrossRef ]
  • Buczak, A.L.; Baugher, B.; Moniz, L.J.; Bagley, T.; Babin, S.M.; Guven, E. Ensemble method for dengue prediction. PLoS ONE 2018 , 13 , e0189988. [ Google Scholar ] [ CrossRef ]
  • Puggioni, G.; Couret, J.; Serman, E.; Akanda, A.S.; Ginsberg, H.S. Spatiotemporal modeling of dengue fever risk in Puerto Rico. Spat. Spatio-Temporal Epidemiol. 2020 , 35 , 100375. [ Google Scholar ] [ CrossRef ]
  • Henry, S.; Mendonça, F.d.A. Past, present, and future vulnerability to dengue in Jamaica: A spatial analysis of monthly variations. Int. J. Environ. Res. Public Health 2020 , 17 , 3156. [ Google Scholar ] [ CrossRef ]
  • Bultó, P.L.O.; Rodríguez, A.P.; Valencia, A.R.; Vega, N.L.; Gonzalez, M.D.; Carrera, A.P. Assessment of human health vulnerability to climate variability and change in Cuba. Environ. Health Perspect. 2006 , 114 , 1942–1949. [ Google Scholar ] [ CrossRef ]
  • Ferreira, M.C. Geographical distribution of the association between El Niño South Oscillation and dengue fever in the Americas: A continental analysis using geographical information system-based techniques. Geospat. Health 2014 , 9 , 141–151. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Douglas, K.O.; Samuels, T.A.; Iheozor-Ejiofor, R.; Vapalahti, O.; Sironen, T.; Gittens-St Hilaire, M. Serological Evidence of Human Orthohantavirus Infections in Barbados, 2008 to 2016. Pathogens 2021 , 10 , 571. [ Google Scholar ] [ CrossRef ]
  • Montgomery, J.M.; Blair, P.J.; Carroll, D.S.; Mills, J.N.; Gianella, A.; Iihoshi, N.; Briggiler, A.M.; Felices, V.; Salazar, M.; Olson, J.G. Hantavirus pulmonary syndrome in Santa Cruz, Bolivia: Outbreak investigation and antibody prevalence study. PLoS Neglected Trop. Dis. 2012 , 6 , e1840. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Bayard, V.; Kitsutani, P.T.; Barria, E.O.; Ruedas, L.A.; Tinnin, D.S.; Muñoz, C.; De Mosca, I.B.; Guerrero, G.; Kant, R.; Garcia, A. Outbreak of hantavirus pulmonary syndrome, Los Santos, Panama, 1999–2000. Emerg. Infect. Dis. 2004 , 10 , 1635. [ Google Scholar ] [ CrossRef ]
  • Williams, R.J.; Bryan, R.T.; Mills, J.N.; Palma, R.E.; Vera, I.; De Velasquez, F.; Baez, E.; Schmidt, W.E.; Figueroa, R.E.; Peters, C.J. An outbreak of hantavirus pulmonary syndrome in western Paraguay. Am. J. Trop. Med. Hyg. 1997 , 57 , 274–282. [ Google Scholar ] [ CrossRef ]
  • Cafferata, M.L.; Bardach, A.; Rey-Ares, L.; Alcaraz, A.; Cormick, G.; Gibbons, L.; Romano, M.; Cesaroni, S.; Ruvinsky, S. Dengue epidemiology and burden of disease in Latin America and the Caribbean: A systematic review of the literature and meta-analysis. Value Health Reg. Issues 2013 , 2 , 347–356. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Wiwanitkit, V. An observation on correlation between rainfall and the prevalence of clinical cases of dengue in Thailand. J. Vector Borne Dis. 2006 , 43 , 73. [ Google Scholar ] [ PubMed ]
  • Sumi, A.; Telan, E.; Chagan-Yasutan, H.; Piolo, M.; Hattori, T.; Kobayashi, N. Effect of temperature, relative humidity and rainfall on dengue fever and leptospirosis infections in Manila, the Philippines. Epidemiol. Infect. 2017 , 145 , 78–86. [ Google Scholar ] [ CrossRef ]
  • Silva, F.D.; Santos, A.M.d.; Corrêa, R.d.G.C.F.; Caldas, A.d.J.M. Temporal relationship between rainfall, temperature and occurrence of dengue cases in São Luís, Maranhão, Brazil. Cienc. Saude Coletiva 2016 , 21 , 641–646. [ Google Scholar ] [ CrossRef ]
  • Benedum, C.M.; Seidahmed, O.M.; Eltahir, E.A.; Markuzon, N. Statistical modeling of the effect of rainfall flushing on dengue transmission in Singapore. PLoS Negl. Trop. Dis. 2018 , 12 , e0006935. [ Google Scholar ] [ CrossRef ]
  • Klotzbach, P.J. The Influence of El Nino-Southern Oscillation and the Atlantic Multidecadal Oscillation on Caribbean Tropical Cyclone Activity. J. Clim. 2011 , 24 , 721–731. [ Google Scholar ] [ CrossRef ]
  • Herrera, D.A.; Ault, T.R.; Carrillo, C.M.; Fasullo, J.T.; Li, X.L.; Evans, C.P.; Alessi, M.J.; Mahowald, N.M. Dynamical Characteristics of Drought in the Caribbean from Observations and Simulations. J. Clim. 2020 , 33 , 10773–10797. [ Google Scholar ] [ CrossRef ]
  • Petrova, D.; Lowe, R.; Stewart-Ibarra, A.; Ballester, J.; Koopman, S.J.; Rodó, X. Sensitivity of large dengue epidemics in Ecuador to long-lead predictions of El Niño. Clim. Serv. 2019 , 15 , 100096. [ Google Scholar ] [ CrossRef ]
  • Xiao, J.; Liu, T.; Lin, H.; Zhu, G.; Zeng, W.; Li, X.; Zhang, B.; Song, T.; Deng, A.; Zhang, M. Weather variables and the El Nino Southern Oscillation may drive the epidemics of dengue in Guangdong Province, China. Sci. Total Environ. 2018 , 624 , 926–934. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Damtew, Y.T.; Tong, M.; Varghese, B.M.; Anikeeva, O.; Hansen, A.; Dear, K.; Zhang, Y.; Morgan, G.; Driscoll, T.; Capon, T. Effects of high temperatures and heatwaves on dengue fever: A systematic review and meta-analysis. eBioMedicine 2023 , 91 , 104582. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Pliego, E.P.; Velázquez-Castro, J.; Collar, A.F. Seasonality on the life cycle of Aedes aegypti mosquito and its statistical relation with dengue outbreaks. Appl. Math. Model. 2017 , 50 , 484–496. [ Google Scholar ] [ CrossRef ]
  • Bennett, J.E.; Dolin, R.; Blaser, M.J. Mandell, Douglas, and Bennett’s Principles and Practice of Infectious Diseases E-Book ; Elsevier Health Sciences: Amsterdam, The Netherlands, 2019. [ Google Scholar ]
  • Rosenfelder, M.; Koppe, C.; Pfafferott, J.; Matzarakis, A. Effects of ventilation behaviour on indoor heat load based on test reference years. Int. J. Biometeorol. 2016 , 60 , 277–287. [ Google Scholar ] [ CrossRef ]
  • Serra, O.P.; Cardoso, B.F.; Ribeiro, A.L.M.; Santos, F.A.L.d.; Slhessarenko, R.D. Mayaro virus and dengue virus 1 and 4 natural infection in culicids from Cuiabá, state of Mato Grosso, Brazil. Memórias Do Inst. Oswaldo Cruz 2016 , 111 , 20–29. [ Google Scholar ] [ CrossRef ]
  • Burke, R.; Barrera, R.; Lewis, M.; Kluchinsky, T.; Claborn, D. Septic tanks as larval habitats for the mosquitoes Aedes aegypti and Culex quinquefasciatus in Playa-Playita, Puerto Rico. Med. Vet. Entomol. 2010 , 24 , 117–123. [ Google Scholar ] [ CrossRef ]
  • Kenneson, A.; Beltrán-Ayala, E.; Borbor-Cordova, M.J.; Polhemus, M.E.; Ryan, S.J.; Endy, T.P.; Stewart-Ibarra, A.M. Social-ecological factors and preventive actions decrease the risk of dengue infection at the household-level: Results from a prospective dengue surveillance study in Machala, Ecuador. PLoS Negl. Trop. Dis. 2017 , 11 , e0006150. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Matysiak, A.; Roess, A. Interrelationship between climatic, ecologic, social, and cultural determinants affecting dengue emergence and transmission in Puerto Rico and their implications for Zika response. J. Trop. Med. 2017 , 2017 , 8947067. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Carabali, M.; Hernandez, L.M.; Arauz, M.J.; Villar, L.A.; Ridde, V. Why are people with dengue dying? A scoping review of determinants for dengue mortality. BMC Infect. Dis. 2015 , 15 , 1–14. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Allicock, O.M.; Sahadeo, N.; Lemey, P.; Auguste, A.J.; Suchard, M.A.; Rambaut, A.; Carrington, C.V. Determinants of dengue virus dispersal in the Americas. Virus Evol. 2020 , 6 , veaa074. [ Google Scholar ] [ CrossRef ]
  • Barrera, R.; Amador, M.; Diaz, A.; Smith, J.; Munoz-Jordan, J.; Rosario, Y. Unusual productivity of Aedes aegypti in septic tanks and its implications for dengue control. Med. Vet. Entomol. 2008 , 22 , 62–69. [ Google Scholar ] [ CrossRef ]
  • Mutikanga, H.E.; Sharma, S.; Vairavamoorthy, K. Water loss management in developing countries: Challenges and prospec. J. -Am. Water Work. Assoc. 2009 , 101 , 57–68. [ Google Scholar ] [ CrossRef ]
  • Krystosik, A.; Njoroge, G.; Odhiambo, L.; Forsyth, J.E.; Mutuku, F.; LaBeaud, A.D. Solid wastes provide breeding sites, burrows, and food for biological disease vectors, and urban zoonotic reservoirs: A call to action for solutions-based research. Front. Public Health 2020 , 7 , 405. [ Google Scholar ] [ CrossRef ]
  • Lamond, J.; Bhattacharya, N.; Bloch, R. The role of solid waste management as a response to urban flood risk in developing countries, a case study analysis. WIT Trans. Ecol. Environ. 2012 , 159 , 193–204. [ Google Scholar ]
  • Huits, R.; Angelo, K.M.; Amatya, B.; Barkati, S.; Barnett, E.D.; Bottieau, E.; Emetulu, H.; Epelboin, L.; Eperon, G.; Medebb, L. Clinical Characteristics and Outcomes Among Travelers With Severe Dengue: A GeoSentinel Analysis. Ann. Intern. Med. 2023 , 176 , 940–948. [ Google Scholar ] [ CrossRef ]
  • Taylor-Salmon, E.; Hill, V.; Paul, L.M.; Koch, R.T.; Breban, M.I.; Chaguza, C.; Sodeinde, A.; Warren, J.L.; Bunch, S.; Cano, N. Travel surveillance uncovers dengue virus dynamics and introductions in the Caribbean. Nat. Commun. 2024 , 15 , 3508. [ Google Scholar ] [ CrossRef ]
  • Wolfe, M.K.; Paulos, A.H.; Zulli, A.; Duong, D.; Shelden, B.; White, B.J.; Boehm, A.B. Wastewater detection of emerging arbovirus infections: Case study of Dengue in the United States. Environ. Sci. Technol. Lett. 2023 , 11 , 9–15. [ Google Scholar ] [ CrossRef ]
  • Roldan-Hernandez, L.; Van Oost, C.; Boehm, A.B. Solid–liquid partitioning of dengue, West Nile, Zika, hepatitis A, influenza A, and SARS-CoV-2 viruses in wastewater from across the USA. Environ. Sci. Water Res. Technol. 2024; advance article . [ Google Scholar ]
  • Wong, J.C.C.; Tay, M.; Hapuarachchi, H.C.; Lee, B.; Yeo, G.; Maliki, D.; Lee, W.; Suhaimi, N.-A.M.; Chio, K.; Tan, W.C.H. Case report: Zika surveillance complemented with wastewater and mosquito testing. eBioMedicine 2024 , 101 , 105020. [ Google Scholar ] [ CrossRef ] [ PubMed ]
  • Chen, K.-W.; Chen, T.-Y.; Wang, S.-T.; Hou, T.-Y.; Wang, S.-W.; Young, K.-C. Establishment of quantitative and recovery method for detection of dengue virus in wastewater with noncognate spike control. J. Virol. Methods 2023 , 314 , 114687. [ Google Scholar ] [ CrossRef ]
  • Hunsberger, S.; Ortega-Villa, A.M.; Powers, J.H., III; León, H.A.R.; Sosa, S.C.; Hernández, E.R.; Cancino, J.G.N.; Nason, M.; Lumbard, K.; Sepulveda, J. Patterns of signs, symptoms, and laboratory values associated with Zika, dengue, and undefined acute illnesses in a dengue endemic region: Secondary analysis of a prospective cohort study in southern Mexico. Int. J. Infect. Dis. 2020 , 98 , 241–249. [ Google Scholar ] [ CrossRef ] [ PubMed ]

Click here to enlarge figure

ParametersInclusion CriteriaExclusion Criteria
PopulationPeople with acute DENV infection or DF/NSD/SD/DHF/DSSOnly mosquito DENV infections
ExposureAt least one climate factorNo climate factors
ComparatorsN/A
OutcomesDengue case/infection/risk/incidenceMosquito density/distribution
Study designObservational, epidemiological, retrospective, predictive modeling study designProspective study design
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

Douglas, K.O.; Payne, K.; Sabino-Santos, G.; Chami, P.; Lorde, T. The Impact of Climate on Human Dengue Infections in the Caribbean. Pathogens 2024 , 13 , 756. https://doi.org/10.3390/pathogens13090756

Douglas KO, Payne K, Sabino-Santos G, Chami P, Lorde T. The Impact of Climate on Human Dengue Infections in the Caribbean. Pathogens . 2024; 13(9):756. https://doi.org/10.3390/pathogens13090756

Douglas, Kirk Osmond, Karl Payne, Gilberto Sabino-Santos, Peter Chami, and Troy Lorde. 2024. "The Impact of Climate on Human Dengue Infections in the Caribbean" Pathogens 13, no. 9: 756. https://doi.org/10.3390/pathogens13090756

Article Metrics

Article access statistics, supplementary material.

ZIP-Document (ZIP, 131 KiB)

Further Information

Mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

IMAGES

  1. An analysis of quality criteria for qualitative research

    criteria of research paper

  2. Criteria For Doing Good Research

    criteria of research paper

  3. (PDF) The Criteria of a Good Research

    criteria of research paper

  4. Rubric for Research Paper Criteria Exemplary Good

    criteria of research paper

  5. Sample Grading Rubric: Research Paper

    criteria of research paper

  6. Research Paper Format

    criteria of research paper

VIDEO

  1. The Power of Social Media Validation Impact on Individuals and Society #researchtopic #topicideas

  2. PhD Scholarship in Material Science, Soft Matter Chemistry, Biomaterials #scholarship

  3. How to Make Table of Contents for Review Paper ?

  4. Criteria for a Good Research Topic

  5. Glimpse of Research Paper writing

  6. How to Write a Research Paper

COMMENTS

  1. Criteria for Good Qualitative Research: A Comprehensive Review

    This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate criteria for rigorous research were identified. Then ...

  2. Example 1

    Example 1 - Research Paper Rubric. Characteristics to note in the rubric: Language is descriptive, not evaluative. Labels for degrees of success are descriptive ("Expert" "Proficient", etc.); by avoiding the use of letters representing grades or numbers representing points, there is no implied contract that qualities of the paper will ...

  3. PDF Assessment criteria for the research paper

    The research paper evidences adequate independent research but contains significant flaws such as: methodology or quality of research is only fair; poor treatment of materials; limited analysis; defective structure; distracting errors in written expression or presentation.

  4. Evaluating Research in Academic Journals: A Practical Guide to

    Evaluating Research in Academic Journals is a guide for students who are learning how to. evaluate reports of empirical research published in academic journals. It breaks down the process. of ...

  5. Inclusion and exclusion criteria in research studies: definitions and

    Inclusion criteria are defined as the key features of the target population that the investigators will use to answer their research question. 2 Typical inclusion criteria include demographic, clinical, and geographic characteristics. In contrast, exclusion criteria are defined as features of the potential study participants who meet the ...

  6. Research Paper: A step-by-step guide: 7. Evaluating Sources

    Evaluation Criteria. It's very important to evaluate the materials you find to make sure they are appropriate for a research paper. It's not enough that the information is relevant; it must also be credible. You will want to find more than enough resources, so that you can pick and choose the best for your paper.

  7. Writing Strong Research Questions

    A research question pinpoints exactly what you want to find out in your work. A good research question is essential to guide your research paper,

  8. Evaluating research: A multidisciplinary approach to assessing research

    In Canada, standard quality assessment criteria for research papers have been developed, and these deal separately with quantitative and qualitative research studies (Kmet et al., 2004 ).

  9. Editorial criteria and processes

    Editorial criteria and processes This document provides an outline of the editorial process involved in publishing a scientific paper (Article) in Nature, and describes how manuscripts are handled ...

  10. How to Write a Research Paper

    Research papers are similar to academic essays, but they are usually longer and more detailed assignments, designed to assess not only your writing skills but also your skills in scholarly research. Writing a research paper requires you to demonstrate a strong knowledge of your topic, engage with a variety of sources, and make an original contribution to the debate.

  11. Evaluating Research

    Evaluating Research refers to the process of assessing the quality, credibility, and relevance of a research study or project. This involves examining the methods, data, and results of the research in order to determine its validity, reliability, and usefulness. Evaluating research can be done by both experts and non-experts in the field, and ...

  12. Step by step guide to reviewing a manuscript

    Our step-by-step guide to conducting a review will help you through the processes of reviewing the paper, structuring your report, providing criticisms and recommendations.

  13. Methodology for research I

    Learn how to design and conduct a research study, from choosing a topic and methodology to reporting and disseminating the results.

  14. 12.1 Creating a Rough Draft for a Research Paper

    The Structure of a Research Paper Research papers generally follow the same basic structure: an introduction that presents the writer's thesis, a body section that develops the thesis with supporting points and evidence, and a conclusion that revisits the thesis and provides additional insights or suggestions for further research. Your writing voice will come across most strongly in your ...

  15. Ten simple rules for good research practice

    Papers that provide a comprehensive overview of the current state of research in the field are particularly helpful—for example, systematic reviews. Perspective papers may also be useful, for example, there is a paper with the title "SARS-CoV-2 and COVID-19: The most important research questions."

  16. Inclusion and Exclusion Criteria

    Inclusion and exclusion criteria determine which members of the target population can or can't participate in a research study. Collectively, they're known as eligibility criteria, and establishing them is critical when seeking study participants for clinical trials.

  17. How to Write and Publish a Research Paper for a Peer ...

    Communicating research findings is an essential step in the research process. Often, peer-reviewed journals are the forum for such communication, yet many researchers are never taught how to write a publishable scientific paper. In this article, we explain the basic structure of a scientific paper and describe the information that should be included in each section. We also identify common ...

  18. What is a Thesis Paper and How to Write One

    Thesis papers present your own original research or analysis on a specific topic related to your field. "In some ways, a thesis paper can look a lot like a novella," said Shana Chartier, director of information literacy at Southern New Hampshire University (SNHU). "It's too short to be a full-length novel, but with the standard size of ...

  19. Research: How to Build Consensus Around a New Idea

    New research suggests that this rejection can be due to people's lack of shared criteria or reference points when evaluating a potential innovation's value. In a new paper, the authors find ...

  20. Guides: CWP: Craft of Prose: Researching the White Paper

    The research you do for your white paper will require that you identify a specific problem, seek popular culture sources to help define the problem, its history, its significance and impact for people affected by it. You will then delve into academic and grey literature to learn about the way scholars and others with professional expertise ...

  21. Evaluating Sources

    Lateral reading. Lateral reading is the act of evaluating the credibility of a source by comparing it to other sources. This allows you to: Verify evidence. Contextualize information. Find potential weaknesses. If a source is using methods or drawing conclusions that are incompatible with other research in its field, it may not be reliable.

  22. Writing the title and abstract for a research paper: Being concise

    Abstract This article deals with formulating a suitable title and an appropriate abstract for an original research paper. The "title" and the "abstract" are the "initial impressions" of a research article, and hence they need to be drafted correctly, accurately, carefully, and meticulously. Often both of these are drafted after the full manuscript is ready. Most readers read only ...

  23. Exploring the impacts of automation in the mining industry: A

    Using the criteria, 974 articles were removed, and the studies from other sources resulted in a final sample of 94 documents. The described process is summarised in Figure 1 , and a complete list of the papers included in the review has been incorporated in Supplementary Appendix B .

  24. Partners

    Partner with Cisco to be agile, relevant, and profitable. Explore programs, incentives, and the benefits of becoming a Cisco partner.

  25. [2408.15409] Awes, Laws, and Flaws From Today's LLM Research

    We perform a critical examination of the scientific methodology behind contemporary large language model (LLM) research. For this we assess over 2,000 research works based on criteria typical of what is considered good research (e.g. presence of statistical tests and reproducibility) and cross-validate it with arguments that are at the centre of controversy (e.g., claims of emergent behaviour ...

  26. Writing a Scientific Review Article: Comprehensive Insights for

    Writing a review article is equivalent to conducting a research study, with the information gathered by the author (reviewer) representing the data. Like all major studies, it involves conceptualisation, planning, implementation, and dissemination [], all of which may be detailed in a methodology section, if necessary.

  27. The Impact of Climate on Human Dengue Infections in the Caribbean

    A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications. Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the ...