Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

  • Knowledge Base

Methodology

  • How to Write a Literature Review | Guide, Examples, & Templates

How to Write a Literature Review | Guide, Examples, & Templates

Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .

There are five key steps to writing a literature review:

  • Search for relevant literature
  • Evaluate sources
  • Identify themes, debates, and gaps
  • Outline the structure
  • Write your literature review

A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Upload your document to correct all your mistakes in minutes

upload-your-document-ai-proofreader

Table of contents

What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.

  • Quick Run-through
  • Step 1 & 2

When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

  • Demonstrate your familiarity with the topic and its scholarly context
  • Develop a theoretical framework and methodology for your research
  • Position your work in relation to other researchers and theorists
  • Show how your research addresses a gap or contributes to a debate
  • Evaluate the current state of research and demonstrate your knowledge of the scholarly debates around your topic.

Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.

Literature review guide

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

what is reviewing the literature in a research paper

Try for free

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

  • Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
  • Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
  • Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
  • Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .

Make a list of keywords

Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.

  • Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
  • Body image, self-perception, self-esteem, mental health
  • Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:

  • Your university’s library catalogue
  • Google Scholar
  • Project Muse (humanities and social sciences)
  • Medline (life sciences and biomedicine)
  • EconLit (economics)
  • Inspec (physics, engineering and computer science)

You can also use boolean operators to help narrow down your search.

Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.

For each publication, ask yourself:

  • What question or problem is the author addressing?
  • What are the key concepts and how are they defined?
  • What are the key theories, models, and methods?
  • Does the research use established frameworks or take an innovative approach?
  • What are the results and conclusions of the study?
  • How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
  • What are the strengths and weaknesses of the research?

Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.

You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

  • Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
  • Themes: what questions or concepts recur across the literature?
  • Debates, conflicts and contradictions: where do sources disagree?
  • Pivotal publications: are there any influential theories or studies that changed the direction of the field?
  • Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

  • Most research has focused on young women.
  • There is an increasing interest in the visual aspects of social media.
  • But there is still a lack of robust research on highly visual platforms like Instagram and Snapchat—this is a gap that you could address in your own research.

There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.

Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

  • Look at what results have emerged in qualitative versus quantitative research
  • Discuss how the topic has been approached by empirical versus theoretical scholarship
  • Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, you can follow these tips:

  • Summarize and synthesize: give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: don’t just paraphrase other researchers — add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically evaluate: mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: use transition words and topic sentences to draw connections, comparisons and contrasts

In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.

When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !

This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.

Scribbr slides are free to use, customize, and distribute for educational purposes.

Open Google Slides Download PowerPoint

If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.

  • Sampling methods
  • Simple random sampling
  • Stratified sampling
  • Cluster sampling
  • Likert scales
  • Reproducibility

 Statistics

  • Null hypothesis
  • Statistical power
  • Probability distribution
  • Effect size
  • Poisson distribution

Research bias

  • Optimism bias
  • Cognitive bias
  • Implicit bias
  • Hawthorne effect
  • Anchoring bias
  • Explicit bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

There are several reasons to conduct a literature review at the beginning of a research project:

  • To familiarize yourself with the current state of knowledge on your topic
  • To ensure that you’re not just repeating what others have already done
  • To identify gaps in knowledge and unresolved problems that your research can address
  • To develop your theoretical framework and methodology
  • To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved February 19, 2024, from https://www.scribbr.com/dissertation/literature-review/

Is this article helpful?

Shona McCombes

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, what is your plagiarism score.

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

OWL logo

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

  • An introductory paragraph that explains what your working topic and thesis is
  • A forecast of key topics or texts that will appear in the review
  • Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
  • Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically Evaluate: Mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

  • Summarize the key findings you have taken from the literature and emphasize their significance
  • Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

  • Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
  • Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
  • Qualitative versus quantitative research
  • Empirical versus theoretical scholarship
  • Divide the research by sociological, historical, or cultural sources
  • Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

  • It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
  • Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
  • Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
  • Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

University of Texas

  • University of Texas Libraries

Literature Reviews

  • What is a literature review?
  • Steps in the Literature Review Process
  • Define your research question
  • Determine inclusion and exclusion criteria
  • Choose databases and search
  • Review Results
  • Synthesize Results
  • Analyze Results
  • Librarian Support

What is a Literature Review?

A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field. 

A literature review should: 

  • Provide a comprehensive and updated review of the literature;
  • Explain why this review has taken place;
  • Articulate a position or hypothesis;
  • Acknowledge and account for conflicting and corroborating points of view

From  S age Research Methods

Purpose of a Literature Review

A literature review can be written as an introduction to a study to:

  • Demonstrate how a study fills a gap in research
  • Compare a study with other research that's been done

Or it can be a separate work (a research article on its own) which:

  • Organizes or describes a topic
  • Describes variables within a particular issue/problem

Limitations of a Literature Review

Some of the limitations of a literature review are:

  • It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
  • It may be too focused. Some niche studies may miss the bigger picture.
  • It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
  • It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).

Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.

Meryl Brodsky : Communication and Information Studies

Hannah Chapman Tripp : Biology, Neuroscience

Carolyn Cunningham : Human Development & Family Sciences, Psychology, Sociology

Larayne Dallas : Engineering

Janelle Hedstrom : Special Education, Curriculum & Instruction, Ed Leadership & Policy ​

Susan Macicak : Linguistics

Imelda Vetter : Dell Medical School

For help in other subject areas, please see the guide to library specialists by subject .

Periodically, UT Libraries runs a workshop covering the basics and library support for literature reviews. While we try to offer these once per academic year, we find providing the recording to be helpful to community members who have missed the session. Following is the most recent recording of the workshop, Conducting a Literature Review. To view the recording, a UT login is required.

  • October 26, 2022 recording
  • Last Updated: Oct 26, 2022 2:49 PM
  • URL: https://guides.lib.utexas.edu/literaturereviews

Creative Commons License

  • Resources Home 🏠
  • Try SciSpace Copilot
  • Search research papers
  • Add Copilot Extension
  • Try AI Detector
  • Try Paraphraser
  • Try Citation Generator
  • April Papers
  • June Papers
  • July Papers

SciSpace Resources

How To Write A Literature Review - A Complete Guide

Deeptanshu D

Table of Contents

A literature review is much more than just another section in your research paper. It forms the very foundation of your research. It is a formal piece of writing where you analyze the existing theoretical framework, principles, and assumptions and use that as a base to shape your approach to the research question.

Curating and drafting a solid literature review section not only lends more credibility to your research paper but also makes your research tighter and better focused. But, writing literature reviews is a difficult task. It requires extensive reading, plus you have to consider market trends and technological and political changes, which tend to change in the blink of an eye.

Now streamline your literature review process with the help of SciSpace Copilot. With this AI research assistant, you can efficiently synthesize and analyze a vast amount of information, identify key themes and trends, and uncover gaps in the existing research. Get real-time explanations, summaries, and answers to your questions for the paper you're reviewing, making navigating and understanding the complex literature landscape easier.

Perform Literature reviews using SciSpace Copilot

In this comprehensive guide, we will explore everything from the definition of a literature review, its appropriate length, various types of literature reviews, and how to write one.

What is a literature review?

A literature review is a collation of survey, research, critical evaluation, and assessment of the existing literature in a preferred domain.

Eminent researcher and academic Arlene Fink, in her book Conducting Research Literature Reviews , defines it as the following:

“A literature review surveys books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated.

Literature reviews are designed to provide an overview of sources you have explored while researching a particular topic, and to demonstrate to your readers how your research fits within a larger field of study.”

Simply put, a literature review can be defined as a critical discussion of relevant pre-existing research around your research question and carving out a definitive place for your study in the existing body of knowledge. Literature reviews can be presented in multiple ways: a section of an article, the whole research paper itself, or a chapter of your thesis.

A literature review paper

A literature review does function as a summary of sources, but it also allows you to analyze further, interpret, and examine the stated theories, methods, viewpoints, and, of course, the gaps in the existing content.

As an author, you can discuss and interpret the research question and its various aspects and debate your adopted methods to support the claim.

What is the purpose of a literature review?

A literature review is meant to help your readers understand the relevance of your research question and where it fits within the existing body of knowledge. As a researcher, you should use it to set the context, build your argument, and establish the need for your study.

What is the importance of a literature review?

The literature review is a critical part of research papers because it helps you:

  • Gain an in-depth understanding of your research question and the surrounding area
  • Convey that you have a thorough understanding of your research area and are up-to-date with the latest changes and advancements
  • Establish how your research is connected or builds on the existing body of knowledge and how it could contribute to further research
  • Elaborate on the validity and suitability of your theoretical framework and research methodology
  • Identify and highlight gaps and shortcomings in the existing body of knowledge and how things need to change
  • Convey to readers how your study is different or how it contributes to the research area

How long should a literature review be?

Ideally, the literature review should take up 15%-40% of the total length of your manuscript. So, if you have a 10,000-word research paper, the minimum word count could be 1500.

Your literature review format depends heavily on the kind of manuscript you are writing — an entire chapter in case of doctoral theses, a part of the introductory section in a research article, to a full-fledged review article that examines the previously published research on a topic.

Another determining factor is the type of research you are doing. The literature review section tends to be longer for secondary research projects than primary research projects.

What are the different types of literature reviews?

All literature reviews are not the same. There are a variety of possible approaches that you can take. It all depends on the type of research you are pursuing.

Here are the different types of literature reviews:

Argumentative review

It is called an argumentative review when you carefully present literature that only supports or counters a specific argument or premise to establish a viewpoint.

Integrative review

It is a type of literature review focused on building a comprehensive understanding of a topic by combining available theoretical frameworks and empirical evidence.

Methodological review

This approach delves into the ''how'' and the ''what" of the research question —  you cannot look at the outcome in isolation; you should also review the methodology used.

Systematic review

This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research and collect, report, and analyze data from the studies included in the review.

Meta-analysis review

Meta-analysis uses statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects than those derived from the individual studies included within a review.

Historical review

Historical literature reviews focus on examining research throughout a period, often starting with the first time an issue, concept, theory, or phenomenon emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and identify future research's likely directions.

Theoretical Review

This form aims to examine the corpus of theory accumulated regarding an issue, concept, theory, and phenomenon. The theoretical literature review helps to establish what theories exist, the relationships between them, the degree the existing approaches have been investigated, and to develop new hypotheses to be tested.

Scoping Review

The Scoping Review is often used at the beginning of an article, dissertation, or research proposal. It is conducted before the research to highlight gaps in the existing body of knowledge and explains why the project should be greenlit.

State-of-the-Art Review

The State-of-the-Art review is conducted periodically, focusing on the most recent research. It describes what is currently known, understood, or agreed upon regarding the research topic and highlights where there are still disagreements.

Can you use the first person in a literature review?

When writing literature reviews, you should avoid the usage of first-person pronouns. It means that instead of "I argue that" or "we argue that," the appropriate expression would be "this research paper argues that."

Do you need an abstract for a literature review?

Ideally, yes. It is always good to have a condensed summary that is self-contained and independent of the rest of your review. As for how to draft one, you can follow the same fundamental idea when preparing an abstract for a literature review. It should also include:

  • The research topic and your motivation behind selecting it
  • A one-sentence thesis statement
  • An explanation of the kinds of literature featured in the review
  • Summary of what you've learned
  • Conclusions you drew from the literature you reviewed
  • Potential implications and future scope for research

Here's an example of the abstract of a literature review

Abstract-of-a-literature-review

Is a literature review written in the past tense?

Yes, the literature review should ideally be written in the past tense. You should not use the present or future tense when writing one. The exceptions are when you have statements describing events that happened earlier than the literature you are reviewing or events that are currently occurring; then, you can use the past perfect or present perfect tenses.

How many sources for a literature review?

There are multiple approaches to deciding how many sources to include in a literature review section. The first approach would be to look level you are at as a researcher. For instance, a doctoral thesis might need 60+ sources. In contrast, you might only need to refer to 5-15 sources at the undergraduate level.

The second approach is based on the kind of literature review you are doing — whether it is merely a chapter of your paper or if it is a self-contained paper in itself. When it is just a chapter, sources should equal the total number of pages in your article's body. In the second scenario, you need at least three times as many sources as there are pages in your work.

Quick tips on how to write a literature review

To know how to write a literature review, you must clearly understand its impact and role in establishing your work as substantive research material.

You need to follow the below-mentioned steps, to write a literature review:

  • Outline the purpose behind the literature review
  • Search relevant literature
  • Examine and assess the relevant resources
  • Discover connections by drawing deep insights from the resources
  • Structure planning to write a good literature review

1. Outline and identify the purpose of  a literature review

As a first step on how to write a literature review, you must know what the research question or topic is and what shape you want your literature review to take. Ensure you understand the research topic inside out, or else seek clarifications. You must be able to the answer below questions before you start:

  • How many sources do I need to include?
  • What kind of sources should I analyze?
  • How much should I critically evaluate each source?
  • Should I summarize, synthesize or offer a critique of the sources?
  • Do I need to include any background information or definitions?

Additionally, you should know that the narrower your research topic is, the swifter it will be for you to restrict the number of sources to be analyzed.

2. Search relevant literature

Dig deeper into search engines to discover what has already been published around your chosen topic. Make sure you thoroughly go through appropriate reference sources like books, reports, journal articles, government docs, and web-based resources.

You must prepare a list of keywords and their different variations. You can start your search from any library’s catalog, provided you are an active member of that institution. The exact keywords can be extended to widen your research over other databases and academic search engines like:

  • Google Scholar
  • Microsoft Academic
  • Science.gov

Besides, it is not advisable to go through every resource word by word. Alternatively, what you can do is you can start by reading the abstract and then decide whether that source is relevant to your research or not.

Additionally, you must spend surplus time assessing the quality and relevance of resources. It would help if you tried preparing a list of citations to ensure that there lies no repetition of authors, publications, or articles in the literature review.

3. Examine and assess the sources

It is nearly impossible for you to go through every detail in the research article. So rather than trying to fetch every detail, you have to analyze and decide which research sources resemble closest and appear relevant to your chosen domain.

While analyzing the sources, you should look to find out answers to questions like:

  • What question or problem has the author been describing and debating?
  • What is the definition of critical aspects?
  • How well the theories, approach, and methodology have been explained?
  • Whether the research theory used some conventional or new innovative approach?
  • How relevant are the key findings of the work?
  • In what ways does it relate to other sources on the same topic?
  • What challenges does this research paper pose to the existing theory
  • What are the possible contributions or benefits it adds to the subject domain?

Be always mindful that you refer only to credible and authentic resources. It would be best if you always take references from different publications to validate your theory.

Always keep track of important information or data you can present in your literature review right from the beginning. It will help steer your path from any threats of plagiarism and also make it easier to curate an annotated bibliography or reference section.

4. Discover connections

At this stage, you must start deciding on the argument and structure of your literature review. To accomplish this, you must discover and identify the relations and connections between various resources while drafting your abstract.

A few aspects that you should be aware of while writing a literature review include:

  • Rise to prominence: Theories and methods that have gained reputation and supporters over time.
  • Constant scrutiny: Concepts or theories that repeatedly went under examination.
  • Contradictions and conflicts: Theories, both the supporting and the contradictory ones, for the research topic.
  • Knowledge gaps: What exactly does it fail to address, and how to bridge them with further research?
  • Influential resources: Significant research projects available that have been upheld as milestones or perhaps, something that can modify the current trends

Once you join the dots between various past research works, it will be easier for you to draw a conclusion and identify your contribution to the existing knowledge base.

5. Structure planning to write a good literature review

There exist different ways towards planning and executing the structure of a literature review. The format of a literature review varies and depends upon the length of the research.

Like any other research paper, the literature review format must contain three sections: introduction, body, and conclusion. The goals and objectives of the research question determine what goes inside these three sections.

Nevertheless, a good literature review can be structured according to the chronological, thematic, methodological, or theoretical framework approach.

Literature review samples

1. Standalone

Standalone-Literature-Review

2. As a section of a research paper

Literature-review-as-a-section-of-a-research-paper

How SciSpace Discover makes literature review a breeze?

SciSpace Discover is a one-stop solution to do an effective literature search and get barrier-free access to scientific knowledge. It is an excellent repository where you can find millions of only peer-reviewed articles and full-text PDF files. Here’s more on how you can use it:

Find the right information

Find-the-right-information-using-SciSpace

Find what you want quickly and easily with comprehensive search filters that let you narrow down papers according to PDF availability, year of publishing, document type, and affiliated institution. Moreover, you can sort the results based on the publishing date, citation count, and relevance.

Assess credibility of papers quickly

Assess-credibility-of-papers-quickly-using-SciSpace

When doing the literature review, it is critical to establish the quality of your sources. They form the foundation of your research. SciSpace Discover helps you assess the quality of a source by providing an overview of its references, citations, and performance metrics.

Get the complete picture in no time

SciSpace's-personalized-informtion-engine

SciSpace Discover’s personalized suggestion engine helps you stay on course and get the complete picture of the topic from one place. Every time you visit an article page, it provides you links to related papers. Besides that, it helps you understand what’s trending, who are the top authors, and who are the leading publishers on a topic.

Make referring sources super easy

Make-referring-pages-super-easy-with-SciSpace

To ensure you don't lose track of your sources, you must start noting down your references when doing the literature review. SciSpace Discover makes this step effortless. Click the 'cite' button on an article page, and you will receive preloaded citation text in multiple styles — all you've to do is copy-paste it into your manuscript.

Final tips on how to write a literature review

A massive chunk of time and effort is required to write a good literature review. But, if you go about it systematically, you'll be able to save a ton of time and build a solid foundation for your research.

We hope this guide has helped you answer several key questions you have about writing literature reviews.

Would you like to explore SciSpace Discover and kick off your literature search right away? You can get started here .

Frequently Asked Questions (FAQs)

1. how to start a literature review.

• What questions do you want to answer?

• What sources do you need to answer these questions?

• What information do these sources contain?

• How can you use this information to answer your questions?

2. What to include in a literature review?

• A brief background of the problem or issue

• What has previously been done to address the problem or issue

• A description of what you will do in your project

• How this study will contribute to research on the subject

3. Why literature review is important?

The literature review is an important part of any research project because it allows the writer to look at previous studies on a topic and determine existing gaps in the literature, as well as what has already been done. It will also help them to choose the most appropriate method for their own study.

4. How to cite a literature review in APA format?

To cite a literature review in APA style, you need to provide the author's name, the title of the article, and the year of publication. For example: Patel, A. B., & Stokes, G. S. (2012). The relationship between personality and intelligence: A meta-analysis of longitudinal research. Personality and Individual Differences, 53(1), 16-21

5. What are the components of a literature review?

• A brief introduction to the topic, including its background and context. The introduction should also include a rationale for why the study is being conducted and what it will accomplish.

• A description of the methodologies used in the study. This can include information about data collection methods, sample size, and statistical analyses.

• A presentation of the findings in an organized format that helps readers follow along with the author's conclusions.

6. What are common errors in writing literature review?

• Not spending enough time to critically evaluate the relevance of resources, observations and conclusions.

• Totally relying on secondary data while ignoring primary data.

• Letting your personal bias seep into your interpretation of existing literature.

• No detailed explanation of the procedure to discover and identify an appropriate literature review.

7. What are the 5 C's of writing literature review?

• Cite - the sources you utilized and referenced in your research.

• Compare - existing arguments, hypotheses, methodologies, and conclusions found in the knowledge base.

• Contrast - the arguments, topics, methodologies, approaches, and disputes that may be found in the literature.

• Critique - the literature and describe the ideas and opinions you find more convincing and why.

• Connect - the various studies you reviewed in your research.

8. How many sources should a literature review have?

When it is just a chapter, sources should equal the total number of pages in your article's body. if it is a self-contained paper in itself, you need at least three times as many sources as there are pages in your work.

9. Can literature review have diagrams?

• To represent an abstract idea or concept

• To explain the steps of a process or procedure

• To help readers understand the relationships between different concepts

10. How old should sources be in a literature review?

Sources for a literature review should be as current as possible or not older than ten years. The only exception to this rule is if you are reviewing a historical topic and need to use older sources.

11. What are the types of literature review?

• Argumentative review

• Integrative review

• Methodological review

• Systematic review

• Meta-analysis review

• Historical review

• Theoretical review

• Scoping review

• State-of-the-Art review

12. Is a literature review mandatory?

Yes. Literature review is a mandatory part of any research project. It is a critical step in the process that allows you to establish the scope of your research, and provide a background for the rest of your work.

But before you go,

  • Six Online Tools for Easy Literature Review
  • Evaluating literature review: systematic vs. scoping reviews
  • Systematic Approaches to a Successful Literature Review
  • Writing Integrative Literature Reviews: Guidelines and Examples

You might also like

Consensus GPT vs. SciSpace GPT: Choose the Best GPT for Research

Consensus GPT vs. SciSpace GPT: Choose the Best GPT for Research

Sumalatha G

Literature Review and Theoretical Framework: Understanding the Differences

Nikhil Seethi

Types of Essays in Academic Writing

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

  • Knowledge Base
  • Dissertation
  • What is a Literature Review? | Guide, Template, & Examples

What is a Literature Review? | Guide, Template, & Examples

Published on 22 February 2022 by Shona McCombes . Revised on 7 June 2022.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research.

There are five key steps to writing a literature review:

  • Search for relevant literature
  • Evaluate sources
  • Identify themes, debates and gaps
  • Outline the structure
  • Write your literature review

A good literature review doesn’t just summarise sources – it analyses, synthesises, and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

upload-your-document-ai-proofreader

Table of contents

Why write a literature review, examples of literature reviews, step 1: search for relevant literature, step 2: evaluate and select sources, step 3: identify themes, debates and gaps, step 4: outline your literature review’s structure, step 5: write your literature review, frequently asked questions about literature reviews, introduction.

  • Quick Run-through
  • Step 1 & 2

When you write a dissertation or thesis, you will have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

  • Demonstrate your familiarity with the topic and scholarly context
  • Develop a theoretical framework and methodology for your research
  • Position yourself in relation to other researchers and theorists
  • Show how your dissertation addresses a gap or contributes to a debate

You might also have to write a literature review as a stand-alone assignment. In this case, the purpose is to evaluate the current state of research and demonstrate your knowledge of scholarly debates around a topic.

The content will look slightly different in each case, but the process of conducting a literature review follows the same steps. We’ve written a step-by-step guide that you can follow below.

Literature review guide

The only proofreading tool specialized in correcting academic writing

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

what is reviewing the literature in a research paper

Correct my document today

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

  • Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
  • Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
  • Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
  • Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research objectives and questions .

If you are writing a literature review as a stand-alone assignment, you will have to choose a focus and develop a central question to direct your search. Unlike a dissertation research question, this question has to be answerable without collecting original data. You should be able to answer it based only on a review of existing publications.

Make a list of keywords

Start by creating a list of keywords related to your research topic. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list if you discover new keywords in the process of your literature search.

  • Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
  • Body image, self-perception, self-esteem, mental health
  • Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some databases to search for journals and articles include:

  • Your university’s library catalogue
  • Google Scholar
  • Project Muse (humanities and social sciences)
  • Medline (life sciences and biomedicine)
  • EconLit (economics)
  • Inspec (physics, engineering and computer science)

You can use boolean operators to help narrow down your search:

Read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

To identify the most important publications on your topic, take note of recurring citations. If the same authors, books or articles keep appearing in your reading, make sure to seek them out.

You probably won’t be able to read absolutely everything that has been written on the topic – you’ll have to evaluate which sources are most relevant to your questions.

For each publication, ask yourself:

  • What question or problem is the author addressing?
  • What are the key concepts and how are they defined?
  • What are the key theories, models and methods? Does the research use established frameworks or take an innovative approach?
  • What are the results and conclusions of the study?
  • How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
  • How does the publication contribute to your understanding of the topic? What are its key insights and arguments?
  • What are the strengths and weaknesses of the research?

Make sure the sources you use are credible, and make sure you read any landmark studies and major theories in your field of research.

You can find out how many times an article has been cited on Google Scholar – a high citation count means the article has been influential in the field, and should certainly be included in your literature review.

The scope of your review will depend on your topic and discipline: in the sciences you usually only review recent literature, but in the humanities you might take a long historical perspective (for example, to trace how a concept has changed in meaning over time).

Remember that you can use our template to summarise and evaluate sources you’re thinking about using!

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It’s important to keep track of your sources with references to avoid plagiarism . It can be helpful to make an annotated bibliography, where you compile full reference information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

You can use our free APA Reference Generator for quick, correct, consistent citations.

Prevent plagiarism, run a free check.

To begin organising your literature review’s argument and structure, you need to understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

  • Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
  • Themes: what questions or concepts recur across the literature?
  • Debates, conflicts and contradictions: where do sources disagree?
  • Pivotal publications: are there any influential theories or studies that changed the direction of the field?
  • Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

  • Most research has focused on young women.
  • There is an increasing interest in the visual aspects of social media.
  • But there is still a lack of robust research on highly-visual platforms like Instagram and Snapchat – this is a gap that you could address in your own research.

There are various approaches to organising the body of a literature review. You should have a rough idea of your strategy before you start writing.

Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarising sources in order.

Try to analyse patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organise your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

  • Look at what results have emerged in qualitative versus quantitative research
  • Discuss how the topic has been approached by empirical versus theoretical scholarship
  • Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text, your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

If you are writing the literature review as part of your dissertation or thesis, reiterate your central problem or research question and give a brief summary of the scholarly context. You can emphasise the timeliness of the topic (“many recent studies have focused on the problem of x”) or highlight a gap in the literature (“while there has been much research on x, few researchers have taken y into consideration”).

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, make sure to follow these tips:

  • Summarise and synthesise: give an overview of the main points of each source and combine them into a coherent whole.
  • Analyse and interpret: don’t just paraphrase other researchers – add your own interpretations, discussing the significance of findings in relation to the literature as a whole.
  • Critically evaluate: mention the strengths and weaknesses of your sources.
  • Write in well-structured paragraphs: use transitions and topic sentences to draw connections, comparisons and contrasts.

In the conclusion, you should summarise the key findings you have taken from the literature and emphasise their significance.

If the literature review is part of your dissertation or thesis, reiterate how your research addresses gaps and contributes new knowledge, or discuss how you have drawn on existing theories and methods to build a framework for your research. This can lead directly into your methodology section.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

There are several reasons to conduct a literature review at the beginning of a research project:

  • To familiarise yourself with the current state of knowledge on your topic
  • To ensure that you’re not just repeating what others have already done
  • To identify gaps in knowledge and unresolved problems that your research can address
  • To develop your theoretical framework and methodology
  • To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2022, June 07). What is a Literature Review? | Guide, Template, & Examples. Scribbr. Retrieved 19 February 2024, from https://www.scribbr.co.uk/thesis-dissertation/literature-review/

Is this article helpful?

Shona McCombes

Shona McCombes

Other students also liked, how to write a dissertation proposal | a step-by-step guide, what is a theoretical framework | a step-by-step guide, what is a research methodology | steps & tips.

  • Privacy Policy
  • SignUp/Login

Research Method

Home » Literature Review – Types Writing Guide and Examples

Literature Review – Types Writing Guide and Examples

Table of Contents

Literature Review

Literature Review

Definition:

A literature review is a comprehensive and critical analysis of the existing literature on a particular topic or research question. It involves identifying, evaluating, and synthesizing relevant literature, including scholarly articles, books, and other sources, to provide a summary and critical assessment of what is known about the topic.

Types of Literature Review

Types of Literature Review are as follows:

  • Narrative literature review : This type of review involves a comprehensive summary and critical analysis of the available literature on a particular topic or research question. It is often used as an introductory section of a research paper.
  • Systematic literature review: This is a rigorous and structured review that follows a pre-defined protocol to identify, evaluate, and synthesize all relevant studies on a specific research question. It is often used in evidence-based practice and systematic reviews.
  • Meta-analysis: This is a quantitative review that uses statistical methods to combine data from multiple studies to derive a summary effect size. It provides a more precise estimate of the overall effect than any individual study.
  • Scoping review: This is a preliminary review that aims to map the existing literature on a broad topic area to identify research gaps and areas for further investigation.
  • Critical literature review : This type of review evaluates the strengths and weaknesses of the existing literature on a particular topic or research question. It aims to provide a critical analysis of the literature and identify areas where further research is needed.
  • Conceptual literature review: This review synthesizes and integrates theories and concepts from multiple sources to provide a new perspective on a particular topic. It aims to provide a theoretical framework for understanding a particular research question.
  • Rapid literature review: This is a quick review that provides a snapshot of the current state of knowledge on a specific research question or topic. It is often used when time and resources are limited.
  • Thematic literature review : This review identifies and analyzes common themes and patterns across a body of literature on a particular topic. It aims to provide a comprehensive overview of the literature and identify key themes and concepts.
  • Realist literature review: This review is often used in social science research and aims to identify how and why certain interventions work in certain contexts. It takes into account the context and complexities of real-world situations.
  • State-of-the-art literature review : This type of review provides an overview of the current state of knowledge in a particular field, highlighting the most recent and relevant research. It is often used in fields where knowledge is rapidly evolving, such as technology or medicine.
  • Integrative literature review: This type of review synthesizes and integrates findings from multiple studies on a particular topic to identify patterns, themes, and gaps in the literature. It aims to provide a comprehensive understanding of the current state of knowledge on a particular topic.
  • Umbrella literature review : This review is used to provide a broad overview of a large and diverse body of literature on a particular topic. It aims to identify common themes and patterns across different areas of research.
  • Historical literature review: This type of review examines the historical development of research on a particular topic or research question. It aims to provide a historical context for understanding the current state of knowledge on a particular topic.
  • Problem-oriented literature review : This review focuses on a specific problem or issue and examines the literature to identify potential solutions or interventions. It aims to provide practical recommendations for addressing a particular problem or issue.
  • Mixed-methods literature review : This type of review combines quantitative and qualitative methods to synthesize and analyze the available literature on a particular topic. It aims to provide a more comprehensive understanding of the research question by combining different types of evidence.

Parts of Literature Review

Parts of a literature review are as follows:

Introduction

The introduction of a literature review typically provides background information on the research topic and why it is important. It outlines the objectives of the review, the research question or hypothesis, and the scope of the review.

Literature Search

This section outlines the search strategy and databases used to identify relevant literature. The search terms used, inclusion and exclusion criteria, and any limitations of the search are described.

Literature Analysis

The literature analysis is the main body of the literature review. This section summarizes and synthesizes the literature that is relevant to the research question or hypothesis. The review should be organized thematically, chronologically, or by methodology, depending on the research objectives.

Critical Evaluation

Critical evaluation involves assessing the quality and validity of the literature. This includes evaluating the reliability and validity of the studies reviewed, the methodology used, and the strength of the evidence.

The conclusion of the literature review should summarize the main findings, identify any gaps in the literature, and suggest areas for future research. It should also reiterate the importance of the research question or hypothesis and the contribution of the literature review to the overall research project.

The references list includes all the sources cited in the literature review, and follows a specific referencing style (e.g., APA, MLA, Harvard).

How to write Literature Review

Here are some steps to follow when writing a literature review:

  • Define your research question or topic : Before starting your literature review, it is essential to define your research question or topic. This will help you identify relevant literature and determine the scope of your review.
  • Conduct a comprehensive search: Use databases and search engines to find relevant literature. Look for peer-reviewed articles, books, and other academic sources that are relevant to your research question or topic.
  • Evaluate the sources: Once you have found potential sources, evaluate them critically to determine their relevance, credibility, and quality. Look for recent publications, reputable authors, and reliable sources of data and evidence.
  • Organize your sources: Group the sources by theme, method, or research question. This will help you identify similarities and differences among the literature, and provide a structure for your literature review.
  • Analyze and synthesize the literature : Analyze each source in depth, identifying the key findings, methodologies, and conclusions. Then, synthesize the information from the sources, identifying patterns and themes in the literature.
  • Write the literature review : Start with an introduction that provides an overview of the topic and the purpose of the literature review. Then, organize the literature according to your chosen structure, and analyze and synthesize the sources. Finally, provide a conclusion that summarizes the key findings of the literature review, identifies gaps in knowledge, and suggests areas for future research.
  • Edit and proofread: Once you have written your literature review, edit and proofread it carefully to ensure that it is well-organized, clear, and concise.

Examples of Literature Review

Here’s an example of how a literature review can be conducted for a thesis on the topic of “ The Impact of Social Media on Teenagers’ Mental Health”:

  • Start by identifying the key terms related to your research topic. In this case, the key terms are “social media,” “teenagers,” and “mental health.”
  • Use academic databases like Google Scholar, JSTOR, or PubMed to search for relevant articles, books, and other publications. Use these keywords in your search to narrow down your results.
  • Evaluate the sources you find to determine if they are relevant to your research question. You may want to consider the publication date, author’s credentials, and the journal or book publisher.
  • Begin reading and taking notes on each source, paying attention to key findings, methodologies used, and any gaps in the research.
  • Organize your findings into themes or categories. For example, you might categorize your sources into those that examine the impact of social media on self-esteem, those that explore the effects of cyberbullying, and those that investigate the relationship between social media use and depression.
  • Synthesize your findings by summarizing the key themes and highlighting any gaps or inconsistencies in the research. Identify areas where further research is needed.
  • Use your literature review to inform your research questions and hypotheses for your thesis.

For example, after conducting a literature review on the impact of social media on teenagers’ mental health, a thesis might look like this:

“Using a mixed-methods approach, this study aims to investigate the relationship between social media use and mental health outcomes in teenagers. Specifically, the study will examine the effects of cyberbullying, social comparison, and excessive social media use on self-esteem, anxiety, and depression. Through an analysis of survey data and qualitative interviews with teenagers, the study will provide insight into the complex relationship between social media use and mental health outcomes, and identify strategies for promoting positive mental health outcomes in young people.”

Reference: Smith, J., Jones, M., & Lee, S. (2019). The effects of social media use on adolescent mental health: A systematic review. Journal of Adolescent Health, 65(2), 154-165. doi:10.1016/j.jadohealth.2019.03.024

Reference Example: Author, A. A., Author, B. B., & Author, C. C. (Year). Title of article. Title of Journal, volume number(issue number), page range. doi:0000000/000000000000 or URL

Applications of Literature Review

some applications of literature review in different fields:

  • Social Sciences: In social sciences, literature reviews are used to identify gaps in existing research, to develop research questions, and to provide a theoretical framework for research. Literature reviews are commonly used in fields such as sociology, psychology, anthropology, and political science.
  • Natural Sciences: In natural sciences, literature reviews are used to summarize and evaluate the current state of knowledge in a particular field or subfield. Literature reviews can help researchers identify areas where more research is needed and provide insights into the latest developments in a particular field. Fields such as biology, chemistry, and physics commonly use literature reviews.
  • Health Sciences: In health sciences, literature reviews are used to evaluate the effectiveness of treatments, identify best practices, and determine areas where more research is needed. Literature reviews are commonly used in fields such as medicine, nursing, and public health.
  • Humanities: In humanities, literature reviews are used to identify gaps in existing knowledge, develop new interpretations of texts or cultural artifacts, and provide a theoretical framework for research. Literature reviews are commonly used in fields such as history, literary studies, and philosophy.

Role of Literature Review in Research

Here are some applications of literature review in research:

  • Identifying Research Gaps : Literature review helps researchers identify gaps in existing research and literature related to their research question. This allows them to develop new research questions and hypotheses to fill those gaps.
  • Developing Theoretical Framework: Literature review helps researchers develop a theoretical framework for their research. By analyzing and synthesizing existing literature, researchers can identify the key concepts, theories, and models that are relevant to their research.
  • Selecting Research Methods : Literature review helps researchers select appropriate research methods and techniques based on previous research. It also helps researchers to identify potential biases or limitations of certain methods and techniques.
  • Data Collection and Analysis: Literature review helps researchers in data collection and analysis by providing a foundation for the development of data collection instruments and methods. It also helps researchers to identify relevant data sources and identify potential data analysis techniques.
  • Communicating Results: Literature review helps researchers to communicate their results effectively by providing a context for their research. It also helps to justify the significance of their findings in relation to existing research and literature.

Purpose of Literature Review

Some of the specific purposes of a literature review are as follows:

  • To provide context: A literature review helps to provide context for your research by situating it within the broader body of literature on the topic.
  • To identify gaps and inconsistencies: A literature review helps to identify areas where further research is needed or where there are inconsistencies in the existing literature.
  • To synthesize information: A literature review helps to synthesize the information from multiple sources and present a coherent and comprehensive picture of the current state of knowledge on the topic.
  • To identify key concepts and theories : A literature review helps to identify key concepts and theories that are relevant to your research question and provide a theoretical framework for your study.
  • To inform research design: A literature review can inform the design of your research study by identifying appropriate research methods, data sources, and research questions.

Characteristics of Literature Review

Some Characteristics of Literature Review are as follows:

  • Identifying gaps in knowledge: A literature review helps to identify gaps in the existing knowledge and research on a specific topic or research question. By analyzing and synthesizing the literature, you can identify areas where further research is needed and where new insights can be gained.
  • Establishing the significance of your research: A literature review helps to establish the significance of your own research by placing it in the context of existing research. By demonstrating the relevance of your research to the existing literature, you can establish its importance and value.
  • Informing research design and methodology : A literature review helps to inform research design and methodology by identifying the most appropriate research methods, techniques, and instruments. By reviewing the literature, you can identify the strengths and limitations of different research methods and techniques, and select the most appropriate ones for your own research.
  • Supporting arguments and claims: A literature review provides evidence to support arguments and claims made in academic writing. By citing and analyzing the literature, you can provide a solid foundation for your own arguments and claims.
  • I dentifying potential collaborators and mentors: A literature review can help identify potential collaborators and mentors by identifying researchers and practitioners who are working on related topics or using similar methods. By building relationships with these individuals, you can gain valuable insights and support for your own research and practice.
  • Keeping up-to-date with the latest research : A literature review helps to keep you up-to-date with the latest research on a specific topic or research question. By regularly reviewing the literature, you can stay informed about the latest findings and developments in your field.

Advantages of Literature Review

There are several advantages to conducting a literature review as part of a research project, including:

  • Establishing the significance of the research : A literature review helps to establish the significance of the research by demonstrating the gap or problem in the existing literature that the study aims to address.
  • Identifying key concepts and theories: A literature review can help to identify key concepts and theories that are relevant to the research question, and provide a theoretical framework for the study.
  • Supporting the research methodology : A literature review can inform the research methodology by identifying appropriate research methods, data sources, and research questions.
  • Providing a comprehensive overview of the literature : A literature review provides a comprehensive overview of the current state of knowledge on a topic, allowing the researcher to identify key themes, debates, and areas of agreement or disagreement.
  • Identifying potential research questions: A literature review can help to identify potential research questions and areas for further investigation.
  • Avoiding duplication of research: A literature review can help to avoid duplication of research by identifying what has already been done on a topic, and what remains to be done.
  • Enhancing the credibility of the research : A literature review helps to enhance the credibility of the research by demonstrating the researcher’s knowledge of the existing literature and their ability to situate their research within a broader context.

Limitations of Literature Review

Limitations of Literature Review are as follows:

  • Limited scope : Literature reviews can only cover the existing literature on a particular topic, which may be limited in scope or depth.
  • Publication bias : Literature reviews may be influenced by publication bias, which occurs when researchers are more likely to publish positive results than negative ones. This can lead to an incomplete or biased picture of the literature.
  • Quality of sources : The quality of the literature reviewed can vary widely, and not all sources may be reliable or valid.
  • Time-limited: Literature reviews can become quickly outdated as new research is published, making it difficult to keep up with the latest developments in a field.
  • Subjective interpretation : Literature reviews can be subjective, and the interpretation of the findings can vary depending on the researcher’s perspective or bias.
  • Lack of original data : Literature reviews do not generate new data, but rather rely on the analysis of existing studies.
  • Risk of plagiarism: It is important to ensure that literature reviews do not inadvertently contain plagiarism, which can occur when researchers use the work of others without proper attribution.

About the author

' src=

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Paper Conclusion

Research Paper Conclusion – Writing Guide and...

Appendices

Appendices – Writing Guide, Types and Examples

Research Report

Research Report – Example, Writing Guide and...

Delimitations

Delimitations in Research – Types, Examples and...

Scope of the Research

Scope of the Research – Writing Guide and...

Research Contribution

Research Contribution – Thesis Guide

Harvey Cushing/John Hay Whitney Medical Library

  • Collections
  • Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

  • Biomedical Databases
  • Global (Public Health) Databases
  • Soc. Sci., History, and Law Databases
  • Grey Literature
  • Trials Registers
  • Data and Statistics
  • Public Policy
  • Google Tips
  • Recommended Books
  • Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Discovers relationships between research studies/ideas.
  • Identifies major themes, concepts, and researchers on a topic.
  • Identifies critical gaps and points of disagreement.
  • Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

Cover Art

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

  • Make sure your research question is not too broad or too narrow.  Is it manageable?
  • Begin writing down terms that are related to your question. These will be useful for searches later.
  • If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

  • This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

  • use the tabs on this guide
  • Find other databases in the Nursing Information Resources web page
  • More on the Medical Library web page
  • ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

  • Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
  • Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
  • Review the abstracts of research studies carefully. This will save you time.
  • Use the bibliographies and references of research studies you find to locate others.
  • Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
  • Ask your librarian for help at any time.
  • Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

  • What was the research question of the study you are reviewing? What were the authors trying to discover?
  • Was the research funded by a source that could influence the findings?
  • What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
  • Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
  • If there are conflicting studies, why do you think that is?
  • How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

  • Review the abstracts carefully.  
  • Keep careful notes so that you may track your thought processes during the research process.
  • Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
  • << Previous: Recommended Books
  • Last Updated: Jan 4, 2024 10:52 AM
  • URL: https://guides.library.yale.edu/YSNDoctoral

Libraries | Research Guides

Literature reviews, what is a literature review, learning more about how to do a literature review.

  • Planning the Review
  • The Research Question
  • Choosing Where to Search
  • Organizing the Review
  • Writing the Review

A literature review is a review and synthesis of existing research on a topic or research question. A literature review is meant to analyze the scholarly literature, make connections across writings and identify strengths, weaknesses, trends, and missing conversations. A literature review should address different aspects of a topic as it relates to your research question. A literature review goes beyond a description or summary of the literature you have read. 

  • Sage Research Methods Core Collection This link opens in a new window SAGE Research Methods supports research at all levels by providing material to guide users through every step of the research process. SAGE Research Methods is the ultimate methods library with more than 1000 books, reference works, journal articles, and instructional videos by world-leading academics from across the social sciences, including the largest collection of qualitative methods books available online from any scholarly publisher. – Publisher

Cover Art

  • Next: Planning the Review >>
  • Last Updated: Jan 17, 2024 10:05 AM
  • URL: https://libguides.northwestern.edu/literaturereviews

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • CAREER FEATURE
  • 04 December 2020
  • Correction 09 December 2020

How to write a superb literature review

Andy Tay is a freelance writer based in Singapore.

You can also search for this author in PubMed   Google Scholar

Literature reviews are important resources for scientists. They provide historical context for a field while offering opinions on its future trajectory. Creating them can provide inspiration for one’s own research, as well as some practice in writing. But few scientists are trained in how to write a review — or in what constitutes an excellent one. Even picking the appropriate software to use can be an involved decision (see ‘Tools and techniques’). So Nature asked editors and working scientists with well-cited reviews for their tips.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

doi: https://doi.org/10.1038/d41586-020-03422-x

Interviews have been edited for length and clarity.

Updates & Corrections

Correction 09 December 2020 : An earlier version of the tables in this article included some incorrect details about the programs Zotero, Endnote and Manubot. These have now been corrected.

Hsing, I.-M., Xu, Y. & Zhao, W. Electroanalysis 19 , 755–768 (2007).

Article   Google Scholar  

Ledesma, H. A. et al. Nature Nanotechnol. 14 , 645–657 (2019).

Article   PubMed   Google Scholar  

Brahlek, M., Koirala, N., Bansal, N. & Oh, S. Solid State Commun. 215–216 , 54–62 (2015).

Choi, Y. & Lee, S. Y. Nature Rev. Chem . https://doi.org/10.1038/s41570-020-00221-w (2020).

Download references

Related Articles

what is reviewing the literature in a research paper

  • Research management

How to boost your research: take a sabbatical in policy

How to boost your research: take a sabbatical in policy

World View 21 FEB 24

Structural biology for researchers with low vision

Structural biology for researchers with low vision

Career Column 19 FEB 24

Just 5 women have won a top maths prize in the past 90 years

Just 5 women have won a top maths prize in the past 90 years

News 16 FEB 24

China conducts first nationwide review of retractions and research misconduct

China conducts first nationwide review of retractions and research misconduct

News 12 FEB 24

Could roving researchers help address the challenge of taking parental leave?

Could roving researchers help address the challenge of taking parental leave?

Career Feature 07 FEB 24

Best practice for LGBTQ+ data collection by STEM organizations

Correspondence 06 FEB 24

Open-access publishing: citation advantage is unproven

Correspondence 13 FEB 24

How journals are fighting back against a wave of questionable images

How journals are fighting back against a wave of questionable images

News Explainer 12 FEB 24

Recruitment of Global Talent at the Institute of Zoology, Chinese Academy of Sciences (IOZ, CAS)

The Institute of Zoology (IOZ), Chinese Academy of Sciences (CAS), is seeking global talents around the world.

Beijing, China

Institute of Zoology, Chinese Academy of Sciences (IOZ, CAS)

what is reviewing the literature in a research paper

Position Opening for Principal Investigator GIBH

Guangzhou, Guangdong, China

Guangzhou Institutes of Biomedicine and Health(GIBH), Chinese Academy of Sciences

what is reviewing the literature in a research paper

Faculty Positions in Multiscale Research Institute for Complex Systems, Fudan University

The Multiscale Research Institute for Complex Systems (MRICS) at Fudan University is located at the Zhangjiang Campus of Fudan University.

Shanghai, China

Fudan University

what is reviewing the literature in a research paper

Postdoctoral Associate- Single- Cell and Data Science

Houston, Texas (US)

Baylor College of Medicine (BCM)

what is reviewing the literature in a research paper

Postdoctoral Associate

what is reviewing the literature in a research paper

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

Duke University Libraries

Literature Reviews

  • Getting started

What is a literature review?

Why conduct a literature review, stages of a literature review, lit reviews: an overview (video), check out these books.

  • Types of reviews
  • 1. Define your research question
  • 2. Plan your search
  • 3. Search the literature
  • 4. Organize your results
  • 5. Synthesize your findings
  • 6. Write the review
  • Thompson Writing Studio This link opens in a new window
  • Need to write a systematic review? This link opens in a new window

what is reviewing the literature in a research paper

Contact a Librarian

Ask a Librarian

what is reviewing the literature in a research paper

Definition: A literature review is a systematic examination and synthesis of existing scholarly research on a specific topic or subject.

Purpose: It serves to provide a comprehensive overview of the current state of knowledge within a particular field.

Analysis: Involves critically evaluating and summarizing key findings, methodologies, and debates found in academic literature.

Identifying Gaps: Aims to pinpoint areas where there is a lack of research or unresolved questions, highlighting opportunities for further investigation.

Contextualization: Enables researchers to understand how their work fits into the broader academic conversation and contributes to the existing body of knowledge.

what is reviewing the literature in a research paper

tl;dr  A literature review critically examines and synthesizes existing scholarly research and publications on a specific topic to provide a comprehensive understanding of the current state of knowledge in the field.

What is a literature review NOT?

❌ An annotated bibliography

❌ Original research

❌ A summary

❌ Something to be conducted at the end of your research

❌ An opinion piece

❌ A chronological compilation of studies

The reason for conducting a literature review is to:

what is reviewing the literature in a research paper

Literature Reviews: An Overview for Graduate Students

While this 9-minute video from NCSU is geared toward graduate students, it is useful for anyone conducting a literature review.

what is reviewing the literature in a research paper

Writing the literature review: A practical guide

Available 3rd floor of Perkins

what is reviewing the literature in a research paper

Writing literature reviews: A guide for students of the social and behavioral sciences

Available online!

what is reviewing the literature in a research paper

So, you have to write a literature review: A guided workbook for engineers

what is reviewing the literature in a research paper

Telling a research story: Writing a literature review

what is reviewing the literature in a research paper

The literature review: Six steps to success

what is reviewing the literature in a research paper

Systematic approaches to a successful literature review

Request from Duke Medical Center Library

what is reviewing the literature in a research paper

Doing a systematic review: A student's guide

  • Next: Types of reviews >>
  • Last Updated: Feb 15, 2024 1:45 PM
  • URL: https://guides.library.duke.edu/lit-reviews

Duke University Libraries

Services for...

  • Faculty & Instructors
  • Graduate Students
  • Undergraduate Students
  • International Students
  • Patrons with Disabilities

Twitter

  • Harmful Language Statement
  • Re-use & Attribution / Privacy
  • Support the Libraries

Creative Commons License

The Writing Center • University of North Carolina at Chapel Hill

Literature Reviews

What this handout is about.

This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.

Introduction

OK. You’ve got to write a literature review. You dust off a novel and a book of poetry, settle down in your chair, and get ready to issue a “thumbs up” or “thumbs down” as you leaf through the pages. “Literature review” done. Right?

Wrong! The “literature” of a literature review refers to any collection of materials on a topic, not necessarily the great literary texts of the world. “Literature” could be anything from a set of government pamphlets on British colonial methods in Africa to scholarly articles on the treatment of a torn ACL. And a review does not necessarily mean that your reader wants you to give your personal opinion on whether or not you liked these sources.

What is a literature review, then?

A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.

A literature review can be just a simple summary of the sources, but it usually has an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. And depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.

But how is a literature review different from an academic research paper?

The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts. In a research paper, you use the literature as a foundation and as support for a new insight that you contribute. The focus of a literature review, however, is to summarize and synthesize the arguments and ideas of others without adding new contributions.

Why do we write literature reviews?

Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field. For scholars, the depth and breadth of the literature review emphasizes the credibility of the writer in his or her field. Literature reviews also provide a solid background for a research paper’s investigation. Comprehensive knowledge of the literature of the field is essential to most research papers.

Who writes these things, anyway?

Literature reviews are written occasionally in the humanities, but mostly in the sciences and social sciences; in experiment and lab reports, they constitute a section of the paper. Sometimes a literature review is written as a paper in itself.

Let’s get to it! What should I do before writing the literature review?

If your assignment is not very specific, seek clarification from your instructor:

  • Roughly how many sources should you include?
  • What types of sources (books, journal articles, websites)?
  • Should you summarize, synthesize, or critique your sources by discussing a common theme or issue?
  • Should you evaluate your sources?
  • Should you provide subheadings and other background information, such as definitions and/or a history?

Find models

Look for other literature reviews in your area of interest or in the discipline and read them to get a sense of the types of themes you might want to look for in your own research or ways to organize your final review. You can simply put the word “review” in your search engine along with your other topic terms to find articles of this type on the Internet or in an electronic database. The bibliography or reference section of sources you’ve already read are also excellent entry points into your own research.

Narrow your topic

There are hundreds or even thousands of articles and books on most areas of study. The narrower your topic, the easier it will be to limit the number of sources you need to read in order to get a good survey of the material. Your instructor will probably not expect you to read everything that’s out there on the topic, but you’ll make your job easier if you first limit your scope.

Keep in mind that UNC Libraries have research guides and to databases relevant to many fields of study. You can reach out to the subject librarian for a consultation: https://library.unc.edu/support/consultations/ .

And don’t forget to tap into your professor’s (or other professors’) knowledge in the field. Ask your professor questions such as: “If you had to read only one book from the 90’s on topic X, what would it be?” Questions such as this help you to find and determine quickly the most seminal pieces in the field.

Consider whether your sources are current

Some disciplines require that you use information that is as current as possible. In the sciences, for instance, treatments for medical problems are constantly changing according to the latest studies. Information even two years old could be obsolete. However, if you are writing a review in the humanities, history, or social sciences, a survey of the history of the literature may be what is needed, because what is important is how perspectives have changed through the years or within a certain time period. Try sorting through some other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to consider what is currently of interest to scholars in this field and what is not.

Strategies for writing the literature review

Find a focus.

A literature review, like a term paper, is usually organized around ideas, not the sources themselves as an annotated bibliography would be organized. This means that you will not just simply list your sources and go into detail about each one of them, one at a time. No. As you read widely but selectively in your topic area, consider instead what themes or issues connect your sources together. Do they present one or different solutions? Is there an aspect of the field that is missing? How well do they present the material and do they portray it according to an appropriate theory? Do they reveal a trend in the field? A raging debate? Pick one of these themes to focus the organization of your review.

Convey it to your reader

A literature review may not have a traditional thesis statement (one that makes an argument), but you do need to tell readers what to expect. Try writing a simple statement that lets the reader know what is your main organizing principle. Here are a couple of examples:

The current trend in treatment for congestive heart failure combines surgery and medicine. More and more cultural studies scholars are accepting popular media as a subject worthy of academic consideration.

Consider organization

You’ve got a focus, and you’ve stated it clearly and directly. Now what is the most effective way of presenting the information? What are the most important topics, subtopics, etc., that your review needs to include? And in what order should you present them? Develop an organization for your review at both a global and local level:

First, cover the basic categories

Just like most academic papers, literature reviews also must contain at least three basic elements: an introduction or background information section; the body of the review containing the discussion of sources; and, finally, a conclusion and/or recommendations section to end the paper. The following provides a brief description of the content of each:

  • Introduction: Gives a quick idea of the topic of the literature review, such as the central theme or organizational pattern.
  • Body: Contains your discussion of sources and is organized either chronologically, thematically, or methodologically (see below for more information on each).
  • Conclusions/Recommendations: Discuss what you have drawn from reviewing literature so far. Where might the discussion proceed?

Organizing the body

Once you have the basic categories in place, then you must consider how you will present the sources themselves within the body of your paper. Create an organizational method to focus this section even further.

To help you come up with an overall organizational framework for your review, consider the following scenario:

You’ve decided to focus your literature review on materials dealing with sperm whales. This is because you’ve just finished reading Moby Dick, and you wonder if that whale’s portrayal is really real. You start with some articles about the physiology of sperm whales in biology journals written in the 1980’s. But these articles refer to some British biological studies performed on whales in the early 18th century. So you check those out. Then you look up a book written in 1968 with information on how sperm whales have been portrayed in other forms of art, such as in Alaskan poetry, in French painting, or on whale bone, as the whale hunters in the late 19th century used to do. This makes you wonder about American whaling methods during the time portrayed in Moby Dick, so you find some academic articles published in the last five years on how accurately Herman Melville portrayed the whaling scene in his novel.

Now consider some typical ways of organizing the sources into a review:

  • Chronological: If your review follows the chronological method, you could write about the materials above according to when they were published. For instance, first you would talk about the British biological studies of the 18th century, then about Moby Dick, published in 1851, then the book on sperm whales in other art (1968), and finally the biology articles (1980s) and the recent articles on American whaling of the 19th century. But there is relatively no continuity among subjects here. And notice that even though the sources on sperm whales in other art and on American whaling are written recently, they are about other subjects/objects that were created much earlier. Thus, the review loses its chronological focus.
  • By publication: Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on biological studies of sperm whales if the progression revealed a change in dissection practices of the researchers who wrote and/or conducted the studies.
  • By trend: A better way to organize the above sources chronologically is to examine the sources under another trend, such as the history of whaling. Then your review would have subsections according to eras within this period. For instance, the review might examine whaling from pre-1600-1699, 1700-1799, and 1800-1899. Under this method, you would combine the recent studies on American whaling in the 19th century with Moby Dick itself in the 1800-1899 category, even though the authors wrote a century apart.
  • Thematic: Thematic reviews of literature are organized around a topic or issue, rather than the progression of time. However, progression of time may still be an important factor in a thematic review. For instance, the sperm whale review could focus on the development of the harpoon for whale hunting. While the study focuses on one topic, harpoon technology, it will still be organized chronologically. The only difference here between a “chronological” and a “thematic” approach is what is emphasized the most: the development of the harpoon or the harpoon technology.But more authentic thematic reviews tend to break away from chronological order. For instance, a thematic review of material on sperm whales might examine how they are portrayed as “evil” in cultural documents. The subsections might include how they are personified, how their proportions are exaggerated, and their behaviors misunderstood. A review organized in this manner would shift between time periods within each section according to the point made.
  • Methodological: A methodological approach differs from the two above in that the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the “methods” of the researcher or writer. For the sperm whale project, one methodological approach would be to look at cultural differences between the portrayal of whales in American, British, and French art work. Or the review might focus on the economic impact of whaling on a community. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed. Once you’ve decided on the organizational method for the body of the review, the sections you need to include in the paper should be easy to figure out. They should arise out of your organizational strategy. In other words, a chronological review would have subsections for each vital time period. A thematic review would have subtopics based upon factors that relate to the theme or issue.

Sometimes, though, you might need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. Put in only what is necessary. Here are a few other sections you might want to consider:

  • Current Situation: Information necessary to understand the topic or focus of the literature review.
  • History: The chronological progression of the field, the literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Methods and/or Standards: The criteria you used to select the sources in your literature review or the way in which you present your information. For instance, you might explain that your review includes only peer-reviewed articles and journals.

Questions for Further Research: What questions about the field has the review sparked? How will you further your research as a result of the review?

Begin composing

Once you’ve settled on a general pattern of organization, you’re ready to write each section. There are a few guidelines you should follow during the writing stage as well. Here is a sample paragraph from a literature review about sexism and language to illuminate the following discussion:

However, other studies have shown that even gender-neutral antecedents are more likely to produce masculine images than feminine ones (Gastil, 1990). Hamilton (1988) asked students to complete sentences that required them to fill in pronouns that agreed with gender-neutral antecedents such as “writer,” “pedestrian,” and “persons.” The students were asked to describe any image they had when writing the sentence. Hamilton found that people imagined 3.3 men to each woman in the masculine “generic” condition and 1.5 men per woman in the unbiased condition. Thus, while ambient sexism accounted for some of the masculine bias, sexist language amplified the effect. (Source: Erika Falk and Jordan Mills, “Why Sexist Language Affects Persuasion: The Role of Homophily, Intended Audience, and Offense,” Women and Language19:2).

Use evidence

In the example above, the writers refer to several other sources when making their point. A literature review in this sense is just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence to show that what you are saying is valid.

Be selective

Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the review’s focus, whether it is thematic, methodological, or chronological.

Use quotes sparingly

Falk and Mills do not use any direct quotes. That is because the survey nature of the literature review does not allow for in-depth discussion or detailed quotes from the text. Some short quotes here and there are okay, though, if you want to emphasize a point, or if what the author said just cannot be rewritten in your own words. Notice that Falk and Mills do quote certain terms that were coined by the author, not common knowledge, or taken directly from the study. But if you find yourself wanting to put in more quotes, check with your instructor.

Summarize and synthesize

Remember to summarize and synthesize your sources within each paragraph as well as throughout the review. The authors here recapitulate important features of Hamilton’s study, but then synthesize it by rephrasing the study’s significance and relating it to their own work.

Keep your own voice

While the literature review presents others’ ideas, your voice (the writer’s) should remain front and center. Notice that Falk and Mills weave references to other sources into their own text, but they still maintain their own voice by starting and ending the paragraph with their own ideas and their own words. The sources support what Falk and Mills are saying.

Use caution when paraphrasing

When paraphrasing a source that is not your own, be sure to represent the author’s information or opinions accurately and in your own words. In the preceding example, Falk and Mills either directly refer in the text to the author of their source, such as Hamilton, or they provide ample notation in the text when the ideas they are mentioning are not their own, for example, Gastil’s. For more information, please see our handout on plagiarism .

Revise, revise, revise

Draft in hand? Now you’re ready to revise. Spending a lot of time revising is a wise idea, because your main objective is to present the material, not the argument. So check over your review again to make sure it follows the assignment and/or your outline. Then, just as you would for most other academic forms of writing, rewrite or rework the language of your review so that you’ve presented your information in the most concise manner possible. Be sure to use terminology familiar to your audience; get rid of unnecessary jargon or slang. Finally, double check that you’ve documented your sources and formatted the review appropriately for your discipline. For tips on the revising and editing process, see our handout on revising drafts .

Works consulted

We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.

Anson, Chris M., and Robert A. Schwegler. 2010. The Longman Handbook for Writers and Readers , 6th ed. New York: Longman.

Jones, Robert, Patrick Bizzaro, and Cynthia Selfe. 1997. The Harcourt Brace Guide to Writing in the Disciplines . New York: Harcourt Brace.

Lamb, Sandra E. 1998. How to Write It: A Complete Guide to Everything You’ll Ever Write . Berkeley: Ten Speed Press.

Rosen, Leonard J., and Laurence Behrens. 2003. The Allyn & Bacon Handbook , 5th ed. New York: Longman.

Troyka, Lynn Quittman, and Doug Hesse. 2016. Simon and Schuster Handbook for Writers , 11th ed. London: Pearson.

You may reproduce it for non-commercial use if you use the entire handout and attribute the source: The Writing Center, University of North Carolina at Chapel Hill

Make a Gift

  • UConn Library
  • Literature Review: The What, Why and How-to Guide
  • Introduction

Literature Review: The What, Why and How-to Guide — Introduction

  • Getting Started
  • How to Pick a Topic
  • Strategies to Find Sources
  • Evaluating Sources & Lit. Reviews
  • Tips for Writing Literature Reviews
  • Writing Literature Review: Useful Sites
  • Citation Resources
  • Other Academic Writings

What are Literature Reviews?

So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D.  The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.

Goals of Literature Reviews

What are the goals of creating a Literature Review?  A literature could be written to accomplish different aims:

  • To develop a theory or evaluate an existing theory
  • To summarize the historical or existing state of a research topic
  • Identify a problem in a field of research 

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews .  Review of General Psychology , 1 (3), 311-320.

What kinds of sources require a Literature Review?

  • A research paper assigned in a course
  • A thesis or dissertation
  • A grant proposal
  • An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

Types of Literature Reviews

What kinds of literature reviews are written?

Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

  • Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework:  10.1177/08948453211037398  

Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.

  • Example : The effect of leave policies on increasing fertility: a systematic review:  10.1057/s41599-022-01270-w

Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.

  • Example : Employment Instability and Fertility in Europe: A Meta-Analysis:  10.1215/00703370-9164737

Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts .  Journal of Advanced Nursing , 53 (3), 311-318.

  • Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis:  10.1177/05390184221113735

Literature Reviews in the Health Sciences

  • UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
  • << Previous: Getting Started
  • Next: How to Pick a Topic >>
  • Last Updated: Sep 21, 2022 2:16 PM
  • URL: https://guides.lib.uconn.edu/literaturereview

Creative Commons

  • USC Libraries
  • Research Guides

Organizing Your Social Sciences Research Paper

  • 5. The Literature Review
  • Purpose of Guide
  • Design Flaws to Avoid
  • Independent and Dependent Variables
  • Glossary of Research Terms
  • Reading Research Effectively
  • Narrowing a Topic Idea
  • Broadening a Topic Idea
  • Extending the Timeliness of a Topic Idea
  • Academic Writing Style
  • Choosing a Title
  • Making an Outline
  • Paragraph Development
  • Research Process Video Series
  • Executive Summary
  • The C.A.R.S. Model
  • Background Information
  • The Research Problem/Question
  • Theoretical Framework
  • Citation Tracking
  • Content Alert Services
  • Evaluating Sources
  • Primary Sources
  • Secondary Sources
  • Tiertiary Sources
  • Scholarly vs. Popular Publications
  • Qualitative Methods
  • Quantitative Methods
  • Insiderness
  • Using Non-Textual Elements
  • Limitations of the Study
  • Common Grammar Mistakes
  • Writing Concisely
  • Avoiding Plagiarism
  • Footnotes or Endnotes?
  • Further Readings
  • Generative AI and Writing
  • USC Libraries Tutorials and Other Guides
  • Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

  • Give a new interpretation of old material or combine new with old interpretations,
  • Trace the intellectual progression of the field, including major debates,
  • Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
  • Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

  • Place each work in the context of its contribution to understanding the research problem being studied.
  • Describe the relationship of each work to the others under consideration.
  • Identify new ways to interpret prior research.
  • Reveal any gaps that exist in the literature.
  • Resolve conflicts amongst seemingly contradictory previous studies.
  • Identify areas of prior scholarship to prevent duplication of effort.
  • Point the way in fulfilling a need for additional research.
  • Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE : Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

  • An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
  • Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
  • An explanation of how each work is similar to and how it varies from the others,
  • Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

  • Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
  • Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
  • Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
  • Persuasiveness -- which of the author's theses are most convincing or least convincing?
  • Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

  • Current Situation : Information necessary to understand the current topic or focus of the literature review.
  • Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
  • History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
  • Standards : Description of the way in which you present your information.
  • Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

  • Sources in your literature review do not clearly relate to the research problem;
  • You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
  • Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
  • Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
  • Does not describe the search procedures that were used in identifying the literature to review;
  • Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
  • Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

  • How are they organizing their ideas?
  • What methods have they used to study the problem?
  • What theories have been used to explain, predict, or understand their research problem?
  • What sources have they cited to support their conclusions?
  • How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

  • Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
  • Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
  • Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

  • << Previous: Theoretical Framework
  • Next: Citation Tracking >>
  • Last Updated: Feb 8, 2024 1:57 PM
  • URL: https://libguides.usc.edu/writingguide

Libraries Home

Writing Literature Reviews: What is a "Literature Review"?

  • What is a "Literature Review"?
  • 1. Brainstorm
  • 3. Refine Search and Topic
  • 4. Structure Your Lit Review
  • Helpful Sites

Literature reviews:

  • provide a summary of the published academic work on a topic
  • help "make the case" for why someone is writing their paper or conducting their research
  • can be the "background" section of a larger paper or it can be the focus of an entire paper

Goals of a Literature Review

  • including the major theories, issues, works, and debates in the field
  • synthesize all this information into an organized summary
  • critique current knowledge of a topic
  • identify aspects of the topic that need further investigation

Plagiarism and Citation

Citation is when you give credit to someone else's ideas, words, creative works, or contributions in your own paper.

Reasons to cite:

  • Give credit the author(s) of the works that you used to write your paper.
  • Avoid plagiarism (which means you are claiming someone else's work as your own. This will get you in big trouble. See the Purdue Online Writing Lab for more information.)
  • Show that you know your topic well and have read and thought about what others have already said.
  • Show your readers where to find the original sources of the information you present so they can read them fully.

When to cite? What to cite?

  • Cite other people's words, ideas and other intellectual property that you use in your papers or that influence your ideas, including things such as books, articles, reports, data/statistics, speeches, academic articles, works of art, songs.
  • Cite direct quotes, facts or statistics AND when you summarize or paraphrase others' ideas.

Helpful Sites on Literature Reviews

Much of the information in this guide and more information can be found on the websites listed on the  Helpful Sites tab .

Ask A Librarian

Make an appointment

Chat with a Librarian

Email [email protected]

Profile Photo

  • Next: 1. Brainstorm >>
  • University of Colorado Boulder Libraries
  • Research Guides
  • Writing Literature Reviews
  • Last Updated: Dec 31, 2023 1:22 PM
  • URL: https://libguides.colorado.edu/litreview

Learn how to write a review of literature

What is a review of literature.

The format of a review of literature may vary from discipline to discipline and from assignment to assignment.

A review may be a self-contained unit — an end in itself — or a preface to and rationale for engaging in primary research. A review is a required part of grant and research proposals and often a chapter in theses and dissertations.

Generally, the purpose of a review is to analyze critically a segment of a published body of knowledge through summary, classification, and comparison of prior research studies, reviews of literature, and theoretical articles.

Writing the introduction

In the introduction, you should:

Define or identify the general topic, issue, or area of concern, thus providing an appropriate context for reviewing the literature.

Point out overall trends in what has been published about the topic; or conflicts in theory, methodology, evidence, and conclusions; or gaps in research and scholarship; or a single problem or new perspective of immediate interest.

Establish the writer’s reason (point of view) for reviewing the literature; explain the criteria to be used in analyzing and comparing literature and the organization of the review (sequence); and, when necessary, state why certain literature is or is not included (scope).

Writing the body

In the body, you should:

Group research studies and other types of literature (reviews, theoretical articles, case studies, etc.) according to common denominators such as qualitative versus quantitative approaches, conclusions of authors, specific purpose or objective, chronology, etc.

Summarize individual studies or articles with as much or as little detail as each merits according to its comparative importance in the literature, remembering that space (length) denotes significance.

Provide the reader with strong “umbrella” sentences at beginnings of paragraphs, “signposts” throughout, and brief “so what” summary sentences at intermediate points in the review to aid in understanding comparisons and analyses.

Writing the conclusion

In the conclusion, you should:

Summarize major contributions of significant studies and articles to the body of knowledge under review, maintaining the focus established in the introduction.

Evaluate the current “state of the art” for the body of knowledge reviewed, pointing out major methodological flaws or gaps in research, inconsistencies in theory and findings, and areas or issues pertinent to future study.

Conclude by providing some insight into the relationship between the central topic of the literature review and a larger area of study such as a discipline, a scientific endeavor, or a profession.

For further information see our handouts on Writing a Critical Review of a Nonfiction Book or Article or Reading a Book to Review It .

To learn more about literature reviews, take a look at our workshop on Writing Literature Reviews of Published Research.

Sample Literature Reviews

An important strategy for learning how to compose literature reviews in your field or within a specific genre is to locate and analyze representative examples. The following collection of annotated sample literature reviews written and co-written by colleagues associated with UW-Madison showcases how these reviews can do different kind of work for different purposes. Use these successful examples as a starting point for understanding how other writers have approached the challenging and important task of situating their idea in the context of established research.

  • Sample 1 (PDF) A brief literature review within a political scientists’  National Science Foundation Graduate Research Fellowship  grant
  • Sample 2 (PDF) A several-page literature review at the beginning of a published, academic article about philosophy
  • Sample 3 (PDF) A brief literature review at the beginning of a published, academic article about photochemistry

what is reviewing the literature in a research paper

Academic and Professional Writing

This is an accordion element with a series of buttons that open and close related content panels.

Analysis Papers

Reading Poetry

A Short Guide to Close Reading for Literary Analysis

Using Literary Quotations

Play Reviews

Writing a Rhetorical Précis to Analyze Nonfiction Texts

Incorporating Interview Data

Grant Proposals

Planning and Writing a Grant Proposal: The Basics

Additional Resources for Grants and Proposal Writing

Job Materials and Application Essays

Writing Personal Statements for Ph.D. Programs

  • Before you begin: useful tips for writing your essay
  • Guided brainstorming exercises
  • Get more help with your essay
  • Frequently Asked Questions

Resume Writing Tips

CV Writing Tips

Cover Letters

Business Letters

Proposals and Dissertations

Resources for Proposal Writers

Resources for Dissertators

Research Papers

Planning and Writing Research Papers

Quoting and Paraphrasing

Writing Annotated Bibliographies

Creating Poster Presentations

Writing an Abstract for Your Research Paper

Thank-You Notes

Advice for Students Writing Thank-You Notes to Donors

Reading for a Review

Critical Reviews

Writing a Review of Literature

Scientific Reports

Scientific Report Format

Sample Lab Assignment

Writing for the Web

Writing an Effective Blog Post

Writing for Social Media: A Guide for Academics

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • Advanced Search
  • Journal List
  • PLoS Comput Biol
  • v.9(7); 2013 Jul

Logo of ploscomp

Ten Simple Rules for Writing a Literature Review

Marco pautasso.

1 Centre for Functional and Evolutionary Ecology (CEFE), CNRS, Montpellier, France

2 Centre for Biodiversity Synthesis and Analysis (CESAB), FRB, Aix-en-Provence, France

Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications [1] . For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively [2] . Given such mountains of papers, scientists cannot be expected to examine in detail every single new paper relevant to their interests [3] . Thus, it is both advantageous and necessary to rely on regular summaries of the recent literature. Although recognition for scientists mainly comes from primary research, timely literature reviews can lead to new synthetic insights and are often widely read [4] . For such summaries to be useful, however, they need to be compiled in a professional way [5] .

When starting from scratch, reviewing the literature can require a titanic amount of work. That is why researchers who have spent their career working on a certain research issue are in a perfect position to review that literature. Some graduate schools are now offering courses in reviewing the literature, given that most research students start their project by producing an overview of what has already been done on their research issue [6] . However, it is likely that most scientists have not thought in detail about how to approach and carry out a literature review.

Reviewing the literature requires the ability to juggle multiple tasks, from finding and evaluating relevant material to synthesising information from various sources, from critical thinking to paraphrasing, evaluating, and citation skills [7] . In this contribution, I share ten simple rules I learned working on about 25 literature reviews as a PhD and postdoctoral student. Ideas and insights also come from discussions with coauthors and colleagues, as well as feedback from reviewers and editors.

Rule 1: Define a Topic and Audience

How to choose which topic to review? There are so many issues in contemporary science that you could spend a lifetime of attending conferences and reading the literature just pondering what to review. On the one hand, if you take several years to choose, several other people may have had the same idea in the meantime. On the other hand, only a well-considered topic is likely to lead to a brilliant literature review [8] . The topic must at least be:

  • interesting to you (ideally, you should have come across a series of recent papers related to your line of work that call for a critical summary),
  • an important aspect of the field (so that many readers will be interested in the review and there will be enough material to write it), and
  • a well-defined issue (otherwise you could potentially include thousands of publications, which would make the review unhelpful).

Ideas for potential reviews may come from papers providing lists of key research questions to be answered [9] , but also from serendipitous moments during desultory reading and discussions. In addition to choosing your topic, you should also select a target audience. In many cases, the topic (e.g., web services in computational biology) will automatically define an audience (e.g., computational biologists), but that same topic may also be of interest to neighbouring fields (e.g., computer science, biology, etc.).

Rule 2: Search and Re-search the Literature

After having chosen your topic and audience, start by checking the literature and downloading relevant papers. Five pieces of advice here:

  • keep track of the search items you use (so that your search can be replicated [10] ),
  • keep a list of papers whose pdfs you cannot access immediately (so as to retrieve them later with alternative strategies),
  • use a paper management system (e.g., Mendeley, Papers, Qiqqa, Sente),
  • define early in the process some criteria for exclusion of irrelevant papers (these criteria can then be described in the review to help define its scope), and
  • do not just look for research papers in the area you wish to review, but also seek previous reviews.

The chances are high that someone will already have published a literature review ( Figure 1 ), if not exactly on the issue you are planning to tackle, at least on a related topic. If there are already a few or several reviews of the literature on your issue, my advice is not to give up, but to carry on with your own literature review,

An external file that holds a picture, illustration, etc.
Object name is pcbi.1003149.g001.jpg

The bottom-right situation (many literature reviews but few research papers) is not just a theoretical situation; it applies, for example, to the study of the impacts of climate change on plant diseases, where there appear to be more literature reviews than research studies [33] .

  • discussing in your review the approaches, limitations, and conclusions of past reviews,
  • trying to find a new angle that has not been covered adequately in the previous reviews, and
  • incorporating new material that has inevitably accumulated since their appearance.

When searching the literature for pertinent papers and reviews, the usual rules apply:

  • be thorough,
  • use different keywords and database sources (e.g., DBLP, Google Scholar, ISI Proceedings, JSTOR Search, Medline, Scopus, Web of Science), and
  • look at who has cited past relevant papers and book chapters.

Rule 3: Take Notes While Reading

If you read the papers first, and only afterwards start writing the review, you will need a very good memory to remember who wrote what, and what your impressions and associations were while reading each single paper. My advice is, while reading, to start writing down interesting pieces of information, insights about how to organize the review, and thoughts on what to write. This way, by the time you have read the literature you selected, you will already have a rough draft of the review.

Of course, this draft will still need much rewriting, restructuring, and rethinking to obtain a text with a coherent argument [11] , but you will have avoided the danger posed by staring at a blank document. Be careful when taking notes to use quotation marks if you are provisionally copying verbatim from the literature. It is advisable then to reformulate such quotes with your own words in the final draft. It is important to be careful in noting the references already at this stage, so as to avoid misattributions. Using referencing software from the very beginning of your endeavour will save you time.

Rule 4: Choose the Type of Review You Wish to Write

After having taken notes while reading the literature, you will have a rough idea of the amount of material available for the review. This is probably a good time to decide whether to go for a mini- or a full review. Some journals are now favouring the publication of rather short reviews focusing on the last few years, with a limit on the number of words and citations. A mini-review is not necessarily a minor review: it may well attract more attention from busy readers, although it will inevitably simplify some issues and leave out some relevant material due to space limitations. A full review will have the advantage of more freedom to cover in detail the complexities of a particular scientific development, but may then be left in the pile of the very important papers “to be read” by readers with little time to spare for major monographs.

There is probably a continuum between mini- and full reviews. The same point applies to the dichotomy of descriptive vs. integrative reviews. While descriptive reviews focus on the methodology, findings, and interpretation of each reviewed study, integrative reviews attempt to find common ideas and concepts from the reviewed material [12] . A similar distinction exists between narrative and systematic reviews: while narrative reviews are qualitative, systematic reviews attempt to test a hypothesis based on the published evidence, which is gathered using a predefined protocol to reduce bias [13] , [14] . When systematic reviews analyse quantitative results in a quantitative way, they become meta-analyses. The choice between different review types will have to be made on a case-by-case basis, depending not just on the nature of the material found and the preferences of the target journal(s), but also on the time available to write the review and the number of coauthors [15] .

Rule 5: Keep the Review Focused, but Make It of Broad Interest

Whether your plan is to write a mini- or a full review, it is good advice to keep it focused 16 , 17 . Including material just for the sake of it can easily lead to reviews that are trying to do too many things at once. The need to keep a review focused can be problematic for interdisciplinary reviews, where the aim is to bridge the gap between fields [18] . If you are writing a review on, for example, how epidemiological approaches are used in modelling the spread of ideas, you may be inclined to include material from both parent fields, epidemiology and the study of cultural diffusion. This may be necessary to some extent, but in this case a focused review would only deal in detail with those studies at the interface between epidemiology and the spread of ideas.

While focus is an important feature of a successful review, this requirement has to be balanced with the need to make the review relevant to a broad audience. This square may be circled by discussing the wider implications of the reviewed topic for other disciplines.

Rule 6: Be Critical and Consistent

Reviewing the literature is not stamp collecting. A good review does not just summarize the literature, but discusses it critically, identifies methodological problems, and points out research gaps [19] . After having read a review of the literature, a reader should have a rough idea of:

  • the major achievements in the reviewed field,
  • the main areas of debate, and
  • the outstanding research questions.

It is challenging to achieve a successful review on all these fronts. A solution can be to involve a set of complementary coauthors: some people are excellent at mapping what has been achieved, some others are very good at identifying dark clouds on the horizon, and some have instead a knack at predicting where solutions are going to come from. If your journal club has exactly this sort of team, then you should definitely write a review of the literature! In addition to critical thinking, a literature review needs consistency, for example in the choice of passive vs. active voice and present vs. past tense.

Rule 7: Find a Logical Structure

Like a well-baked cake, a good review has a number of telling features: it is worth the reader's time, timely, systematic, well written, focused, and critical. It also needs a good structure. With reviews, the usual subdivision of research papers into introduction, methods, results, and discussion does not work or is rarely used. However, a general introduction of the context and, toward the end, a recapitulation of the main points covered and take-home messages make sense also in the case of reviews. For systematic reviews, there is a trend towards including information about how the literature was searched (database, keywords, time limits) [20] .

How can you organize the flow of the main body of the review so that the reader will be drawn into and guided through it? It is generally helpful to draw a conceptual scheme of the review, e.g., with mind-mapping techniques. Such diagrams can help recognize a logical way to order and link the various sections of a review [21] . This is the case not just at the writing stage, but also for readers if the diagram is included in the review as a figure. A careful selection of diagrams and figures relevant to the reviewed topic can be very helpful to structure the text too [22] .

Rule 8: Make Use of Feedback

Reviews of the literature are normally peer-reviewed in the same way as research papers, and rightly so [23] . As a rule, incorporating feedback from reviewers greatly helps improve a review draft. Having read the review with a fresh mind, reviewers may spot inaccuracies, inconsistencies, and ambiguities that had not been noticed by the writers due to rereading the typescript too many times. It is however advisable to reread the draft one more time before submission, as a last-minute correction of typos, leaps, and muddled sentences may enable the reviewers to focus on providing advice on the content rather than the form.

Feedback is vital to writing a good review, and should be sought from a variety of colleagues, so as to obtain a diversity of views on the draft. This may lead in some cases to conflicting views on the merits of the paper, and on how to improve it, but such a situation is better than the absence of feedback. A diversity of feedback perspectives on a literature review can help identify where the consensus view stands in the landscape of the current scientific understanding of an issue [24] .

Rule 9: Include Your Own Relevant Research, but Be Objective

In many cases, reviewers of the literature will have published studies relevant to the review they are writing. This could create a conflict of interest: how can reviewers report objectively on their own work [25] ? Some scientists may be overly enthusiastic about what they have published, and thus risk giving too much importance to their own findings in the review. However, bias could also occur in the other direction: some scientists may be unduly dismissive of their own achievements, so that they will tend to downplay their contribution (if any) to a field when reviewing it.

In general, a review of the literature should neither be a public relations brochure nor an exercise in competitive self-denial. If a reviewer is up to the job of producing a well-organized and methodical review, which flows well and provides a service to the readership, then it should be possible to be objective in reviewing one's own relevant findings. In reviews written by multiple authors, this may be achieved by assigning the review of the results of a coauthor to different coauthors.

Rule 10: Be Up-to-Date, but Do Not Forget Older Studies

Given the progressive acceleration in the publication of scientific papers, today's reviews of the literature need awareness not just of the overall direction and achievements of a field of inquiry, but also of the latest studies, so as not to become out-of-date before they have been published. Ideally, a literature review should not identify as a major research gap an issue that has just been addressed in a series of papers in press (the same applies, of course, to older, overlooked studies (“sleeping beauties” [26] )). This implies that literature reviewers would do well to keep an eye on electronic lists of papers in press, given that it can take months before these appear in scientific databases. Some reviews declare that they have scanned the literature up to a certain point in time, but given that peer review can be a rather lengthy process, a full search for newly appeared literature at the revision stage may be worthwhile. Assessing the contribution of papers that have just appeared is particularly challenging, because there is little perspective with which to gauge their significance and impact on further research and society.

Inevitably, new papers on the reviewed topic (including independently written literature reviews) will appear from all quarters after the review has been published, so that there may soon be the need for an updated review. But this is the nature of science [27] – [32] . I wish everybody good luck with writing a review of the literature.

Acknowledgments

Many thanks to M. Barbosa, K. Dehnen-Schmutz, T. Döring, D. Fontaneto, M. Garbelotto, O. Holdenrieder, M. Jeger, D. Lonsdale, A. MacLeod, P. Mills, M. Moslonka-Lefebvre, G. Stancanelli, P. Weisberg, and X. Xu for insights and discussions, and to P. Bourne, T. Matoni, and D. Smith for helpful comments on a previous draft.

Funding Statement

This work was funded by the French Foundation for Research on Biodiversity (FRB) through its Centre for Synthesis and Analysis of Biodiversity data (CESAB), as part of the NETSEED research project. The funders had no role in the preparation of the manuscript.

Logo for BCcampus Open Publishing

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Chapter 2: Getting Started in Research

Reviewing the Research Literature

Learning Objectives

  • Define the research literature in psychology and give examples of sources that are part of the research literature and sources that are not.
  • Describe and use several methods for finding previous research on a particular research idea or question.

Reviewing the research literature means finding, reading, and summarizing the published research relevant to your question. An empirical research report written in American Psychological Association (APA) style always includes a written literature review, but it is important to review the literature early in the research process for several reasons.

  • It can help you turn a research idea into an interesting research question.
  • It can tell you if a research question has already been answered.
  • It can help you evaluate the interestingness of a research question.
  • It can give you ideas for how to conduct your own study.
  • It can tell you how your study fits into the research literature.

What Is the Research Literature?

The  research literature  in any field is all the published research in that field. The research literature in psychology is enormous—including millions of scholarly articles and books dating to the beginning of the field—and it continues to grow. Although its boundaries are somewhat fuzzy, the research literature definitely does not include self-help and other pop psychology books, dictionary and encyclopedia entries, websites, and similar sources that are intended mainly for the general public. These are considered unreliable because they are not reviewed by other researchers and are often based on little more than common sense or personal experience. Wikipedia contains much valuable information, but the fact that its authors are anonymous and may not have any formal training or expertise in that subject area, and its content continually changes makes it unsuitable as a basis of sound scientific research. For our purposes, it helps to define the research literature as consisting almost entirely of two types of sources: articles in professional journals, and scholarly books in psychology and related fields.

Professional Journals

Professional journals  are periodicals that publish original research articles. There are thousands of professional journals that publish research in psychology and related fields. They are usually published monthly or quarterly in individual issues, each of which contains several articles. The issues are organized into volumes, which usually consist of all the issues for a calendar year. Some journals are published in hard copy only, others in both hard copy and electronic form, and still others in electronic form only.

Most articles in professional journals are one of two basic types: empirical research reports and review articles.  Empirical research reports  describe one or more new empirical studies conducted by the authors. They introduce a research question, explain why it is interesting, review previous research, describe their method and results, and draw their conclusions. Review articles  summarize previously published research on a topic and usually present new ways to organize or explain the results. When a review article is devoted primarily to presenting a new theory, it is often referred to as a theoretical article .

Figure 2.6 Small Sample of the Thousands of Professional Journals That Publish Research in Psychology and Related Fields

Most professional journals in psychology undergo a process of  double-blind peer review . Researchers who want to publish their work in the journal submit a manuscript to the editor—who is generally an established researcher too—who in turn sends it to two or three experts on the topic. Each reviewer reads the manuscript, writes a critical but constructive review, and sends the review back to the editor along with his or her recommendations. The editor then decides whether to accept the article for publication, ask the authors to make changes and resubmit it for further consideration, or reject it outright. In any case, the editor forwards the reviewers’ written comments to the researchers so that they can revise their manuscript accordingly. This entire process is double-blind, as the reviewers do not know the identity of the researcher(s), and vice versa. Double-blind peer review is helpful because it ensures that the work meets basic standards of the field before it can enter the research literature. However, in order to increase transparency and accountability some newer open access journals (e.g., Frontiers in Psychology) utilize an open peer review process wherein the identities of the reviewers (which remain concealed during the peer review process) are published alongside the journal article.

Scholarly Books

Scholarly books  are books written by researchers and practitioners mainly for use by other researchers and practitioners. A  monograph  is written by a single author or a small group of authors and usually gives a coherent presentation of a topic much like an extended review article.  Edited volumes have an editor or a small group of editors who recruit many authors to write separate chapters on different aspects of the same topic. Although edited volumes can also give a coherent presentation of the topic, it is not unusual for each chapter to take a different perspective or even for the authors of different chapters to openly disagree with each other. In general, scholarly books undergo a peer review process similar to that used by professional journals.

Literature Search Strategies

Using psycinfo and other databases.

The primary method used to search the research literature involves using one or more electronic databases. These include Academic Search Premier, JSTOR, and ProQuest for all academic disciplines, ERIC for education, and PubMed for medicine and related fields. The most important for our purposes, however, is PsycINFO, which is produced by the APA. PsycINFO is so comprehensive—covering thousands of professional journals and scholarly books going back more than 100 years—that for most purposes its content is synonymous with the research literature in psychology. Like most such databases, PsycINFO is usually available through your university library.

PsycINFO consists of individual records for each article, book chapter, or book in the database. Each record includes basic publication information, an abstract or summary of the work (like the one presented at the start of this chapter), and a list of other works cited by that work. A computer interface allows entering one or more search terms and returns any records that contain those search terms. (These interfaces are provided by different vendors and therefore can look somewhat different depending on the library you use.) Each record also contains lists of keywords that describe the content of the work and also a list of index terms. The index terms are especially helpful because they are standardized. Research on differences between women and men, for example, is always indexed under “Human Sex Differences.” Research on notetaking is always indexed under the term “Learning Strategies.” If you do not know the appropriate index terms, PsycINFO includes a thesaurus that can help you find them.

Given that there are nearly four million records in PsycINFO, you may have to try a variety of search terms in different combinations and at different levels of specificity before you find what you are looking for. Imagine, for example, that you are interested in the question of whether women and men differ in terms of their ability to recall experiences from when they were very young. If you were to enter “memory for early experiences” as your search term, PsycINFO would return only six records, most of which are not particularly relevant to your question. However, if you were to enter the search term “memory,” it would return 149,777 records—far too many to look through individually. This is where the thesaurus helps. Entering “memory” into the thesaurus provides several more specific index terms—one of which is “early memories.” While searching for “early memories” among the index terms returns 1,446 records—still too many too look through individually—combining it with “human sex differences” as a second search term returns 37 articles, many of which are highly relevant to the topic.

QR code that links to PsycINFO video

Depending on the vendor that provides the interface to PsycINFO, you may be able to save, print, or e-mail the relevant PsycINFO records. The records might even contain links to full-text copies of the works themselves. (PsycARTICLES is a database that provides full-text access to articles in all journals published by the APA.) If not, and you want a copy of the work, you will have to find out if your library carries the journal or has the book and the hard copy on the library shelves. Be sure to ask a librarian if you need help.

Using Other Search Techniques

QR code that links to Google Scholar video

In addition to entering search terms into PsycINFO and other databases, there are several other techniques you can use to search the research literature. First, if you have one good article or book chapter on your topic—a recent review article is best—you can look through the reference list of that article for other relevant articles, books, and book chapters. In fact, you should do this with any relevant article or book chapter you find. You can also start with a classic article or book chapter on your topic, find its record in PsycINFO (by entering the author’s name or article’s title as a search term), and link from there to a list of other works in PsycINFO that cite that classic article. This works because other researchers working on your topic are likely to be aware of the classic article and cite it in their own work. You can also do a general Internet search using search terms related to your topic or the name of a researcher who conducts research on your topic. This might lead you directly to works that are part of the research literature (e.g., articles in open-access journals or posted on researchers’ own websites). The search engine Google Scholar is especially useful for this purpose. A general Internet search might also lead you to websites that are not part of the research literature but might provide references to works that are. Finally, you can talk to people (e.g., your instructor or other faculty members in psychology) who know something about your topic and can suggest relevant articles and book chapters.

What to Search For

When you do a literature review, you need to be selective. Not every article, book chapter, and book that relates to your research idea or question will be worth obtaining, reading, and integrating into your review. Instead, you want to focus on sources that help you do four basic things: (a) refine your research question, (b) identify appropriate research methods, (c) place your research in the context of previous research, and (d) write an effective research report. Several basic principles can help you find the most useful sources.

First, it is best to focus on recent research, keeping in mind that what counts as recent depends on the topic. For newer topics that are actively being studied, “recent” might mean published in the past year or two. For older topics that are receiving less attention right now, “recent” might mean within the past 10 years. You will get a feel for what counts as recent for your topic when you start your literature search. A good general rule, however, is to start with sources published in the past five years. The main exception to this rule would be classic articles that turn up in the reference list of nearly every other source. If other researchers think that this work is important, even though it is old, then by all means you should include it in your review.

Second, you should look for review articles on your topic because they will provide a useful overview of it—often discussing important definitions, results, theories, trends, and controversies—giving you a good sense of where your own research fits into the literature. You should also look for empirical research reports addressing your question or similar questions, which can give you ideas about how to operationally define your variables and collect your data. As a general rule, it is good to use methods that others have already used successfully unless you have good reasons not to. Finally, you should look for sources that provide information that can help you argue for the interestingness of your research question. For a study on the effects of cell phone use on driving ability, for example, you might look for information about how widespread cell phone use is, how frequent and costly motor vehicle crashes are, and so on.

How many sources are enough for your literature review? This is a difficult question because it depends on how extensively your topic has been studied and also on your own goals. One study found that across a variety of professional journals in psychology, the average number of sources cited per article was about 50 (Adair & Vohra, 2003) [1] . This gives a rough idea of what professional researchers consider to be adequate. As a student, you might be assigned a much lower minimum number of references to use, but the principles for selecting the most useful ones remain the same.

Key Takeaways

  • The research literature in psychology is all the published research in psychology, consisting primarily of articles in professional journals and scholarly books.
  • Early in the research process, it is important to conduct a review of the research literature on your topic to refine your research question, identify appropriate research methods, place your question in the context of other research, and prepare to write an effective research report.
  • There are several strategies for finding previous research on your topic. Among the best is using PsycINFO, a computer database that catalogs millions of articles, books, and book chapters in psychology and related fields.
  • Practice: Use the techniques discussed in this section to find 10 journal articles and book chapters on one of the following research ideas: memory for smells, aggressive driving, the causes of narcissistic personality disorder, the functions of the intraparietal sulcus, or prejudice against the physically handicapped.
  • Watch the following video clip produced by UBCiSchool about how to read an academic paper (without losing your mind):

QR code that links to UBCiSchool video

Video Attributions

  • “ Sample PsycINFO Search on EBSCOhost ” by APA Publishing Training . Standard YouTube Licence.
  • “ Using Google Scholar (CLIP) ” by clipinfolit . CC BY (Attribution)
  • “ How to Read an Academic Paper ” by UBCiSchool . CC BY (Attribution)
  • Adair, J. G., & Vohra, N. (2003). The explosion of knowledge, references, and citations: Psychology’s unique response to a crisis. American Psychologist, 58 , 15–23. ↵

All the published research in a particular field.

Periodicals that publish original research articles.

A type of research article which describes one or more new empirical studies conducted by the authors.

A type of research article that summarizes previously published research on a topic and usually presents new ways to organize or explain the results.

A type of review article primarily devoted to presenting a new theory.

Books written by researchers and practitioners mainly for sue by other researchers and practitioners.

Type of scholarly book written by a single author or small group of authors, coherently presents a topic much like an extended review article.

A type of scholarly book in which an editor or small group of editors recruit many authors to write separate chapters on different aspects of the same topic.

An electronic database covering thousands of professional journals and scholarly books produced by the APA.

Research Methods in Psychology - 2nd Canadian Edition by Paul C. Price, Rajiv Jhangiani, & I-Chant A. Chiang is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

what is reviewing the literature in a research paper

Research Methods

  • Getting Started
  • Literature Review Research
  • Research Design
  • Research Design By Discipline
  • SAGE Research Methods
  • Teaching with SAGE Research Methods

Literature Review

  • What is a Literature Review?
  • What is NOT a Literature Review?
  • Purposes of a Literature Review
  • Types of Literature Reviews
  • Literature Reviews vs. Systematic Reviews
  • Systematic vs. Meta-Analysis

Literature Review  is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.

Also, we can define a literature review as the collected body of scholarly works related to a topic:

  • Summarizes and analyzes previous research relevant to a topic
  • Includes scholarly books and articles published in academic journals
  • Can be an specific scholarly paper or a section in a research paper

The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic

  • Help gather ideas or information
  • Keep up to date in current trends and findings
  • Help develop new questions

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Helps focus your own research questions or problems
  • Discovers relationships between research studies/ideas.
  • Suggests unexplored ideas or populations
  • Identifies major themes, concepts, and researchers on a topic.
  • Tests assumptions; may help counter preconceived ideas and remove unconscious bias.
  • Identifies critical gaps, points of disagreement, or potentially flawed methodology or theoretical approaches.
  • Indicates potential directions for future research.

All content in this section is from Literature Review Research from Old Dominion University 

Keep in mind the following, a literature review is NOT:

Not an essay 

Not an annotated bibliography  in which you summarize each article that you have reviewed.  A literature review goes beyond basic summarizing to focus on the critical analysis of the reviewed works and their relationship to your research question.

Not a research paper   where you select resources to support one side of an issue versus another.  A lit review should explain and consider all sides of an argument in order to avoid bias, and areas of agreement and disagreement should be highlighted.

A literature review serves several purposes. For example, it

  • provides thorough knowledge of previous studies; introduces seminal works.
  • helps focus one’s own research topic.
  • identifies a conceptual framework for one’s own research questions or problems; indicates potential directions for future research.
  • suggests previously unused or underused methodologies, designs, quantitative and qualitative strategies.
  • identifies gaps in previous studies; identifies flawed methodologies and/or theoretical approaches; avoids replication of mistakes.
  • helps the researcher avoid repetition of earlier research.
  • suggests unexplored populations.
  • determines whether past studies agree or disagree; identifies controversy in the literature.
  • tests assumptions; may help counter preconceived ideas and remove unconscious bias.

As Kennedy (2007) notes*, it is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the original studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally that become part of the lore of field. In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews.

Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are several approaches to how they can be done, depending upon the type of analysis underpinning your study. Listed below are definitions of types of literature reviews:

Argumentative Review      This form examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to to make summary claims of the sort found in systematic reviews.

Integrative Review      Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication.

Historical Review      Few things rest in isolation from historical precedent. Historical reviews are focused on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review      A review does not always focus on what someone said [content], but how they said it [method of analysis]. This approach provides a framework of understanding at different levels (i.e. those of theory, substantive fields, research approaches and data collection and analysis techniques), enables researchers to draw on a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection and data analysis, and helps highlight many ethical issues which we should be aware of and consider as we go through our study.

Systematic Review      This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyse data from the studies that are included in the review. Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?"

Theoretical Review      The purpose of this form is to concretely examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review help establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

* Kennedy, Mary M. "Defining a Literature."  Educational Researcher  36 (April 2007): 139-147.

All content in this section is from The Literature Review created by Dr. Robert Larabee USC

Robinson, P. and Lowe, J. (2015),  Literature reviews vs systematic reviews.  Australian and New Zealand Journal of Public Health, 39: 103-103. doi: 10.1111/1753-6405.12393

what is reviewing the literature in a research paper

What's in the name? The difference between a Systematic Review and a Literature Review, and why it matters . By Lynn Kysh from University of Southern California

what is reviewing the literature in a research paper

Systematic review or meta-analysis?

A  systematic review  answers a defined research question by collecting and summarizing all empirical evidence that fits pre-specified eligibility criteria.

A  meta-analysis  is the use of statistical methods to summarize the results of these studies.

Systematic reviews, just like other research articles, can be of varying quality. They are a significant piece of work (the Centre for Reviews and Dissemination at York estimates that a team will take 9-24 months), and to be useful to other researchers and practitioners they should have:

  • clearly stated objectives with pre-defined eligibility criteria for studies
  • explicit, reproducible methodology
  • a systematic search that attempts to identify all studies
  • assessment of the validity of the findings of the included studies (e.g. risk of bias)
  • systematic presentation, and synthesis, of the characteristics and findings of the included studies

Not all systematic reviews contain meta-analysis. 

Meta-analysis is the use of statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review.  More information on meta-analyses can be found in  Cochrane Handbook, Chapter 9 .

A meta-analysis goes beyond critique and integration and conducts secondary statistical analysis on the outcomes of similar studies.  It is a systematic review that uses quantitative methods to synthesize and summarize the results.

An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings.  Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted.  In that case, an integrative review is an appropriate strategy. 

Some of the content in this section is from Systematic reviews and meta-analyses: step by step guide created by Kate McAllister.

  • << Previous: Getting Started
  • Next: Research Design >>
  • Last Updated: Aug 21, 2023 4:07 PM
  • URL: https://guides.lib.udel.edu/researchmethods

Literature Reviews

  • Getting Started
  • Choosing a Type of Review
  • Developing a Research Question
  • Searching the Literature
  • Searching Tips
  • ChatGPT [beta]
  • Documenting your Search
  • Using Citation Managers
  • Concept Mapping
  • Concept Map Definition

MindMeister

  • Writing the Review
  • Further Resources

Additional Tools

Google slides.

GSlides can create concept maps using their Diagram feature. Insert > Diagram > Hierarchy will give you some editable templates to use.

Tutorial on diagrams in GSlides .

MICROSOFT WORD

MS Word can create concept maps using Insert > SmartArt Graphic. Select Process, Cycle, Hierarchy, or Relationship to see templates.

NVivo  is software for qualitative analysis that has a concept map feature. Zotero libraries can be uploaded using ris files. NVivo Concept Map information.

A concept map or mind map is a visual representation of knowledge that illustrates relationships between concepts or ideas. It is a tool for organizing and representing information in a hierarchical and interconnected manner. At its core, a concept map consists of nodes, which represent individual concepts or ideas, and links, which depict the relationships between these concepts .

Below is a non-exhaustive list of tools that can facilitate the creation of concept maps.

what is reviewing the literature in a research paper

www.canva.com

Canva is a user-friendly graphic design platform that enables individuals to create visual content quickly and easily. It offers a diverse array of customizable templates, design elements, and tools, making it accessible to users with varying levels of design experience. 

Pros: comes with many pre-made concept map templates to get you started

Cons : not all features are available in the free version

Explore Canva concept map templates here .

Note: Although Canva advertises an "education" option, this is for K-12 only and does not apply to university users.

what is reviewing the literature in a research paper

www.lucidchart.com

Lucid has two tools that can create mind maps (what they're called inside Lucid): Lucidchart is the place to build, document, and diagram, and Lucidspark is the place to ideate, connect, and plan.

Lucidchart is a collaborative online diagramming and visualization tool that allows users to create a wide range of diagrams, including flowcharts, org charts, wireframes, and mind maps. Its mind-mapping feature provides a structured framework for brainstorming ideas, organizing thoughts, and visualizing relationships between concepts. 

Lucidspark , works as a virtual whiteboard. Here, you can add sticky notes, develop ideas through freehand drawing, and collaborate with your teammates. Has only one template for mind mapping.

Explore Lucid mind map creation here .

How to create mind maps using LucidSpark: 

Note: U-M students have access to Lucid through ITS. [ info here ] Choose the "Login w Google" option, use your @umich.edu account, and access should happen automatically.

what is reviewing the literature in a research paper

www.figma.com

Figma is a cloud-based design tool that enables collaborative interface design and prototyping. It's widely used by UI/UX designers to create, prototype, and iterate on digital designs. Figma is the main design tool, and FigJam is their virtual whiteboard:

Figma  is a comprehensive design tool that enables designers to create and prototype high-fidelity designs

FigJam focuses on collaboration and brainstorming, providing a virtual whiteboard-like experience, best for concept maps

Explore FigJam concept maps here .

what is reviewing the literature in a research paper

Note: There is a " Figma for Education " version for students that will provide access. Choose the "Login w Google" option, use your @umich.edu account, and access should happen automatically.

what is reviewing the literature in a research paper

www.mindmeister.com

MindMeister  is an online mind mapping tool that allows users to visually organize their thoughts, ideas, and information in a structured and hierarchical format. It provides a digital canvas where users can create and manipulate nodes representing concepts or topics, and connect them with lines to show relationships and associations.

Features : collaborative, permits multiple co-authors, and multiple export formats. The free version allows up to 3 mind maps.

Explore  MindMeister templates here .

  • << Previous: Using Citation Managers
  • Next: Writing the Review >>
  • Last Updated: Feb 15, 2024 1:47 PM
  • URL: https://guides.lib.umich.edu/litreview

Library Homepage

Literature Reviews

  • What Is It?
  • Finding Literature Reviews

A literature review is both a process and a product. As a process, it involves searching for information related to your topic, to familiarize yourself with the relevant research and to identify issues and gaps in the research. In most cases you're seeking to identify the key authors and key arguments that are relevant to your topic, not to exhaustively read everything written on the subject. 

Types of Literature Reviews

A stand alone literature review can be a single work in its own right.  Examples include:

  • A class assignment
  • A review article

Literature reviews can also be component parts of larger bodies of work. Examples include:

  • A thesis / dissertation
  • An academic journal article introduction

Profile Photo

What is a Literature Review?

A literature review is the writing process of summarizing, synthesizing and/or critiquing the literature found as a result of a literature search. It may be used as background or context for a primary research project.

There are several reasons to review the literature :

  • Identify the developments in the field of study
  • Learn about the information sources and the research methodologies
  • Find gaps in the literature that can become research questions
  • Validate the originality of a research project
  • Evaluate the methods
  • Identify errors to avoid
  • Highlight the strengths, weaknesses and controversies in the field of study
  • Identify the subject experts

When writing your review, there are objectives you should keep in mind :

  • Inform the audience of the developments in the field
  • Establish your credibility
  • Discuss the relevance and significance of your question(s)
  • Provide the context for your methodological approach
  • Discuss the relevance and appropriateness of your approach.

​The level of detail or comprehensiveness of your literature review may depend on many things, but especially the purpose and audience of your review. For example, if you're writing a literature review that will aid you in writing a thesis or dissertation, you may want to have a very comprehensive lit review that reviews all relevant literature on a topic, as well as relevant sources beyond what is immediately and freely available (e.g. foundational scholarly articles not available through library collections).

Purpose of a Literature Review

Watch this YouTube video to understand the purpose of a literature review.

  • Next: Finding Literature Reviews >>
  • Last Updated: Dec 12, 2023 3:07 PM
  • URL: https://library.knox.edu/literature-review
  • Systematic review
  • Open access
  • Published: 19 February 2024

‘It depends’: what 86 systematic reviews tell us about what strategies to use to support the use of research in clinical practice

  • Annette Boaz   ORCID: orcid.org/0000-0003-0557-1294 1 ,
  • Juan Baeza 2 ,
  • Alec Fraser   ORCID: orcid.org/0000-0003-1121-1551 2 &
  • Erik Persson 3  

Implementation Science volume  19 , Article number:  15 ( 2024 ) Cite this article

239 Accesses

30 Altmetric

Metrics details

The gap between research findings and clinical practice is well documented and a range of strategies have been developed to support the implementation of research into clinical practice. The objective of this study was to update and extend two previous reviews of systematic reviews of strategies designed to implement research evidence into clinical practice.

We developed a comprehensive systematic literature search strategy based on the terms used in the previous reviews to identify studies that looked explicitly at interventions designed to turn research evidence into practice. The search was performed in June 2022 in four electronic databases: Medline, Embase, Cochrane and Epistemonikos. We searched from January 2010 up to June 2022 and applied no language restrictions. Two independent reviewers appraised the quality of included studies using a quality assessment checklist. To reduce the risk of bias, papers were excluded following discussion between all members of the team. Data were synthesised using descriptive and narrative techniques to identify themes and patterns linked to intervention strategies, targeted behaviours, study settings and study outcomes.

We identified 32 reviews conducted between 2010 and 2022. The reviews are mainly of multi-faceted interventions ( n  = 20) although there are reviews focusing on single strategies (ICT, educational, reminders, local opinion leaders, audit and feedback, social media and toolkits). The majority of reviews report strategies achieving small impacts (normally on processes of care). There is much less evidence that these strategies have shifted patient outcomes. Furthermore, a lot of nuance lies behind these headline findings, and this is increasingly commented upon in the reviews themselves.

Combined with the two previous reviews, 86 systematic reviews of strategies to increase the implementation of research into clinical practice have been identified. We need to shift the emphasis away from isolating individual and multi-faceted interventions to better understanding and building more situated, relational and organisational capability to support the use of research in clinical practice. This will involve drawing on a wider range of research perspectives (including social science) in primary studies and diversifying the types of synthesis undertaken to include approaches such as realist synthesis which facilitate exploration of the context in which strategies are employed.

Peer Review reports

Contribution to the literature

Considerable time and money is invested in implementing and evaluating strategies to increase the implementation of research into clinical practice.

The growing body of evidence is not providing the anticipated clear lessons to support improved implementation.

Instead what is needed is better understanding and building more situated, relational and organisational capability to support the use of research in clinical practice.

This would involve a more central role in implementation science for a wider range of perspectives, especially from the social, economic, political and behavioural sciences and for greater use of different types of synthesis, such as realist synthesis.

Introduction

The gap between research findings and clinical practice is well documented and a range of interventions has been developed to increase the implementation of research into clinical practice [ 1 , 2 ]. In recent years researchers have worked to improve the consistency in the ways in which these interventions (often called strategies) are described to support their evaluation. One notable development has been the emergence of Implementation Science as a field focusing explicitly on “the scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice” ([ 3 ] p. 1). The work of implementation science focuses on closing, or at least narrowing, the gap between research and practice. One contribution has been to map existing interventions, identifying 73 discreet strategies to support research implementation [ 4 ] which have been grouped into 9 clusters [ 5 ]. The authors note that they have not considered the evidence of effectiveness of the individual strategies and that a next step is to understand better which strategies perform best in which combinations and for what purposes [ 4 ]. Other authors have noted that there is also scope to learn more from other related fields of study such as policy implementation [ 6 ] and to draw on methods designed to support the evaluation of complex interventions [ 7 ].

The increase in activity designed to support the implementation of research into practice and improvements in reporting provided the impetus for an update of a review of systematic reviews of the effectiveness of interventions designed to support the use of research in clinical practice [ 8 ] which was itself an update of the review conducted by Grimshaw and colleagues in 2001. The 2001 review [ 9 ] identified 41 reviews considering a range of strategies including educational interventions, audit and feedback, computerised decision support to financial incentives and combined interventions. The authors concluded that all the interventions had the potential to promote the uptake of evidence in practice, although no one intervention seemed to be more effective than the others in all settings. They concluded that combined interventions were more likely to be effective than single interventions. The 2011 review identified a further 13 systematic reviews containing 313 discrete primary studies. Consistent with the previous review, four main strategy types were identified: audit and feedback; computerised decision support; opinion leaders; and multi-faceted interventions (MFIs). Nine of the reviews reported on MFIs. The review highlighted the small effects of single interventions such as audit and feedback, computerised decision support and opinion leaders. MFIs claimed an improvement in effectiveness over single interventions, although effect sizes remained small to moderate and this improvement in effectiveness relating to MFIs has been questioned in a subsequent review [ 10 ]. In updating the review, we anticipated a larger pool of reviews and an opportunity to consolidate learning from more recent systematic reviews of interventions.

This review updates and extends our previous review of systematic reviews of interventions designed to implement research evidence into clinical practice. To identify potentially relevant peer-reviewed research papers, we developed a comprehensive systematic literature search strategy based on the terms used in the Grimshaw et al. [ 9 ] and Boaz, Baeza and Fraser [ 8 ] overview articles. To ensure optimal retrieval, our search strategy was refined with support from an expert university librarian, considering the ongoing improvements in the development of search filters for systematic reviews since our first review [ 11 ]. We also wanted to include technology-related terms (e.g. apps, algorithms, machine learning, artificial intelligence) to find studies that explored interventions based on the use of technological innovations as mechanistic tools for increasing the use of evidence into practice (see Additional file 1 : Appendix A for full search strategy).

The search was performed in June 2022 in the following electronic databases: Medline, Embase, Cochrane and Epistemonikos. We searched for articles published since the 2011 review. We searched from January 2010 up to June 2022 and applied no language restrictions. Reference lists of relevant papers were also examined.

We uploaded the results using EPPI-Reviewer, a web-based tool that facilitated semi-automation of the screening process and removal of duplicate studies. We made particular use of a priority screening function to reduce screening workload and avoid ‘data deluge’ [ 12 ]. Through machine learning, one reviewer screened a smaller number of records ( n  = 1200) to train the software to predict whether a given record was more likely to be relevant or irrelevant, thus pulling the relevant studies towards the beginning of the screening process. This automation did not replace manual work but helped the reviewer to identify eligible studies more quickly. During the selection process, we included studies that looked explicitly at interventions designed to turn research evidence into practice. Studies were included if they met the following pre-determined inclusion criteria:

The study was a systematic review

Search terms were included

Focused on the implementation of research evidence into practice

The methodological quality of the included studies was assessed as part of the review

Study populations included healthcare providers and patients. The EPOC taxonomy [ 13 ] was used to categorise the strategies. The EPOC taxonomy has four domains: delivery arrangements, financial arrangements, governance arrangements and implementation strategies. The implementation strategies domain includes 20 strategies targeted at healthcare workers. Numerous EPOC strategies were assessed in the review including educational strategies, local opinion leaders, reminders, ICT-focused approaches and audit and feedback. Some strategies that did not fit easily within the EPOC categories were also included. These were social media strategies and toolkits, and multi-faceted interventions (MFIs) (see Table  2 ). Some systematic reviews included comparisons of different interventions while other reviews compared one type of intervention against a control group. Outcomes related to improvements in health care processes or patient well-being. Numerous individual study types (RCT, CCT, BA, ITS) were included within the systematic reviews.

We excluded papers that:

Focused on changing patient rather than provider behaviour

Had no demonstrable outcomes

Made unclear or no reference to research evidence

The last of these criteria was sometimes difficult to judge, and there was considerable discussion amongst the research team as to whether the link between research evidence and practice was sufficiently explicit in the interventions analysed. As we discussed in the previous review [ 8 ] in the field of healthcare, the principle of evidence-based practice is widely acknowledged and tools to change behaviour such as guidelines are often seen to be an implicit codification of evidence, despite the fact that this is not always the case.

Reviewers employed a two-stage process to select papers for inclusion. First, all titles and abstracts were screened by one reviewer to determine whether the study met the inclusion criteria. Two papers [ 14 , 15 ] were identified that fell just before the 2010 cut-off. As they were not identified in the searches for the first review [ 8 ] they were included and progressed to assessment. Each paper was rated as include, exclude or maybe. The full texts of 111 relevant papers were assessed independently by at least two authors. To reduce the risk of bias, papers were excluded following discussion between all members of the team. 32 papers met the inclusion criteria and proceeded to data extraction. The study selection procedure is documented in a PRISMA literature flow diagram (see Fig.  1 ). We were able to include French, Spanish and Portuguese papers in the selection reflecting the language skills in the study team, but none of the papers identified met the inclusion criteria. Other non- English language papers were excluded.

figure 1

PRISMA flow diagram. Source: authors

One reviewer extracted data on strategy type, number of included studies, local, target population, effectiveness and scope of impact from the included studies. Two reviewers then independently read each paper and noted key findings and broad themes of interest which were then discussed amongst the wider authorial team. Two independent reviewers appraised the quality of included studies using a Quality Assessment Checklist based on Oxman and Guyatt [ 16 ] and Francke et al. [ 17 ]. Each study was rated a quality score ranging from 1 (extensive flaws) to 7 (minimal flaws) (see Additional file 2 : Appendix B). All disagreements were resolved through discussion. Studies were not excluded in this updated overview based on methodological quality as we aimed to reflect the full extent of current research into this topic.

The extracted data were synthesised using descriptive and narrative techniques to identify themes and patterns in the data linked to intervention strategies, targeted behaviours, study settings and study outcomes.

Thirty-two studies were included in the systematic review. Table 1. provides a detailed overview of the included systematic reviews comprising reference, strategy type, quality score, number of included studies, local, target population, effectiveness and scope of impact (see Table  1. at the end of the manuscript). Overall, the quality of the studies was high. Twenty-three studies scored 7, six studies scored 6, one study scored 5, one study scored 4 and one study scored 3. The primary focus of the review was on reviews of effectiveness studies, but a small number of reviews did include data from a wider range of methods including qualitative studies which added to the analysis in the papers [ 18 , 19 , 20 , 21 ]. The majority of reviews report strategies achieving small impacts (normally on processes of care). There is much less evidence that these strategies have shifted patient outcomes. In this section, we discuss the different EPOC-defined implementation strategies in turn. Interestingly, we found only two ‘new’ approaches in this review that did not fit into the existing EPOC approaches. These are a review focused on the use of social media and a review considering toolkits. In addition to single interventions, we also discuss multi-faceted interventions. These were the most common intervention approach overall. A summary is provided in Table  2 .

Educational strategies

The overview identified three systematic reviews focusing on educational strategies. Grudniewicz et al. [ 22 ] explored the effectiveness of printed educational materials on primary care physician knowledge, behaviour and patient outcomes and concluded they were not effective in any of these aspects. Koota, Kääriäinen and Melender [ 23 ] focused on educational interventions promoting evidence-based practice among emergency room/accident and emergency nurses and found that interventions involving face-to-face contact led to significant or highly significant effects on patient benefits and emergency nurses’ knowledge, skills and behaviour. Interventions using written self-directed learning materials also led to significant improvements in nurses’ knowledge of evidence-based practice. Although the quality of the studies was high, the review primarily included small studies with low response rates, and many of them relied on self-assessed outcomes; consequently, the strength of the evidence for these outcomes is modest. Wu et al. [ 20 ] questioned if educational interventions aimed at nurses to support the implementation of evidence-based practice improve patient outcomes. Although based on evaluation projects and qualitative data, their results also suggest that positive changes on patient outcomes can be made following the implementation of specific evidence-based approaches (or projects). The differing positive outcomes for educational strategies aimed at nurses might indicate that the target audience is important.

Local opinion leaders

Flodgren et al. [ 24 ] was the only systemic review focusing solely on opinion leaders. The review found that local opinion leaders alone, or in combination with other interventions, can be effective in promoting evidence‐based practice, but this varies both within and between studies and the effect on patient outcomes is uncertain. The review found that, overall, any intervention involving opinion leaders probably improves healthcare professionals’ compliance with evidence-based practice but varies within and across studies. However, how opinion leaders had an impact could not be determined because of insufficient details were provided, illustrating that reporting specific details in published studies is important if diffusion of effective methods of increasing evidence-based practice is to be spread across a system. The usefulness of this review is questionable because it cannot provide evidence of what is an effective opinion leader, whether teams of opinion leaders or a single opinion leader are most effective, or the most effective methods used by opinion leaders.

Pantoja et al. [ 26 ] was the only systemic review focusing solely on manually generated reminders delivered on paper included in the overview. The review explored how these affected professional practice and patient outcomes. The review concluded that manually generated reminders delivered on paper as a single intervention probably led to small to moderate increases in adherence to clinical recommendations, and they could be used as a single quality improvement intervention. However, the authors indicated that this intervention would make little or no difference to patient outcomes. The authors state that such a low-tech intervention may be useful in low- and middle-income countries where paper records are more likely to be the norm.

ICT-focused approaches

The three ICT-focused reviews [ 14 , 27 , 28 ] showed mixed results. Jamal, McKenzie and Clark [ 14 ] explored the impact of health information technology on the quality of medical and health care. They examined the impact of electronic health record, computerised provider order-entry, or decision support system. This showed a positive improvement in adherence to evidence-based guidelines but not to patient outcomes. The number of studies included in the review was low and so a conclusive recommendation could not be reached based on this review. Similarly, Brown et al. [ 28 ] found that technology-enabled knowledge translation interventions may improve knowledge of health professionals, but all eight studies raised concerns of bias. The De Angelis et al. [ 27 ] review was more promising, reporting that ICT can be a good way of disseminating clinical practice guidelines but conclude that it is unclear which type of ICT method is the most effective.

Audit and feedback

Sykes, McAnuff and Kolehmainen [ 29 ] examined whether audit and feedback were effective in dementia care and concluded that it remains unclear which ingredients of audit and feedback are successful as the reviewed papers illustrated large variations in the effectiveness of interventions using audit and feedback.

Non-EPOC listed strategies: social media, toolkits

There were two new (non-EPOC listed) intervention types identified in this review compared to the 2011 review — fewer than anticipated. We categorised a third — ‘care bundles’ [ 36 ] as a multi-faceted intervention due to its description in practice and a fourth — ‘Technology Enhanced Knowledge Transfer’ [ 28 ] was classified as an ICT-focused approach. The first new strategy was identified in Bhatt et al.’s [ 30 ] systematic review of the use of social media for the dissemination of clinical practice guidelines. They reported that the use of social media resulted in a significant improvement in knowledge and compliance with evidence-based guidelines compared with more traditional methods. They noted that a wide selection of different healthcare professionals and patients engaged with this type of social media and its global reach may be significant for low- and middle-income countries. This review was also noteworthy for developing a simple stepwise method for using social media for the dissemination of clinical practice guidelines. However, it is debatable whether social media can be classified as an intervention or just a different way of delivering an intervention. For example, the review discussed involving opinion leaders and patient advocates through social media. However, this was a small review that included only five studies, so further research in this new area is needed. Yamada et al. [ 31 ] draw on 39 studies to explore the application of toolkits, 18 of which had toolkits embedded within larger KT interventions, and 21 of which evaluated toolkits as standalone interventions. The individual component strategies of the toolkits were highly variable though the authors suggest that they align most closely with educational strategies. The authors conclude that toolkits as either standalone strategies or as part of MFIs hold some promise for facilitating evidence use in practice but caution that the quality of many of the primary studies included is considered weak limiting these findings.

Multi-faceted interventions

The majority of the systematic reviews ( n  = 20) reported on more than one intervention type. Some of these systematic reviews focus exclusively on multi-faceted interventions, whilst others compare different single or combined interventions aimed at achieving similar outcomes in particular settings. While these two approaches are often described in a similar way, they are actually quite distinct from each other as the former report how multiple strategies may be strategically combined in pursuance of an agreed goal, whilst the latter report how different strategies may be incidentally used in sometimes contrasting settings in the pursuance of similar goals. Ariyo et al. [ 35 ] helpfully summarise five key elements often found in effective MFI strategies in LMICs — but which may also be transferrable to HICs. First, effective MFIs encourage a multi-disciplinary approach acknowledging the roles played by different professional groups to collectively incorporate evidence-informed practice. Second, they utilise leadership drawing on a wide set of clinical and non-clinical actors including managers and even government officials. Third, multiple types of educational practices are utilised — including input from patients as stakeholders in some cases. Fourth, protocols, checklists and bundles are used — most effectively when local ownership is encouraged. Finally, most MFIs included an emphasis on monitoring and evaluation [ 35 ]. In contrast, other studies offer little information about the nature of the different MFI components of included studies which makes it difficult to extrapolate much learning from them in relation to why or how MFIs might affect practice (e.g. [ 28 , 38 ]). Ultimately, context matters, which some review authors argue makes it difficult to say with real certainty whether single or MFI strategies are superior (e.g. [ 21 , 27 ]). Taking all the systematic reviews together we may conclude that MFIs appear to be more likely to generate positive results than single interventions (e.g. [ 34 , 45 ]) though other reviews should make us cautious (e.g. [ 32 , 43 ]).

While multi-faceted interventions still seem to be more effective than single-strategy interventions, there were important distinctions between how the results of reviews of MFIs are interpreted in this review as compared to the previous reviews [ 8 , 9 ], reflecting greater nuance and debate in the literature. This was particularly noticeable where the effectiveness of MFIs was compared to single strategies, reflecting developments widely discussed in previous studies [ 10 ]. We found that most systematic reviews are bounded by their clinical, professional, spatial, system, or setting criteria and often seek to draw out implications for the implementation of evidence in their areas of specific interest (such as nursing or acute care). Frequently this means combining all relevant studies to explore the respective foci of each systematic review. Therefore, most reviews we categorised as MFIs actually include highly variable numbers and combinations of intervention strategies and highly heterogeneous original study designs. This makes statistical analyses of the type used by Squires et al. [ 10 ] on the three reviews in their paper not possible. Further, it also makes extrapolating findings and commenting on broad themes complex and difficult. This may suggest that future research should shift its focus from merely examining ‘what works’ to ‘what works where and what works for whom’ — perhaps pointing to the value of realist approaches to these complex review topics [ 48 , 49 ] and other more theory-informed approaches [ 50 ].

Some reviews have a relatively small number of studies (i.e. fewer than 10) and the authors are often understandably reluctant to engage with wider debates about the implications of their findings. Other larger studies do engage in deeper discussions about internal comparisons of findings across included studies and also contextualise these in wider debates. Some of the most informative studies (e.g. [ 35 , 40 ]) move beyond EPOC categories and contextualise MFIs within wider systems thinking and implementation theory. This distinction between MFIs and single interventions can actually be very useful as it offers lessons about the contexts in which individual interventions might have bounded effectiveness (i.e. educational interventions for individual change). Taken as a whole, this may also then help in terms of how and when to conjoin single interventions into effective MFIs.

In the two previous reviews, a consistent finding was that MFIs were more effective than single interventions [ 8 , 9 ]. However, like Squires et al. [ 10 ] this overview is more equivocal on this important issue. There are four points which may help account for the differences in findings in this regard. Firstly, the diversity of the systematic reviews in terms of clinical topic or setting is an important factor. Secondly, there is heterogeneity of the studies within the included systematic reviews themselves. Thirdly, there is a lack of consistency with regards to the definition and strategies included within of MFIs. Finally, there are epistemological differences across the papers and the reviews. This means that the results that are presented depend on the methods used to measure, report, and synthesise them. For instance, some reviews highlight that education strategies can be useful to improve provider understanding — but without wider organisational or system-level change, they may struggle to deliver sustained transformation [ 19 , 44 ].

It is also worth highlighting the importance of the theory of change underlying the different interventions. Where authors of the systematic reviews draw on theory, there is space to discuss/explain findings. We note a distinction between theoretical and atheoretical systematic review discussion sections. Atheoretical reviews tend to present acontextual findings (for instance, one study found very positive results for one intervention, and this gets highlighted in the abstract) whilst theoretically informed reviews attempt to contextualise and explain patterns within the included studies. Theory-informed systematic reviews seem more likely to offer more profound and useful insights (see [ 19 , 35 , 40 , 43 , 45 ]). We find that the most insightful systematic reviews of MFIs engage in theoretical generalisation — they attempt to go beyond the data of individual studies and discuss the wider implications of the findings of the studies within their reviews drawing on implementation theory. At the same time, they highlight the active role of context and the wider relational and system-wide issues linked to implementation. It is these types of investigations that can help providers further develop evidence-based practice.

This overview has identified a small, but insightful set of papers that interrogate and help theorise why, how, for whom, and in which circumstances it might be the case that MFIs are superior (see [ 19 , 35 , 40 ] once more). At the level of this overview — and in most of the systematic reviews included — it appears to be the case that MFIs struggle with the question of attribution. In addition, there are other important elements that are often unmeasured, or unreported (e.g. costs of the intervention — see [ 40 ]). Finally, the stronger systematic reviews [ 19 , 35 , 40 , 43 , 45 ] engage with systems issues, human agency and context [ 18 ] in a way that was not evident in the systematic reviews identified in the previous reviews [ 8 , 9 ]. The earlier reviews lacked any theory of change that might explain why MFIs might be more effective than single ones — whereas now some systematic reviews do this, which enables them to conclude that sometimes single interventions can still be more effective.

As Nilsen et al. ([ 6 ] p. 7) note ‘Study findings concerning the effectiveness of various approaches are continuously synthesized and assembled in systematic reviews’. We may have gone as far as we can in understanding the implementation of evidence through systematic reviews of single and multi-faceted interventions and the next step would be to conduct more research exploring the complex and situated nature of evidence used in clinical practice and by particular professional groups. This would further build on the nuanced discussion and conclusion sections in a subset of the papers we reviewed. This might also support the field to move away from isolating individual implementation strategies [ 6 ] to explore the complex processes involving a range of actors with differing capacities [ 51 ] working in diverse organisational cultures. Taxonomies of implementation strategies do not fully account for the complex process of implementation, which involves a range of different actors with different capacities and skills across multiple system levels. There is plenty of work to build on, particularly in the social sciences, which currently sits at the margins of debates about evidence implementation (see for example, Normalisation Process Theory [ 52 ]).

There are several changes that we have identified in this overview of systematic reviews in comparison to the review we published in 2011 [ 8 ]. A consistent and welcome finding is that the overall quality of the systematic reviews themselves appears to have improved between the two reviews, although this is not reflected upon in the papers. This is exhibited through better, clearer reporting mechanisms in relation to the mechanics of the reviews, alongside a greater attention to, and deeper description of, how potential biases in included papers are discussed. Additionally, there is an increased, but still limited, inclusion of original studies conducted in low- and middle-income countries as opposed to just high-income countries. Importantly, we found that many of these systematic reviews are attuned to, and comment upon the contextual distinctions of pursuing evidence-informed interventions in health care settings in different economic settings. Furthermore, systematic reviews included in this updated article cover a wider set of clinical specialities (both within and beyond hospital settings) and have a focus on a wider set of healthcare professions — discussing both similarities, differences and inter-professional challenges faced therein, compared to the earlier reviews. These wider ranges of studies highlight that a particular intervention or group of interventions may work well for one professional group but be ineffective for another. This diversity of study settings allows us to consider the important role context (in its many forms) plays on implementing evidence into practice. Examining the complex and varied context of health care will help us address what Nilsen et al. ([ 6 ] p. 1) described as, ‘society’s health problems [that] require research-based knowledge acted on by healthcare practitioners together with implementation of political measures from governmental agencies’. This will help us shift implementation science to move, ‘beyond a success or failure perspective towards improved analysis of variables that could explain the impact of the implementation process’ ([ 6 ] p. 2).

This review brings together 32 papers considering individual and multi-faceted interventions designed to support the use of evidence in clinical practice. The majority of reviews report strategies achieving small impacts (normally on processes of care). There is much less evidence that these strategies have shifted patient outcomes. Combined with the two previous reviews, 86 systematic reviews of strategies to increase the implementation of research into clinical practice have been conducted. As a whole, this substantial body of knowledge struggles to tell us more about the use of individual and MFIs than: ‘it depends’. To really move forwards in addressing the gap between research evidence and practice, we may need to shift the emphasis away from isolating individual and multi-faceted interventions to better understanding and building more situated, relational and organisational capability to support the use of research in clinical practice. This will involve drawing on a wider range of perspectives, especially from the social, economic, political and behavioural sciences in primary studies and diversifying the types of synthesis undertaken to include approaches such as realist synthesis which facilitate exploration of the context in which strategies are employed. Harvey et al. [ 53 ] suggest that when context is likely to be critical to implementation success there are a range of primary research approaches (participatory research, realist evaluation, developmental evaluation, ethnography, quality/ rapid cycle improvement) that are likely to be appropriate and insightful. While these approaches often form part of implementation studies in the form of process evaluations, they are usually relatively small scale in relation to implementation research as a whole. As a result, the findings often do not make it into the subsequent systematic reviews. This review provides further evidence that we need to bring qualitative approaches in from the periphery to play a central role in many implementation studies and subsequent evidence syntheses. It would be helpful for systematic reviews, at the very least, to include more detail about the interventions and their implementation in terms of how and why they worked.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

Before and after study

Controlled clinical trial

Effective Practice and Organisation of Care

High-income countries

Information and Communications Technology

Interrupted time series

Knowledge translation

Low- and middle-income countries

Randomised controlled trial

Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30. https://doi.org/10.1016/S0140-6736(03)14546-1 .

Article   PubMed   Google Scholar  

Green LA, Seifert CM. Translation of research into practice: why we can’t “just do it.” J Am Board Fam Pract. 2005;18:541–5. https://doi.org/10.3122/jabfm.18.6.541 .

Eccles MP, Mittman BS. Welcome to Implementation Science. Implement Sci. 2006;1:1–3. https://doi.org/10.1186/1748-5908-1-1 .

Article   PubMed Central   Google Scholar  

Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:2–14. https://doi.org/10.1186/s13012-015-0209-1 .

Article   Google Scholar  

Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. 2015;10:1–8. https://doi.org/10.1186/s13012-015-0295-0 .

Nilsen P, Ståhl C, Roback K, et al. Never the twain shall meet? - a comparison of implementation science and policy implementation research. Implementation Sci. 2013;8:2–12. https://doi.org/10.1186/1748-5908-8-63 .

Rycroft-Malone J, Seers K, Eldh AC, et al. A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar. Implementation Sci. 2018;13:1–15. https://doi.org/10.1186/s13012-018-0811-0 .

Boaz A, Baeza J, Fraser A, European Implementation Score Collaborative Group (EIS). Effective implementation of research into practice: an overview of systematic reviews of the health literature. BMC Res Notes. 2011;4:212. https://doi.org/10.1186/1756-0500-4-212 .

Article   PubMed   PubMed Central   Google Scholar  

Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, et al. Changing provider behavior – an overview of systematic reviews of interventions. Med Care. 2001;39 8Suppl 2:II2–45.

Google Scholar  

Squires JE, Sullivan K, Eccles MP, et al. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9:1–22. https://doi.org/10.1186/s13012-014-0152-6 .

Salvador-Oliván JA, Marco-Cuenca G, Arquero-Avilés R. Development of an efficient search filter to retrieve systematic reviews from PubMed. J Med Libr Assoc. 2021;109:561–74. https://doi.org/10.5195/jmla.2021.1223 .

Thomas JM. Diffusion of innovation in systematic review methodology: why is study selection not yet assisted by automation? OA Evid Based Med. 2013;1:1–6.

Effective Practice and Organisation of Care (EPOC). The EPOC taxonomy of health systems interventions. EPOC Resources for review authors. Oslo: Norwegian Knowledge Centre for the Health Services; 2016. epoc.cochrane.org/epoc-taxonomy . Accessed 9 Oct 2023.

Jamal A, McKenzie K, Clark M. The impact of health information technology on the quality of medical and health care: a systematic review. Health Inf Manag. 2009;38:26–37. https://doi.org/10.1177/183335830903800305 .

Menon A, Korner-Bitensky N, Kastner M, et al. Strategies for rehabilitation professionals to move evidence-based knowledge into practice: a systematic review. J Rehabil Med. 2009;41:1024–32. https://doi.org/10.2340/16501977-0451 .

Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol. 1991;44:1271–8. https://doi.org/10.1016/0895-4356(91)90160-b .

Article   CAS   PubMed   Google Scholar  

Francke AL, Smit MC, de Veer AJ, et al. Factors influencing the implementation of clinical guidelines for health care professionals: a systematic meta-review. BMC Med Inform Decis Mak. 2008;8:1–11. https://doi.org/10.1186/1472-6947-8-38 .

Jones CA, Roop SC, Pohar SL, et al. Translating knowledge in rehabilitation: systematic review. Phys Ther. 2015;95:663–77. https://doi.org/10.2522/ptj.20130512 .

Scott D, Albrecht L, O’Leary K, Ball GDC, et al. Systematic review of knowledge translation strategies in the allied health professions. Implement Sci. 2012;7:1–17. https://doi.org/10.1186/1748-5908-7-70 .

Wu Y, Brettle A, Zhou C, Ou J, et al. Do educational interventions aimed at nurses to support the implementation of evidence-based practice improve patient outcomes? A systematic review. Nurse Educ Today. 2018;70:109–14. https://doi.org/10.1016/j.nedt.2018.08.026 .

Yost J, Ganann R, Thompson D, Aloweni F, et al. The effectiveness of knowledge translation interventions for promoting evidence-informed decision-making among nurses in tertiary care: a systematic review and meta-analysis. Implement Sci. 2015;10:1–15. https://doi.org/10.1186/s13012-015-0286-1 .

Grudniewicz A, Kealy R, Rodseth RN, Hamid J, et al. What is the effectiveness of printed educational materials on primary care physician knowledge, behaviour, and patient outcomes: a systematic review and meta-analyses. Implement Sci. 2015;10:2–12. https://doi.org/10.1186/s13012-015-0347-5 .

Koota E, Kääriäinen M, Melender HL. Educational interventions promoting evidence-based practice among emergency nurses: a systematic review. Int Emerg Nurs. 2018;41:51–8. https://doi.org/10.1016/j.ienj.2018.06.004 .

Flodgren G, O’Brien MA, Parmelli E, et al. Local opinion leaders: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2019. https://doi.org/10.1002/14651858.CD000125.pub5 .

Arditi C, Rège-Walther M, Durieux P, et al. Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2017. https://doi.org/10.1002/14651858.CD001175.pub4 .

Pantoja T, Grimshaw JM, Colomer N, et al. Manually-generated reminders delivered on paper: effects on professional practice and patient outcomes. Cochrane Database Syst Rev. 2019. https://doi.org/10.1002/14651858.CD001174.pub4 .

De Angelis G, Davies B, King J, McEwan J, et al. Information and communication technologies for the dissemination of clinical practice guidelines to health professionals: a systematic review. JMIR Med Educ. 2016;2:e16. https://doi.org/10.2196/mededu.6288 .

Brown A, Barnes C, Byaruhanga J, McLaughlin M, et al. Effectiveness of technology-enabled knowledge translation strategies in improving the use of research in public health: systematic review. J Med Internet Res. 2020;22:e17274. https://doi.org/10.2196/17274 .

Sykes MJ, McAnuff J, Kolehmainen N. When is audit and feedback effective in dementia care? A systematic review. Int J Nurs Stud. 2018;79:27–35. https://doi.org/10.1016/j.ijnurstu.2017.10.013 .

Bhatt NR, Czarniecki SW, Borgmann H, et al. A systematic review of the use of social media for dissemination of clinical practice guidelines. Eur Urol Focus. 2021;7:1195–204. https://doi.org/10.1016/j.euf.2020.10.008 .

Yamada J, Shorkey A, Barwick M, Widger K, et al. The effectiveness of toolkits as knowledge translation strategies for integrating evidence into clinical care: a systematic review. BMJ Open. 2015;5:e006808. https://doi.org/10.1136/bmjopen-2014-006808 .

Afari-Asiedu S, Abdulai MA, Tostmann A, et al. Interventions to improve dispensing of antibiotics at the community level in low and middle income countries: a systematic review. J Glob Antimicrob Resist. 2022;29:259–74. https://doi.org/10.1016/j.jgar.2022.03.009 .

Boonacker CW, Hoes AW, Dikhoff MJ, Schilder AG, et al. Interventions in health care professionals to improve treatment in children with upper respiratory tract infections. Int J Pediatr Otorhinolaryngol. 2010;74:1113–21. https://doi.org/10.1016/j.ijporl.2010.07.008 .

Al Zoubi FM, Menon A, Mayo NE, et al. The effectiveness of interventions designed to increase the uptake of clinical practice guidelines and best practices among musculoskeletal professionals: a systematic review. BMC Health Serv Res. 2018;18:2–11. https://doi.org/10.1186/s12913-018-3253-0 .

Ariyo P, Zayed B, Riese V, Anton B, et al. Implementation strategies to reduce surgical site infections: a systematic review. Infect Control Hosp Epidemiol. 2019;3:287–300. https://doi.org/10.1017/ice.2018.355 .

Borgert MJ, Goossens A, Dongelmans DA. What are effective strategies for the implementation of care bundles on ICUs: a systematic review. Implement Sci. 2015;10:1–11. https://doi.org/10.1186/s13012-015-0306-1 .

Cahill LS, Carey LM, Lannin NA, et al. Implementation interventions to promote the uptake of evidence-based practices in stroke rehabilitation. Cochrane Database Syst Rev. 2020. https://doi.org/10.1002/14651858.CD012575.pub2 .

Pedersen ER, Rubenstein L, Kandrack R, Danz M, et al. Elusive search for effective provider interventions: a systematic review of provider interventions to increase adherence to evidence-based treatment for depression. Implement Sci. 2018;13:1–30. https://doi.org/10.1186/s13012-018-0788-8 .

Jenkins HJ, Hancock MJ, French SD, Maher CG, et al. Effectiveness of interventions designed to reduce the use of imaging for low-back pain: a systematic review. CMAJ. 2015;187:401–8. https://doi.org/10.1503/cmaj.141183 .

Bennett S, Laver K, MacAndrew M, Beattie E, et al. Implementation of evidence-based, non-pharmacological interventions addressing behavior and psychological symptoms of dementia: a systematic review focused on implementation strategies. Int Psychogeriatr. 2021;33:947–75. https://doi.org/10.1017/S1041610220001702 .

Noonan VK, Wolfe DL, Thorogood NP, et al. Knowledge translation and implementation in spinal cord injury: a systematic review. Spinal Cord. 2014;52:578–87. https://doi.org/10.1038/sc.2014.62 .

Albrecht L, Archibald M, Snelgrove-Clarke E, et al. Systematic review of knowledge translation strategies to promote research uptake in child health settings. J Pediatr Nurs. 2016;31:235–54. https://doi.org/10.1016/j.pedn.2015.12.002 .

Campbell A, Louie-Poon S, Slater L, et al. Knowledge translation strategies used by healthcare professionals in child health settings: an updated systematic review. J Pediatr Nurs. 2019;47:114–20. https://doi.org/10.1016/j.pedn.2019.04.026 .

Bird ML, Miller T, Connell LA, et al. Moving stroke rehabilitation evidence into practice: a systematic review of randomized controlled trials. Clin Rehabil. 2019;33:1586–95. https://doi.org/10.1177/0269215519847253 .

Goorts K, Dizon J, Milanese S. The effectiveness of implementation strategies for promoting evidence informed interventions in allied healthcare: a systematic review. BMC Health Serv Res. 2021;21:1–11. https://doi.org/10.1186/s12913-021-06190-0 .

Zadro JR, O’Keeffe M, Allison JL, Lembke KA, et al. Effectiveness of implementation strategies to improve adherence of physical therapist treatment choices to clinical practice guidelines for musculoskeletal conditions: systematic review. Phys Ther. 2020;100:1516–41. https://doi.org/10.1093/ptj/pzaa101 .

Van der Veer SN, Jager KJ, Nache AM, et al. Translating knowledge on best practice into improving quality of RRT care: a systematic review of implementation strategies. Kidney Int. 2011;80:1021–34. https://doi.org/10.1038/ki.2011.222 .

Pawson R, Greenhalgh T, Harvey G, et al. Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10Suppl 1:21–34. https://doi.org/10.1258/1355819054308530 .

Rycroft-Malone J, McCormack B, Hutchinson AM, et al. Realist synthesis: illustrating the method for implementation research. Implementation Sci. 2012;7:1–10. https://doi.org/10.1186/1748-5908-7-33 .

Johnson MJ, May CR. Promoting professional behaviour change in healthcare: what interventions work, and why? A theory-led overview of systematic reviews. BMJ Open. 2015;5:e008592. https://doi.org/10.1136/bmjopen-2015-008592 .

Metz A, Jensen T, Farley A, Boaz A, et al. Is implementation research out of step with implementation practice? Pathways to effective implementation support over the last decade. Implement Res Pract. 2022;3:1–11. https://doi.org/10.1177/26334895221105585 .

May CR, Finch TL, Cornford J, Exley C, et al. Integrating telecare for chronic disease management in the community: What needs to be done? BMC Health Serv Res. 2011;11:1–11. https://doi.org/10.1186/1472-6963-11-131 .

Harvey G, Rycroft-Malone J, Seers K, Wilson P, et al. Connecting the science and practice of implementation – applying the lens of context to inform study design in implementation research. Front Health Serv. 2023;3:1–15. https://doi.org/10.3389/frhs.2023.1162762 .

Download references

Acknowledgements

The authors would like to thank Professor Kathryn Oliver for her support in the planning the review, Professor Steve Hanney for reading and commenting on the final manuscript and the staff at LSHTM library for their support in planning and conducting the literature search.

This study was supported by LSHTM’s Research England QR strategic priorities funding allocation and the National Institute for Health and Care Research (NIHR) Applied Research Collaboration South London (NIHR ARC South London) at King’s College Hospital NHS Foundation Trust. Grant number NIHR200152. The views expressed are those of the author(s) and not necessarily those of the NIHR, the Department of Health and Social Care or Research England.

Author information

Authors and affiliations.

Health and Social Care Workforce Research Unit, The Policy Institute, King’s College London, Virginia Woolf Building, 22 Kingsway, London, WC2B 6LE, UK

Annette Boaz

King’s Business School, King’s College London, 30 Aldwych, London, WC2B 4BG, UK

Juan Baeza & Alec Fraser

Federal University of Santa Catarina (UFSC), Campus Universitário Reitor João Davi Ferreira Lima, Florianópolis, SC, 88.040-900, Brazil

Erik Persson

You can also search for this author in PubMed   Google Scholar

Contributions

AB led the conceptual development and structure of the manuscript. EP conducted the searches and data extraction. All authors contributed to screening and quality appraisal. EP and AF wrote the first draft of the methods section. AB, JB and AF performed result synthesis and contributed to the analyses. AB wrote the first draft of the manuscript and incorporated feedback and revisions from all other authors. All authors revised and approved the final manuscript.

Corresponding author

Correspondence to Annette Boaz .

Ethics declarations

Ethics approval and consent to participate.

Not applicable.

Consent for publication

Competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: appendix a., additional file 2: appendix b., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Boaz, A., Baeza, J., Fraser, A. et al. ‘It depends’: what 86 systematic reviews tell us about what strategies to use to support the use of research in clinical practice. Implementation Sci 19 , 15 (2024). https://doi.org/10.1186/s13012-024-01337-z

Download citation

Received : 01 November 2023

Accepted : 05 January 2024

Published : 19 February 2024

DOI : https://doi.org/10.1186/s13012-024-01337-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Implementation
  • Interventions
  • Clinical practice
  • Research evidence
  • Multi-faceted

Implementation Science

ISSN: 1748-5908

  • Submission enquiries: Access here and click Contact Us
  • General enquiries: [email protected]

what is reviewing the literature in a research paper

  • Open access
  • Published: 17 February 2024

The complexity of leadership in coproduction practices: a guiding framework based on a systematic literature review

  • Sofia Kjellström 1 , 2 ,
  • Sophie Sarre 2 &
  • Daniel Masterson 1  

BMC Health Services Research volume  24 , Article number:  219 ( 2024 ) Cite this article

257 Accesses

Metrics details

As coproduction in public services increases, understanding the role of leadership in this context is essential to the tasks of establishing relational partnerships and addressing power differentials among groups. The aims of this review are to explore models of coproduction leadership and the processes involved in leading coproduction as well as, based on that exploration, to develop a guiding framework for coproduction practices.

A systematic review that synthesizes the evidence reported by 73 papers related to coproduction of health and welfare.

Despite the fact that models of coleadership and collective leadership exhibit a better fit with the relational character of coproduction, the majority of the articles included in this review employed a leader-centric underlying theory. The practice of coproduction leadership is a complex activity pertaining to interactions among people, encompassing nine essential practices: initiating, power-sharing, training, supporting, establishing trust, communicating, networking, orchestration, and implementation.

Conclusions

This paper proposes a novel framework for coproduction leadership practices based on a systematic review of the literature and a set of reflective questions. This framework aims to help coproduction leaders and participants understand the complexity, diversity, and flexibility of coproduction leadership and to challenge and enhance their capacity to collaborate effectively.

Peer Review reports

Introduction

For more than 40 years, scholars and practitioners have sought to identify and understand various aspects of coproduction with the goal of improving services as well as equalizing (or at least reorganizing) power relations in service design and delivery [ 1 ]. More recently, such discussion has focused on the roles of leaders and leadership in coproduction, seeking to describe and assess the various types of leaders and leadership that might maximize the goals of coproduction processes and outcomes. Leaders can act to make coproduction, in all its forms, happen [ 2 , 3 ]. Leaders can enhance coproduction by providing resources, establishing inviting structures, and prioritizing the involvement of various stakeholders. Conversely, they can inhibit coproduction by perpetuating conservative administrative cultures, failing to provide training, or being reluctant to share power [ 3 ]. Coproduction relies on leadership at all levels, ranging from senior managers to local “champions” and including the citizens and third-sector organizations that participate in coproduction activities and practices.

This review presents a synthesis of research on the leadership of coproduction, which has been recognized for its scarcity [ 3 , 4 , 5 , 6 ]. The review provides new knowledge regarding the fact that coproduction leadership must become more deliberately (in)formed by collective leadership models. It also illustrates the multiplicity and complexity associated with coproduction leadership activities by outlining practices in which leaders must engage to ensure success. This review can inform a framework that offers guiding insights on which commissioners, evaluators, managers and leaders of coproduction can reflect as well as suggestions and directions for future research.

  • Coproduction

Coproduction is a broad concept that is associated with different meanings across a range of contexts [ 1 ]. Many definitions and uses of the term coproduction and codesign have been identified [ 7 ]. Throughout this paper, although we acknowledge the distinctions associated with the concepts and origins of the notion of codesign, we use the broad term coproduction to refer to some form of collaboration or partnership between service providers and service users or citizens. For this review, we follow the definitions provided by Osborne and Strokosch [ 8 ], who identified ‘ consumer coproduction’ as an inevitable component of value creation in interactions among service providers; ‘participatory coproduction’, in which context participation is deliberative and occurs at the strategic level of service design and planning; and ‘enhanced coproduction’, which represents a potential mechanism for transforming organizational processes and boundaries.

Power is inevitably central to coproduction. Schlappa and Ymani claimed that the coproduction process is “inherently negotiated, emergent and reliant on a range of actors who may have both common and contrasting motivations, and are able to exercise power, which in turn is moderated by the context in which these relations occur” [ 6 ]. This sensitivity to motivation, context and power is helpful for our understanding of leadership in coproduction.

Leadership models

Most conceptualizations of leadership have been based on the claim that leadership is a kind of inherent characteristic exhibited by human beings, such that leaders are depicted as heroes with unique traits, styles or behaviours [ 9 ]. However, research on leadership in coproduction is important in relation to an emerging body of research that focuses on the notion of “leadership in the plural” [ 10 ] or “collective leadership” [ 11 , 12 ]. These phrases act as umbrella terms that refer to overlapping concepts such as shared, collaborative, distributed, pooled and relational leadership. A core feature of these models is that leadership is not (only) viewed as a property of individuals and their behaviours but rather as a collective phenomenon that is distributed or shared among different people [ 10 ]. A distinction can be made between two types of collective leadership. Leadership can be shared in interpersonal relationships; for example, it can be pooled among duos or trios at the top of an organization, or shared leadership can be exercised within teams working on a project. This notion is based upon the assumption that people have different skills that complement each other. The second kind of collective leadership is a more radical version of this notion, according to which leadership emerges as a result of direction, alignment, and commitment within a group [ 11 ] or can be observed to reside within the system, for example, in the form of distributed leadership across interorganizational and intraorganizational boundaries and networks [ 10 , 12 ]. In cross-sectoral collaboration, leadership is distributed across time and space, which requires structures to guide how leadership is shared and organized. It has been argued that collective leadership is best suited to the analysis of coproduction practices [ 4 , 6 , 13 , 14 ].

It is important to note that distinctions have been made between management (planning, monitoring and controlling) and leadership (creating a vision, inspiring and changing) based on behaviours [ 15 ]. However, many authors have not made such a distinction, and the terms have frequently been used interchangeably. We therefore adopt the practice employed in the papers included in this review and use the terms leadership and leader as catch-all terms; we only use the words management or manager when the papers refer to job titles or ‘public management’.

Leadership models can be regarded as resembling a colour palette that offers a variety of choices, and similar to colours, some models fit a situation better than others. This paper investigates the use and fit of various leadership models for coproduction.

Leadership of coproduction research

Extant research on the leadership of coproduction has been described as “sparse” [ 4 ], a “neglected area” [ 5 ] and “overlooked” [ 3 , 6 ]. Despite a recent resurgence of interest in the potential of coproduction as a means of maintaining and improving the quality of health and social care, significant questions regarding how coproduction can and should be led in this context remain unanswered. Most reviews of coproduction have not addressed this issue [ 2 , 16 , 17 , 18 ]. Clarke et al.’s (2017) review identified the lack of managerial authority and leadership as a key barrier to the implementation of coproduced interventions but did not explore the implications of this finding for future practice. The review conducted by Bussu and Galanti (2018) stands alone in its focus on leadership, although the empirical cases explored by those authors were restricted to the context of local government in the UK. Recent empirical case studies that have explored leadership [ 13 , 14 , 15 , 19 ] have focused on public managers [ 3 , 5 , 14 ] or on identifying the consequences of different models of leadership. This review contributes to the literature by providing knowledge regarding how to make deliberate choices pertaining to coproduction leadership in terms of how it is conceptualized and shared and the activities that are necessary for leading coproduction.

Coproduction leadership practices

The leadership of coproduction poses a number of challenges. A proposed aim of coproduction is to drive change within services and in traditional state-citizen relationships by establishing equal and reciprocal relationships among professionals, the people using services, and their families and neighbours. This task requires a restructuring of health and welfare services to equalize power between providers and other stakeholders with an interest in the design and provision of these services. However, it has been suggested that coproduction runs the risk of reproducing existing inequalities in power rather than mitigating them since coproduction is inevitably saturated with unequal power relations that must be acknowledged but cannot be managed away [ 20 ].

In this paper, we present the findings of a systematic review of the literature on leadership in coproduction. The purpose of this review is to explore models of coproduction leadership and the practices involved in leading coproduction in the context of health and social care sectors [ 7 ]. The results are synthesized to develop a framework for actors who seek to commission, design, lead or evaluate coproduction processes. This framework emphasizes the need to make more deliberate choices regarding the underlying conceptualization of leadership and the ways in which such a conceptualization is related to the activities necessary for leading coproduction. Based on the framework, we also propose specific guiding questions for individuals involved in coproduction in practice and make suggestions for future research.

This systematic literature review is based on a study protocol on coproduction research in the context of health and social care sectors [ 21 ], and data were obtained from a published scoping review, where the full search strategy is provided [ 7 ]. The scoping review set out to identify ‘what is out there’ and to explore the definitions of the concepts of coproduction and codesign. In brief, the following search terms for the relevant concept (co-produc* OR coproduc* OR co-design* OR codesign*) and context (health OR social OR & “public service*” OR “public sector”) were used to query the following databases: CINAHL with Full Text (EBSCOHost), Cochrane Central Register of Controlled Trials (Wiley), MEDLINE (EBSCOhost), PsycINFO (ProQuest), PubMed (legacy), and Scopus (Elsevier). This paper focused on leadership. All titles and abstracts included in the scoping review ( n  = 979) were obtained and searched for leadership concepts (leader* OR manage*) ( n  = 415). These materials were reviewed independently by SK and SS using the following inclusion criterion: conceptual, empirical and reflection papers that included references to the management and/or leadership of coproduction. Study protocols were excluded because we wanted to capture lessons drawn from implementation, and conference papers were excluded because they lacked sufficient detail. Articles focusing on the context of individual-level coproduction (i.e., cases in which an individual client or patient was the focus of coproduction) were excluded, as we were interested in the leadership processes involved in collective coproduction. Conflicts were resolved through discussion and further consideration of disputed papers. This process led to the inclusion of 73 articles (Fig.  1 – PRISMA flow chart).

figure 1

PRISMA flow chart

The method used for this research was a systematic review with qualitative synthesis. The strength of this approach lies in its ability to complement research evidence with user and practitioner considerations [ 22 ]. In the process of examining the full texts of the papers, two researchers (SK and SS) extracted background data independently. To promote coproduction, four stakeholders were strategically selected through the personal networks of one of the authors, SK. These stakeholders exhibited diverse expertise in the leadership of coproduction. One was a leadership developer and family member of an individual with 24/7 care needs. Another was a physician. The third worked in peer support and had personal experience with mental health services. The fourth was a health care leader. Four key articles were chosen due to the diversity of leadership ideas they exhibit and the depth of the explicit text on leadership they provided. During the analysis by stakeholders, no themes were changed or refined; instead, the analysis confirmed the relevance of the initially identified themes, thus emphasizing the robustness of our findings based on a process that involved reading four key articles and identifying the perceived key implications for our research aim.

A qualitative synthesis unites the findings of individual studies in a different arrangement, thereby constructing new knowledge that is not apparent from the individual studies in isolation [ 23 ]. This fact is particularly evident in this review, since leadership was seldom the main focus of the included articles. Accordingly, we employed multiple pieces of information to construct a pattern. The process of synthesis started at a very broad level with the goal of understanding which aspects of leadership were addressed in the literature. This process then separated into two strands. One such strand focused on interpreting the data from the perspective of current leadership models, while the other focused on interpreting leadership practices – i.e., the activities and relationships that are part of the process of leading coproduction. We searched for themes both within and across individual articles, and our goal was interpretative rather than purely aggregative. This process resulted in three themes pertaining to coproduction leadership models and nine coproduction leadership practices. We present these findings together in the form of a framework because consideration of both leadership models and practices prompts better and more conscious choices, which can improve the quality of coproduction. Persons one and two from the stakeholder group also provided feedback on a draft of this paper, and their insights were integrated into this research.

Sample description

We included 73 papers (Additional file 1 ) dating from 1994 to 2019 (the year in which the initial search was performed). Most of these papers were empirical ( n  = 54), and more than half of them were case studies ( n  = 30). Fifteen articles were conceptual papers, and four were literature reviews. The setting or focus of the papers was predominantly on services ( n  = 66), while the remainder of the papers were on research ( n  = 4) or policy ( n  = 3). The papers drew on evidence collected from 13 countries, and the most common national setting was the UK ( n  = 29). Nine cross-national papers were also included. Issues related to leadership were rarely the focus of the papers.

Results: A coproduction leadership framework

The synthesis consists of three parts (roles, models and practices), which are combined to develop an overarching and integrative framework for essential issues pertaining to coproduction leadership [ 4 , 24 ].

People and roles

The way in which the leadership of coproduction has been conceptualized in the literature suggests that a range of actors are involved in the coproduction of health and wellbeing and that these actors can take on different leadership roles and functions. Service users, community members and community representatives can play a vital role in the task of deliberatively coproducing or even transforming services, as can third-sector organizations, external experts, politicians, mid-level facilitators, managers, and senior leaders.

It has been argued that it is important to involve leaders from diverse backgrounds who have personal experiential knowledge of public involvement to encourage involvement from a broader population [ 25 , 26 , 27 ]. Service users and community members play leadership roles in coproduction initiatives related to health or well-being. These roles involve shared decision-making and accountability at various levels, ranging from the personal to the systemic.

Senior leaders include formal representatives of organizations (executives, politicians, or formal managers) and formal or respected leaders of communities. They play an important role throughout this process. During the initiation stage, by implementing and sustaining the outcomes of coproduction, they play a crucial role in the provision of resources such as time, money, materials, and access to networks. In the interim stages, their commitment to coproduction, sponsorship, and engagement is vital.

Champions and ambassadors use their expertise and passion to drive coproduction efforts. In particular, "insider" champions can establish trust among participants and help service providers understand the importance of coproduction. These champions advocate for coproduction and actively support initiatives [ 28 , 29 , 30 , 31 ]. Ambassadors are individuals who have expertise and volunteer their time to train others or work with clients in coproduced services. They play a crucial role in the tasks of supporting and promoting coproduction [ 28 , 32 , 33 ].

Project leaders and facilitators are individuals who are responsible for guiding and supporting coproduction projects, thereby ensuring their smooth operation and collaborative nature. Project leaders are responsible for overall project management, including the setting of goals, objectives, and timelines. They play a pivotal role in ensuring that projects remain on track, and they facilitate accessible and transparent dialogue among stakeholders and ensure equal representation [ 34 , 35 ]. Facilitators focus on supporting the group involved in coproduction, maintaining respectful interactions, empowering service users and carers, and addressing any tensions that may arise during the collaborative process [ 36 , 37 ].

In summary, senior leaders sponsor and support coproduction. Champions and ambassadors are individuals who advocate for and support coproduction initiatives, while project leaders and facilitators are responsible for managing and guiding coproduction projects themselves, thereby ensuring effective collaboration among stakeholders. All of these roles can be played by people drawn from various backgrounds, including senior staff, health care professionals, experts in coproduction, researchers, citizens, or volunteers.

Three models of leadership in coproduction

These actors play different leadership roles, and leadership can be exercised by individuals or groups. Three leadership models have been proposed: leadership as enacted by individual leaders, coleadership and collective leadership.

Leadership by individual leaders

A leader-centric view has been the dominant interpretation of leadership in the field of coproduction. Many references were made to “senior leaders”. This term was used to describe formal representatives of organizations or services (senior managers, executives), formally appointed community leaders (policy-makers, local government leaders), or respected leaders of communities. Senior support was described as an important success factor in coproduction [ 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 ]. Other leadership roles included project leaders, facilitators, ambassadors, and champions – as described in the previous section.

Some papers referred to traits and characteristics exhibited by leaders that facilitate coproduction. These factors included innovativeness, personability, action orientation [ 46 ], courage [ 47 ], passion [ 32 , 46 ], and empathy [ 25 , 46 , 48 ]. “Strong leadership” was often mentioned, albeit without elaboration [ 49 , 50 , 51 , 52 , 53 , 54 , 55 ]. By implication, “strong leadership” appeared to include providing clear direction and guidance, having a clear vision [ 53 ], holding onto a vision [ 34 ], and keeping the vision alive for the team [ 43 ].

Other researchers noted a more collaborative and democratic leadership style that is characterized by listening, transparency, deliberation, and nurturing coproductive behaviours [ 27 , 30 , 48 ]. Senior leaders could use a “top-down” approach to promote user involvement. Alternatively, they could “learn to manage horizontally not top down; embrace ground up initiatives; [and] aim to empower partners” [ 32 , 45 , 51 ] and be “open to changes that would disturb traditional relationships and power disparities between service users and providers” [ 41 ]. Respondents to a survey of participants in a peer-led support network favoured a traditional directive model of leadership alongside a more facilitative and enabling style [ 56 ]. However, they found it challenging to transition to a more distributed and collective leadership approach.

Co-leadership

The terms “co-lead”, “co-leadership” and “dual leadership” refer to situations in which a formal leadership role is allocated to more than one person, in which context the relevant people may represent different institutions or different groups, e.g., different professional groups, researchers and service users/citizens, or teachers and students [ 28 , 31 , 40 , 41 , 57 , 58 ]. Coleads were defined as “individuals who led and made joint decisions” [ 59 ]. Some papers explored the leadership role of service users or community members in the coproduction of research related to health or wellbeing [ 35 , 60 , 61 ]. In these studies, areas of research were proposed by patients/community members, who then collaborated with academic researchers, thereby playing an equal or leading role. Coleadership was reported to result in shared learning.

Collective leadership

Few discernible differences among “ shared”, “distributed” and “collective” leadership were found in the papers included in this review. The approaches examined in this context were characterized by distributed roles and responsibilities in which different individuals’ skills and expertise were identified as best suited to the task at hand. Shared leadership depends on willingness on the part of leaders (implicitly non-community leaders) to be challenged and directed by community members rather than rigidly maintaining their previous conceptions of the issues and the appropriate means of addressing them [ 36 ].

Ward, De Brún, Beirne, Conway, Cunningham, English, Fitzsimons, Furlong, Kane and Kelly [ 62 ] referred to collective leadership as an emergent and dynamic team phenomenon. Other authors argued for a more structured approach to shared leadership [ 36 , 41 ] or distributed leadership [ 28 , 42 , 56 , 59 , 63 ]. Such an approach could involve allocating specific roles to service users, engaging them in a formal structure and/or enabling them to set an agenda [ 41 ], specifying shared roles and responsibilities [ 36 ], and/or providing dedicated support to lay “champions” in research studies [ 28 ]. Various benefits were attributed to collective leadership, such as empowering people to speak up [ 36 , 51 ] and feel engaged.

Nine practices associated with leading coproduction

We identified nine processes that encompass wide-ranging activities and interactions between individuals and groups with regard to leading the coproduction of health and wellbeing. As Farr noted, “Coproduction and codesign […] involves facilitating, managing and co-ordinating a complex set of psychological, social, cultural and institutional interactions” [ 64 ]. In some cases, these processes naturally align with certain actors—for instance, senior leaders play key roles in the tasks of initiating coproduction and implementing and sustaining its results—but other processes (championing coproduction, establishing trusting relationships, and ensuring good communication) are applicable to any and all participants in the coproduction process. Similarly, some of these practices occur at particular timepoints in a coproduction arc (namely, during the stages of initiation or implementation), while others can occur at any or all timepoints (i.e., during the assimilation stage or beyond). Deliberately considering the most suitable leadership model with regard to the aims and context of an initiative is useful at the start, but reflecting on the operation and appropriateness of the model is always salient.

Initiating coproduction

The initiation of coproduction entails recognizing the need for coproduction, dedicating resources, inviting and establishing relevant multi-stakeholder coproduction networks, and coproducing a vision and goals.

It has been argued that senior leaders act as gatekeepers for coproduction because they must recognize the need for it [ 45 ]. Senior leaders play a role in the task of determining the extent to which communities are given the opportunity to influence service design and integration [ 38 , 51 ]. Coproduction requires resources (principally time and money but also networks), which can be used to take advantage of other resources such as skills [ 29 , 31 , 34 , 40 ]. Senior leaders often control or provide access to such resources, which means that they are best positioned to initiate coproduction initiatives [ 41 , 65 ]. However, the findings of a cross-national study on the coproduction of policy showed that, in practice, senior leaders’ control over resources meant that they tended to define the means, methods and forms of participation [ 65 ].

In the task of establishing a conducive environment for coproduction, it is important to pay attention to which actors (organizations or individuals) are participating in the process [ 33 , 42 , 64 , 66 ] and to factors that may delimit those participants or their involvement [ 36 , 42 , 67 ]. Several papers emphasized the need to ensure that all stakeholders are involved from the outset [ 37 , 38 , 41 , 48 , 51 ]. In the initiation stages, a shared vision should be created [ 36 , 61 , 68 ], goals should be coproduced, and responsibilities should be clearly allocated [ 65 ]. Role clarity, ability, and motivation have been identified as determinants of coproductive behaviour, and leaders must implement arrangements to achieve these goals for coproducers [ 69 ].

Power sharing

It has been argued that coproduction leadership must attend to issues pertaining to power redistribution [ 60 , 61 , 63 , 64 ] and uphold the ideology of coproduction by promoting the values of democracy and transparency [ 30 , 32 , 70 , 71 , 72 , 73 , 74 ]. This process can occur at different levels.

At the macro system level, several cultural shifts have been implicated in the redistribution of power – a shift in current professional and stakeholder identities; more fluid, flattened and consensus-based ways of working; and a willingness to accommodate ‘messy’ issues [ 75 ]. The last of those issues was highlighted by Hopkins, Foster and Nikitin [ 29 , s 192], who suggested that coproduction requires service providers to “sit more easily with the unknown, to be comfortable in not having all the answers.” Similarly, “The challenge is that to be transformative, power must be shared with health service users. To do this entails building new relationships and fostering a new culture in health-care institutions that is supportive of participatory approaches” [ 42 , p 379].

At the meso level, several practices could be used to share power. Greenhalgh, Jackson, Shaw and Janamian [ 30 ] identified the importance of equitable decision-making practices and “evenly distributed power constellations.” This goal can be achieved, for instance, by ensuring that service users represent a majority on the project management committee or in codesign events with the goal of challenging dominant professional structures and discourses [ 37 ]. Other scholars called for clear roles and responsibilities [ 38 , 59 , 65 ]. Mulvale, Moll, Miatello, Robert, Larkin, Palmer, Powell, Gable and Girling [ 36 ] recommended the establishment of shared roles and responsibilities, the creation of a representative expert panel to resolve stalemates, and possibly the implementation of formal agreements regarding data and reporting. Importantly, however, Greenhalgh, Jackson, Shaw and Janamian [ 30 ] noted that governance structures and processes alone do not automatically overcome the subtle and inconspicuous uses of power. Farr [ 64 ] recommended the constant practice of critical reflection and dialogue and posed several questions for participants to consider: who is involved, what the interactions are like, how coproduction efforts are implemented within and across structures, and what changes are made.

Although sharing power has been described as an essential component in coproduction, the involvement of stakeholders does not necessarily entail empowerment [ 47 ], and case studies have demonstrated that service improvement initiatives that involve citizens or service users can be instrumental and effective with regard to improving services without enhancing or sharing power or political consciousness if stakeholders are invited but power is not shared [ 32 ]. Farr [ 64 ] noted that rather than coproduction being inherently emancipatory, coproduction and codesign processes can have either dominating or emancipatory effects [ 33 ], and the exclusion of vulnerable groups from coproduction has the potential to reinforce existing inequities [ 75 ].

Training and development for emerging leadership

The importance of appropriate training and mutual learning was noted in several papers [ 36 , 42 , 48 , 63 , 69 , 76 , 77 ]. Implicitly, training for professionals was framed in terms of training in the process of sharing power with service users or facilitating collaboration, whereas training for service users was framed as capacity-building in terms of collaboration and/or leadership. In one case study focusing on coproduced research, participants rejected the notion of “training” from academic researchers with the aim of avoiding suggesting that a certain level of “expertise” needed to be transferred [ 60 ].

Playing a leadership role can be empowering [ 51 , 71 ], but for some individuals, it can be overwhelming [ 71 ]. Leading coproduction requires practice and the development of skills and capacities [ 26 , 48 ]. In some initiatives, lay partners were initially involved in limited roles and gradually took on more responsible leadership tasks over time [ 28 , 42 , 78 ]. In addition, community members’ level of involvement was flexible—they could be participants or take on additional roles as volunteers, paid staff members or directors of organizations. This flexibility offered participants the opportunity to "begin sharing, as opposed to shouldering, the burden of involvement” [ 71 ].

The provision of support

Support is necessary throughout the coproduction process from its outset to the stages of implementation and sustainment [ 25 , 34 , 68 ]. Key dimensions of support include facilitating, advocating for, and championing coproduction. Project management is instrumental to the smooth operation and facilitation of coproduction [ 34 , 35 , 37 , 44 ]. Several facilitation activities are conducted by project leaders and facilitators [ 41 , 42 , 59 , 61 , 78 ]. These activities include holding onto a vision and keeping it alive for the team, ensuring that the project remains on track, and helping maintain momentum. In one codesign case study, facilitators helped people focus on quick wins with the goal of maintaining motivation and engagement; they "needed to support movement from inaction to action, by sifting through group ideas to fix a plan" [ 34 ]. Although these authors acknowledged that this approach may have limited coproduction, they argued that such initiatives would not be sustainable if they were perceived to be “unfeasible.”

Another key function entails advocating for and championing coproduction initiatives to ensure that the process remains ongoing [ 25 , 28 , 29 , 30 , 31 , 32 , 37 , 41 , 74 , 79 ]. Senior leaders play an important role in the task of championing coproduction, and their support has often been described as an important success factor [ 34 , 38 , 39 , 43 , 80 ]. However, effective champions could equally include health care professionals [ 37 ], experts in coproduction [ 51 ], researchers [ 35 , 60 , 61 ], volunteers [ 51 ] or other citizens [ 41 , 61 ]. Champions with lived experience can gain the confidence of their peers and help create understanding among service providers [ 28 , 36 ].

Establishing trusting relationships

Coproduction is essentially relational and requires concerted efforts to establish trusting relationships and a sense of commitment. The importance of trust among stakeholders in coproduction has been noted in several papers [ 28 , 30 , 36 , 37 , 38 , 46 , 48 , 64 , 74 , 81 , 82 ]. In the field of health research, it is difficult to secure funding for the process of establishing relationships and working in the context of partnerships during the early stages of development [ 25 ]. It can therefore be helpful to base recruitment for coproduction initiatives on pre-existing trusting relationships [ 36 ]. If such pre-existing trusting relationships do not exist, policy-makers and senior leaders play a role in the creation of frameworks that can facilitate the development of trust both among organizations and between organizations and citizens, such as political and bureaucratic commitment on the part of regional and local governments and the engagement of actors who play a “boundary-spanning” role in the relationships between service providers, non-government organizations and communities [ 38 ]. Trust is established based on clear responsibilities [ 38 ] and adherence to the principles of engagement in coproduction. In addition to these frameworks, individual leaders must develop trust through interactions with coproducers, using collaborative skills such as those pertaining to communication and listening [ 48 ]. In one case study, through the frank sharing of the organizational, financial, and governance challenges and opportunities faced by stakeholders, people reached a growing understanding and appreciation of each other’s positions, which engendered trust [ 30 ]. Mulvale, Moll, Miatello, Robert, Larkin, Palmer, Powell, Gable [ 36 ] highlighted the importance of understanding and responding to participants’ histories, contexts, and cultural differences.

Commitment can be viewed as more important than resources [ 59 ]. The commitment to and engagement in coproduction exhibited by an organization’s senior leaders demonstrate organizational commitment and lend credibility to coproduction initiatives [ 25 , 34 , 38 , 41 , 47 , 59 , 80 , 83 ]. On some occasions, coproduction initiatives are reported to senior leaders, while on other occasions, the senior leaders were part of the coproduction team. Senior leaders who adopt a more hands-on approach serve as role models [ 25 ], advocating for patient engagement and engendering commitment on the part of staff and patients [ 28 ]. In public health initiatives, buy-in from community leaders confers legitimacy on innovations, helps ensure community trust [ 61 , 78 ], increases the engagement of community members [ 78 ] and is key to a project’s success [ 83 ].

Communication

Communication is a key activity in coproduction, and leaders must establish an environment that is conducive to “epistemological tolerance” [ 47 ], such that different perspectives are valued and appreciated. Such environments facilitate dialogue among partners [ 28 , 30 , 35 , 51 ] and allow critical voices to be heard [ 42 ] . Open dialogue among stakeholders is a starting point for the task of identifying the sources of assumptions and stereotypes, which is itself a prerequisite for change in attitudes and practice [ 28 ]. Project leaders must also facilitate accessible and transparent dialogue and ensure the equal representation of all stakeholders, including those who are less able to communicate verbally [ 57 , 71 ]. Professional leaders are responsible for critically reviewing their professional norms, organizational/institutional processes and past and present policies and practices [ 55 , 75 ].

Dealing with multiple stakeholders, which is inevitably required in coproduction, requires addressing multiple perspectives in an attempt to bring them together. This task frequently involves a degree of conflict and peace negotiation [ 30 , 34 , 41 , 48 , 61 , 64 ]. Leaders should be alert to conflict and power dynamics [ 34 , 36 ]. It may be necessary for meeting chairs to encourage participants to move on from their familiar, entrenched positions to avoid descending into circular arguments and stalemates (Chisholm et al. 2018). This task could require the injection of a critical voice, as Greenhalgh explained:

“Meeting chairs were selected for their leadership qualities, ability to identify and rise above “groupthink” (bland consensus was explicitly discouraged), and commitment to ensuring that potential challenges to new ideas were identified and vigorously discussed. They set an important ethos of constructive criticism and creative innovation, with the patient experience as the central focus. They recognized that if properly handled, conflict was not merely healthy and constructive, but an essential process in achieving successful change in a complex adaptive system. ” [ 30 ]

Leaders must acknowledge the facts that discomfort can arise when more equitable relationships are established [ 61 ] and that challenges to professional identity [ 84 ] and the loss of control [ 72 ] are factors in this process.

Networking refers to the practice of establishing and maintaining relationships with various stakeholders both within and outside the coproduction initiative. Since coproduction involves working with different stakeholders in networks, several papers have discussed the vital mediating processes associated with this context.

“Bridging, brokering and boundary spanning roles have a key role in cross fertilization of ideas between groups, for generating new ideas and for increasing understanding and cooperation” [ 32 , 53 ].

In policy-making, it is helpful to develop coordination structures and processes such as cross-sector working groups and committees, intersector communication channels [ 65 ], and relationship and dialogue structures [ 42 ]. Community representatives can play a mediating role between individuals and public organizations and may alleviate professionals’ concerns regarding the transaction costs of coproduction in the planning and management of services [ 26 , 81 ]. However, these representatives may or may not use this power to amplify the voices of individual coproducers [ 81 ].

An important role of project leaders is that of the “broker” [ 32 , 85 ], who focuses on mediating among different stakeholders in an attempt to align their perspectives [ 26 ,  37 ,  72 , 86 ]. Another role focuses on spanning the boundaries across sites [ 50 ], between local service providers [ 68 ], or among local services, non-government organizations and the community [ 38 ]. Bovaird, drawing on a number of cases of coproduction, came to the following conclusion:

“ there is a need for a new type of public service professional: the coproduction development officer, who can help to overcome the reluctance of many professionals to share power with users and their communities and who can act internally in organizations (and partnerships) to broker new roles for coproduction between traditional service professionals, service managers, and the political decision-makers who shape the strategic direction of the service system.” [ 81 ]

Orchestration

This practice involves reflecting on and improving coproduction itself. It includes activities such as evaluating the effectiveness of coproduction efforts, assessing the impact of coproduction on outcomes, and making adjustments to improve the coproduction process. Several papers have addressed the roles of local government or public managers or health professionals in overseeing and (as we refer to this process) ‘orchestrating’ the networks involved in coproduction at the community or local government level [ 30 , 33 , 65 , 74 , 87 ]. Orchestration involves recruiting the appropriate actors as noted above as well as directing and coordinating activities, thereby ensuring that the whole is more than the sum of its parts. As part of their orchestration work, leaders play a role in the task of managing risk in service innovation [ 55 , 87 ] and must commit to self-reflexivity and a critical review of norms, policies and practices to alert themselves to any unintended negative consequences and strive to counteract them [ 55 ]. Sturmberg, Martin and O’Halloran [ 88 ] used the metaphor of ‘conducting’ to describe the function of leadership in health care – i.e., leading the orchestra through inspiration and empowerment rather than control, leading to the provision of feedback as the performance unfolds.

From a public service perspective, Powers and Thompson [ 69 ] argued that coproduction requires the leader (“usually a public official”) to mobilize the community on behalf of the public good, organize the provision of the good, create incentives, and supervise the enforcement of community norms. Sancino [ 74 ] argued that local governments play a ‘meta-coproduction role’ that requires them to maximize the coproduction and peer-production of community outcomes by taking into account community contributions and deciding which services should be commissioned or decommissioned (a point that was also made by Wilson [ 87 ]) and to promote coproduction and peer-production in such a way as to promote the coproduction of outcomes that have been decided through a democratic process. In this way, he argued,

"the local government becomes the pivot of different kinds of relationships and networks made up of different actors who collectively assume the responsibility for implementing an overall strategic plan of the community beyond their specific roles and interests." [ 74 ]

Sancino [ 74 ] attempted to draw out the leadership implications of this situation, arguing that rather than focusing on service delivery, public managers must create appropriate conditions for such meta-coproduction. This task entails a directing role based on framing shared scenarios for change in the community through sense-making; an activator role based on activating, mobilizing and consolidating the social capital of the community to promote diffused public leadership; a convenor role based on serving as a meta-manager in the process of self-organizing the knowledge, resources and competencies pertaining to the community in question; and an empowering role based on creating conditions in which peer production and coproduction can be combined to create the corresponding added value (i.e., higher levels of community outcomes) [ 74 ]. This practice essentially focuses on self-assessment and continuous improvement within the coproduction framework.

Implementation

It has been argued that coproduction in services [ 30 , 79 ] or policy-making [ 65 ] may improve implementation. The role of leadership in supporting the implementation of the outcomes of coproduction is essential [ 37 , 41 , 49 , 52 , 64 , 65 , 85 , 86 ]. Leaders can argue for the legitimacy of coproduced innovations [ 89 ] and implement mechanisms aimed at acting on the issues thus raised and continuing to promote patients’ involvement [ 28 , 41 ]. Implementing the outcomes of coproduction relies on outcome-focused leadership [ 30 ]. The results of coproduction initiatives must be transformed into strategic plans and policies [ 41 ], and patient perspectives must be translated into actionable quality improvement initiatives [ 49 ]. Conversely, implementation can be blocked by leaders who fail to respond to the results of coproduction initiatives or who implement policies or procedures that are poorly aligned with the recommendations arising from coproduction [ 30 , 41 ]. It should also be acknowledged that not all demands thus generated can always be met [ 61 ]. Failures of implementation run the risk of stakeholder disillusionment; thus, the management of expectations is important.

A framework for coproduction leadership

When coproduction is initiated, it is possible to consider the actors involved and to imagine various forms of coproduction. In the design process, it is possible to make a deliberate choice with regard to the most appropriate model of leadership, and depending on the leadership model selected (leader-centric, coleadership, or collective leadership), different leadership practices emerge. The nine leadership practices identified can be enacted by different people and in different ways. The leadership of coproduction that thus emerges is shaped by issues such as the model of coproduction, the stakeholders involved, participants’ motivations and the context of coproduction. A main concern lies in the need to design project structures and work practices that are aligned and that enable leadership to emerge. We thus created a table (Table  1 ) that illustrates potential reflective questions in this context.

This discussion highlights and problematizes the two main findings of this systematic review, namely, the need to deliberately consider underlying models of leadership and the complex character of leading coproduction.

The need for the deliberate use of leadership in the plural

A focus on leader-centric approaches and the quality of leaders has characterized public leadership research [ 90 ]. Such a focus is echoed in our findings on coproduction leadership, first with regard to the prominence of senior leaders and, to a lesser extent, facilitators. Politicians were rarely identified in the papers included in our review despite representing some of the main actors identified in a previous review [ 4 , 91 ]. Second, many papers referenced the need for “strong” leaders, and the skills and behaviours of individual leaders were noted. As other researchers have found, despite the focus of this field on relationships and interactions, its emphasis has frequently remained on the individual leader and their ability to engage and inspire followers [ 13 ]. Furthermore, even in papers that emphasized ‘coleadership’ or ‘collective leadership,’ the focus remained on public managers, service managers and facilitators. Very little evidence has been reported concerning individual service users’ or citizens’ leadership of (as distinct from involvement in ) coproduction. Although the involvement of community leaders was reported to play a role in project success, no articles explored this issue.

However, some important exceptions should be noted. For example, some studies exhibited a preference for mixed models, employing both a directive approach (particularly in the beginning) and a more facilitative and distributed leadership approach [ 56 ]. Rycroft-Malone, Burton, Wilkinson, Harvey, McCormack, Baker, Dopson, Graham, Staniszewska and Thompson [ 53 ] concluded that consideration should be given to models that combine hierarchical, directive structures with distributed facilitative forms of leadership.

One explanation for this rather narrow view of leadership is that despite the rapidly increasing number of publications in the general field of coproduction [ 7 , 18 ], empirical studies have still lacked depth with regard to investigations of the leadership of this process. Most empirical studies included in this review mentioned leadership only in passing or derived some conclusions regarding leadership from case studies focusing on other aspects of the coproduction process.

Another explanation for this situation is that although coproduction focuses on partnership, in most cases, senior leaders have control over resources and the power to define the means, methods, extent and forms of participation [ 65 ]. Even shared leadership models seem to rely on traditional leaders’ willingness to share power [ 10 ], as leaders are the actors who invite, facilitate, and support the participation of coleaders. However, some signs of change towards a broader view should be noted. Recent publications have theorized the leadership of coproduction and included case studies that have demonstrated leadership to be a social, collective and relational phenomenon that emerges as a property of interactions among individuals in given contexts [ 13 , 19 ].

The complexity of coproduction leadership practices

Our findings indicate that the leadership of coproduction practices entails challenging and complex tasks. Complexity emerges in cases in which many parts are interrelated in multiple ways. Different kinds of leadership activities may be necessary depending on the stakeholders involved [ 92 ], the context [ 13 ], and the mode, level, and phase of coproduction [ 93 ]. A complexity perspective based on systems thinking is therefore useful [ 13 , 19 ]. All actors involved in coproduction are potential leaders, but for that potential to be realized, the coproduction initiative and its leadership must be framed and comprehended in a more plural way. A recent study on systems thinking and complex adaptive thinking as means of initiating coproduction advocated a collective leadership approach [ 19 ].

Our findings highlight the need for a complex way of making meaning of leadership throughout the coproduction process, such as the ability to be flexible due to circumstances and employ both strong leadership and more facilitative approaches when necessary. Leaders must also promote the values of democracy, transparency and the redistribution of power among stakeholders throughout the process [ 64 , 94 ]. These practices and tasks are complex, which must be matched by an inner mental complexity [ 95 , 96 ]. Several practices identified in this research, such as genuinely valuing diverse perspectives, promoting mutual transformative power sharing and welcoming conflicts, require a complex mode of meaning-making that results from psychological development. These issues warrant further exploration. Future studies featuring a thoughtful choice of leadership and complexity models as well as a broader methodological repertoire are thus necessary (see Table  2 for an overview).

Methodological strengths and limitations

A strength of this review lies in its integration of research on the sparse and overlooked issue of leadership in coproduction. Our search strategy, which involved using the key words manag* and lead*, may have excluded some relevant papers. To verify that this approach did not represent an excessively blunt exclusion criterion, we checked 10% of the articles that were excluded based on this criterion. All of these articles would also have been excluded for failing to include any exploration of the management or leadership of coproduction. We therefore determined that this exclusion criterion was justifiable. Many papers did not have an explicit focus on leadership; however, by synthesizing the data, all data were treated as reflections that jointly created a larger pattern, similar to a kaleidoscope. The exclusion of non-peer-reviewed papers is likely to have led to the exclusion of coproduced outputs, which may have offered important insights into the leadership of coproduction, particularly with regard to the experiences of service users and citizens playing leadership roles. In the reporting of this review, the PRISMA guidelines were followed (Additional file 2 ). It should be noted that the lack of reporting bias assessment and certainty assessment represents a limitation of this study.

Future research

Future research (see Table  2 ) should focus on under-represented roles, such as those of politicians and community leaders, and explore emerging collective leadership models based on real-time observational studies. It should also investigate the balance between strong and shared leadership by using qualitative and participatory research methods. Incorporating systems thinking and relevant leadership models can offer new perspectives on collective leadership practices.

Practical implications

This paper explored coproduction leadership practices and revealed that they require a deliberate and plural understanding of leadership roles and tasks. We proposed a framework for coproduction leadership that takes into account the actors involved, the models of leadership, and the leadership practices that emerge in different contexts and during different phases of coproduction. We also provided a set of reflective considerations that can help all actors involved in this process make more deliberate choices regarding the parties involved, leadership models of coproduction, and practices (Table  1 ).

Our systematic review revealed some gaps in the literature on coproduction leadership, such as the lack of attention to the mental complexity of coproduction leaders, the under-representation of service users and citizens as leaders, and the need for more empirical studies that use appropriate models and methods to capture the complexity of coproduction leadership. We suggest that future research should address these gaps, thus contributing to the advancement of coproduction theory and practice.

Our framework also has some practical implications for coproduction leaders and participants. At the start of coproduction process, all people, particularly leaders, must learn more about different models of leadership and how power is shared. Throughout this process, flexibility is necessary because leadership constellations change over time; they emerge and fade away, thus implying different underlying leadership models. A multitude of practices must be implemented throughout the coproduction process. People in leader roles must be aware of their personal strengths and limitations, not only with the goal of sharing leadership but also with the aim of establishing partnerships with others who have competence in certain practices, such as facilitation or addressing conflicts. Reflecting upon the guiding questions can also help illustrate the extent to which power and leadership are being shared. In conclusion, to create more equal power relations over time, we must challenge our current practices and work deliberately to enhance the capacity of individuals and groups to effectively engage in coproduction leadership.

Osborne SP, Radnor Z, Strokosch K. Co-production and the co-creation of value in public services: a suitable case for treatment? Public Manag Rev. 2016;18(5):639–53.

Article   Google Scholar  

Voorberg WH, Bekkers VJJM, Tummers LG. A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey. Public Manag Rev. 2015;17(9):1333–57.

Gassner D, Gofen A. Coproduction investments: Street-level management perspective on coproduction. Cogent Business Management. 2019;6(1):1617023.

Bussu S, Tullia Galanti M. Facilitating coproduction: the role of leadership in coproduction initiatives in the UK. Policy Society. 2018;37(3):347–67.

Brown PR, Head BW. Navigating tensions in co-production: A missing link in leadership for public value. Public Administration (London). 2019;97(2):250–63.

Schlappa H, Imani Y: Who is in the lead? New perspectives on leading service co-production. In: Co-production and co-creation. edn.: Routledge; 2018: 99–108.

Masterson D. Mapping definitions of co-production and co-design in health and social care:systematic scoping review providing lessons for the future. Health Expect. 2022;25(3):902–13.

Article   PubMed   PubMed Central   Google Scholar  

Osborne SP, Strokosch K. It takes Two to Tango? Understanding the C o-production of Public Services by Integrating the Services Management and Public Administration Perspectives. Br J Manag. 2013;24:S31–47.

Parry KW, Bryman A: Leadership in organizations. In: The SAGE Handbook of Organization Studies. edn. Edited by Clegg SR, Hardy C, Lawrence TB, Nord WR. London: SAGE; 2006: 446–468.

Denis J-L, Langley A, Sergi V. Leadership in the plural. Acad Manag Ann. 2012;6(1):211–83.

Drath WH, McCauley CD, Palus CJ, Van Velsor E, O’Connor PMG, McGuire JB. Direction, alignment, commitment: Toward a more integrative ontology of leadership. Leadersh Q. 2008;19(6):635–53.

Ospina SM, Foldy EG, Fairhurst GT, Jackson B. Collective dimensions of leadership: Connecting theory and method. Human Relations. 2020;73(4):441–63.

Schlappa H, Imani Y, Nishino T. Relational leadership: an analytical lens for the exploration of co-production. In: Loeffler E, Bovaird T, editors. The Palgrave Handbook of Co-Production of Public Services and Outcomes. edn.: Springer; 2021. p. 471–90.

Loeffler E. Co-production of public services and outcomes. 1st ed. In: The Palgrave Handbook of Co-Production of Public Services and Outcomes. Cham, Switzerland: Palgrave Macmillan; 2021. p. 387–408. https://link.springer.com/book/10.1007/978-3-030-55509-2 .

Kotter JP. Force for change: how leadership differs from management: Simon and Schuster; 2008.

Palumbo R. Contextualizing co-production of health care: a systematic literature review. Intern J Public Sector Management. 2016;29(1):72–90.

Palumbo R, Manesh MF: Travelling along the public service co-production road: a bibliometric analysis and interpretive review. Public management review 2021:1–37.

Fusco F, Marsilio M, Guglielmetti C. Co-production in health policy and management: a comprehensive bibliometric review. BMC Health Serv Res. 2020;20(1):504–504.

Docherty K: Exploring Collective Leadership and Co-Production: An Empirical Study. In: Processual Perspectives on the Co-Production Turn in Public Sector Organizations. edn.: IGI Global; 2021: 130–155.

Turnhout E, Metze T, Wyborn C, Klenk N, Louder E. The politics of co-production: participation, power, and transformation. Current Opinion Environmental Sustainability. 2020;42:15–21.

Kjellström S, Areskoug-Josefsson K, Andersson Gäre B, Andersson A-C, Ockander M, Käll J, McGrath J, Donetto S, Robert G. Exploring, measuring and enhancing the coproduction of health and well-being at the national, regional and local levels through comparative case studies in Sweden and England: the “Samskapa” research programme protocol. BMJ Open. 2019;9(7):e029723–e029723.

Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108.

Article   PubMed   Google Scholar  

Denyer D, Tranfield D: Producing a Systematic Review. In: The Sage handbook of organizational research methods. edn. Edited by Buchanan D, Bryman A: Sage Publications Ltd; 2009.

Sicilia M, Sancino A, Nabatchi T, Guarini E. Facilitating co-production in public services: management implications from a systematic literature review. Public Money Management. 2019;39(4):233–40.

Staniszewska S, Denegri S, Matthews R, Minogue V. Reviewing progress in public involvement in NIHR research: developing and implementing a new vision for the future. BMJ Open. 2018;8(7):e017124.

Byrne L, Stratford A, Davidson L. The global need for lived experience leadership. Psychiatr Rehabil J. 2018;41(1):76.

Nicol E, Sang B. A co-productive health leadership model to support the liberation of the NHS. J R Soc Med. 2011;104(2):64–8.

Hafford-Letchfield T, Simpson P, Willis PB, Almack K. Developing inclusive residential care for older lesbian, gay, bisexual and trans (LGBT) people: An evaluation of the Care Home Challenge action research project. Health Soc Care Community. 2018;26(2):e312–20.

Hopkins L, Foster A, Nikitin L. The process of establishing Discovery College in Melbourne. Ment Health Soc Incl. 2018;22(4):187–94.

Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q. 2016;94(2):392–429.

Green S, Beveridge E, Evans L, Trite J, Jayacodi S, Evered R, Parker C, Polledri L, Tabb E, Green J. Implementing guidelines on physical health in the acute mental health setting: a quality improvement approach. Int J Ment Heal Syst. 2018;12(1):1–9.

Poocharoen O-o. Ting B: Collaboration, co-production, networks: Convergence of theories. Public Manag Rev. 2015;17(4):587–614.

Topp SM, Sharma A, Chileshe C, Magwende G, Henostroza G, Moonga CN. The health system accountability impact of prison health committees in Zambia. International journal for equity in health. 2018;17(1):74–74.

Chisholm L, Holttum S, Springham N. Processes in an experience-based co-design project with family carers in community mental health. SAGE Open. 2018;8(4):2158244018809220.

Mader LB, Harris T, Kläger S, Wilkinson IB, Hiemstra TF. Inverting the patient involvement paradigm: defining patient led research. Res Involv Engagem. 2018;4(1):1–7.

Mulvale G, Moll S, Miatello A, Robert G, Larkin M, Palmer VJ, Powell A, Gable C, Girling M. Codesigning health and other public services with vulnerable and disadvantaged populations: Insights from an international collaboration. Health Expect. 2019;22(3):284–97.

Larkin M, Boden ZV, Newton E. On the brink of genuinely collaborative care: experience-based co-design in mental health. Qual Health Res. 2015;25(11):1463–76.

Farooqi SA. Co-production: what makes co-production work? Evidence from Pakistan. Int J Public Sect Manag. 2016;29(4):381–95.

Murphy L, Wells JS, Lachman P, Bergin M. A quality improvement initiative in community mental health in the Republic of Ireland. Health Sci J. 2015;9(1):1.

Google Scholar  

Redwood S, Brangan E, Leach V, Horwood J, Donovan JL. Integration of research and practice to improve public health and healthcare delivery through a collaborative’Health Integration Team’model-a qualitative investigation. BMC Health Serv Res. 2016;16(1):1–13.

Bombard Y, Baker GR, Orlando E, Fancott C, Bhatia P, Casalino S, Onate K, Denis J-L, Pomey M-P. Engaging patients to improve quality of care: a systematic review. Implement Sci. 2018;13(1):1–22.

Marston C, Hinton R, Kean S, Baral S, Ahuja A, Costello A, Portela A. Community participation for transformative action on women’s, children’s and adolescents’ health. Bull World Health Organ. 2016;94(5):376–82.

Burhouse A, Lea C, Ray S, Bailey H, Davies R, Harding H, Howard R, Jordan S, Menzies N, White S. Preventing cerebral palsy in preterm labour: a multiorganisational quality improvement approach to the adoption and spread of magnesium sulphate for neuroprotection. BMJ open quality. 2017;6(2):e000189.

Burhouse A, Rowland M, Niman HM, Abraham D, Collins E, Matthews H, Denney J, Ryland H. Coaching for recovery: a quality improvement project in mental healthcare. BMJ Open Quality. 2015;4(1):u206576–w202641.

Millenson ML, DiGioia AM III, Greenhouse PK, Swieskowski D. Turning patient-centeredness from ideal to real: lessons from 2 success stories. J Ambul Care Manage. 2013;36(4):319–34.

Yokota F, Biyani M, Islam R, Ahmed A, Nishikitani M, Kikuchi K, Nohara Y, Nakashima N. Lessons learned from Co-Design and Co-Production in a portable health clinic research project in Jaipur district, India (2016–2018). Sustainability. 2018;10(11):4148.

Cooke J, Langley J, Wolstenholme D, Hampshaw S. Seeing" the difference: the importance of visibility and action as a mark of" authenticity" in co-production: comment on" collaboration and co-production of knowledge in healthcare: opportunities and challenges. Int J Health Policy Manag. 2017;6(6):345.

Sicilia M, Guarini E, Sancino A, Andreani M, Ruffini R. Public services management and co-production in multi-level governance settings. Int Rev Adm Sci. 2016;82(1):8–27.

Bak K, Moody L, Wheeler SM, Gilbert J. Patient and Staff Engagement in Health System Improvement: A Qualitative Evaluation of the Experience-Based Co-design Approach in Canada. Healthcare Quarterly (Toronto, Ont). 2018;21(2):24–9.

Bagot KL, Cadilhac DA, Kim J, Vu M, Savage M, Bolitho L, Howlett G, Rabl J, Dewey HM, Hand PJ. Transitioning from a single-site pilot project to a state-wide regional telehealth service: The experience from the Victorian Stroke Telemedicine programme. J Telemed Telecare. 2017;23(10):850–5.

Bruce G, Wistow G, Kramer R. Connected Care Re-visited: Hartlepool and Beyond. J Integr Care. 2011;19(2):13–21.

Hogan MJ, Johnston H, Broome B, McMoreland C, Walsh J, Smale B, Duggan J, Andriessen J, Leyden KM, Domegan C. Consulting with citizens in the design of wellbeing measures and policies: lessons from a systems science application. Soc Indic Res. 2015;123(3):857–77.

Rycroft-Malone J, Burton CR, Wilkinson J, Harvey G, McCormack B, Baker R, Dopson S, Graham ID, Staniszewska S, Thompson C. Collective action for implementation: a realist evaluation of organisational collaboration in healthcare. Implement Sci. 2015;11(1):1–17.

Sorrentino M, Guglielmetti C, Gilardi S, Marsilio M. Health care services and the coproduction puzzle: filling in the blanks. Administration Society. 2017;49(10):1424–49.

Williams BN, Kang S-C, Johnson J. (Co)-contamination as the dark side of co-production: Public value failures in co-production processes. Public Manag Rev. 2016;18(5):692–717.

Gillard S, Foster R, Turner K. Evaluating the Prosper peer-led peer support network: a participatory, coproduced evaluation. Ment Health Soc Incl. 2016;20(2):80–92.

Greenwood DA, Litchman ML, Ng AH, Gee PM, Young HM, Ferrer M, Ferrer J, Memering CE, Eichorst B, Scibilia R. Development of the intercultural diabetes online community research council: codesign and social media processes. J Diabetes Sci Technol. 2019;13(2):176–86.

Lindsay C, Pearson S, Batty E, Cullen AM, Eadson W. Co-production as a route to employability: Lessons from services with lone parents. Public Administration. 2018;96(2):318–32.

Bell T, Vat LE, McGavin C, Keller M, Getchell L, Rychtera A, Fernandez N. Co-building a patient-oriented research curriculum in Canada. Res Involv Engagem. 2019;5(1):1–13.

Cox N, Clayson A, Webb L. A safe place to reflect on the meaning of recovery: a recovery community co-productive approach using multimedia interviewing technology. Drugs Alcohol Today. 2016;16(1):4–15.

Haynes E, Marawili M, Marika BM, Mitchell AG, Phillips J, Bessarab D, Walker R, Cook J, Ralph AP. Community-based participatory action research on rheumatic heart disease in an Australian Aboriginal homeland: Evaluation of the ‘On track watch’project. Eval Program Plann. 2019;74:38–53.

Ward ME, De Brún A, Beirne D, Conway C, Cunningham U, English A, Fitzsimons J, Furlong E, Kane Y, Kelly A. Using co-design to develop a collective leadership intervention for healthcare teams to improve safety culture. Int J Environ Res Public Health. 2018;15(6):1182.

McGregor J, Repper J, Brown H. “The college is so different from anything I have done”. A study of the characteristics of Nottingham Recovery College. J Mental Health Training, Education Practice. 2014;9(1):3–15.

Farr M. Power dynamics and collaborative mechanisms in co-production and co-design processes. Crit Soc Policy. 2018;38(4):623–44.

Hämäläinen R-M, Aro AR, Lau CJ, Rus D, Cori L, Syed AM. Cross-sector cooperation in health-enhancing physical activity policymaking: more potential than achievements? Health Res Policy Syst. 2016;14(1):33–33.

Farmer J, Taylor J, Stewart E, Kenny A. Citizen participation in health services co-production: a roadmap for navigating participation types and outcomes. Aust J Prim Health. 2017;23(6):509–15.

Morton M, Paice E. Co-Production at the Strategic Level: Co-Designing an Integrated Care System with Lay Partners in North West London. England Int J Integr Care. 2016;16(2):2–2.

Jeffs L, Merkley J, Sinno M, Thomson N, Peladeau N, Richardson S. Engaging Stakeholders to Co-design an Academic Practice Strategic Plan in an Integrated Health System: The Key Roles of the Nurse Executive and Planning Team. Nurs Adm Q. 2019;43(2):186–92.

Powers KJ, Thompson F. Managing Coprovision: Using Expectancy Theory to Overcome the Free-Rider Problem. J Public Adm Res Theory. 1994;4(2):179–96.

Andrews R, Brewer GA. Social capital, management capacity and public service performance: Evidence from the US states. Public Manag Rev. 2013;15(1):19–42.

Budge G, Mitchell A, Rampling T, Down P, Collective B. “It kind of fosters a culture of interdependence”: A participatory appraisal study exploring participants’ experiences of the democratic processes of a peer-led organisation. J Community Applied Social Psychology. 2019;29(3):178–92.

Farmer J, Currie M, Kenny A, Munoz S-A. An exploration of the longer-term impacts of community participation in rural health services design. Soc Sci Med. 2015;141:64–71.

Ersoy A. The spread of coproduction: How the concept reached the northernmost city in the UK. Local Econ. 2016;31(3):410–23.

Article   MathSciNet   Google Scholar  

Sancino A. The meta co-production of community outcomes: Towards a citizens’ capabilities approach. International J Voluntary Nonprofit Organizations. 2016;27(1):409–24.

Nies H. Communities as co-producers in integrated care. Int J Integr Care. 2014;(14):1–4.

Terp M, Laursen BS, Jørgensen R, Mainz J, Bjørnes CD. A room for design: Through participatory design young adults with schizophrenia become strong collaborators: A Room for Design. Int J Ment Health Nurs. 2016;25(6):496–506.

Seid M, Dellal G, Peterson LE, Provost L, Gloor PA, Fore DL, Margolis PA. Co-designing a Collaborative Chronic Care Network (C3N) for inflammatory bowel disease: development of methods. JMIR Hum Factors. 2018;5(1):e8083.

Schaaf M, Topp SM, Ngulube M. From favours to entitlements: community voice and action and health service quality in Zambia. Health Policy Plan. 2017;32(6):847–59.

Oertzen A-S, Odekerken-Schröder G, Brax SA, Mager B. Co-creating services—conceptual clarification, forms and outcomes. J Serv Manag. 2018;29(4):641–79.

Nimegeer A, Farmer J, West C, Currie M. Addressing the problem of rural community engagement in healthcare service design. Health Place. 2011;17(4):1004–6.

Bovaird T. Beyond engagement and participation: User and community coproduction of public services. Public Adm Rev. 2007;67(5):846–60.

Macaulay B. Considering social enterprise involvement in the commissioning of health services in Shetland. Local Econ. 2016;31(5):650–9.

Miller A, Young EL, Tye V, Cody R, Muscat M, Saunders V, Smith ML, Judd JA, Speare R. A community-directed integrated Strongyloides control program in Queensland, Australia. Trop Med Infect Dis. 2018;3(2):48.

Walsh M, Kittler MG, Mahal D. Towards a new paradigm of healthcare: Addressing challenges to professional identities through Community Operational Research. Eur J Oper Res. 2018;268(3):1125–33.

Windrum P. Third sector organizations and the co-production of health innovations. Manag Decis. 2014;5(6):1046–56.

Farmer J, Carlisle K, Dickson-Swift V, Teasdale S, Kenny A, Taylor J, Croker F, Marini K, Gussy M. Applying social innovation theory to examine how community co-designed health services develop: using a case study approach and mixed methods. BMC Health Serv Res. 2018;18(1):1–12.

Wilson G. Co-Production and Self-Care: New Approaches to Managing Community Care Services for Older People1. Social Policy Administration. 1994;28(3):236–50.

Sturmberg JP, Martin CM, O’Halloran D. Music in the Park. An integrating metaphor for the emerging primary (health) care system: Music in the Park. J Eval Clin Pract. 2010;16(3):409–14.

Vennik FD, van de Bovenkamp HM, Putters K, Grit KJ. Co-production in healthcare: rhetoric and practice. Int Rev Adm Sci. 2016;82(1):150–68.

Crosby BC, Bryson JM. Why leadership of public leadership research matters: and what to do about it. Public Manag Rev. 2018;20(9):1265–86.

Clarke D, Jones F, Harris R, Robert G. What outcomes are associated with developing and implementing co-produced interventions in acute healthcare settings? A rapid evidence synthesis. BMJ Open. 2017;7(7):e014650.

Gallan AS, Jarvis CB, Brown SW, Bitner MJ. Customer positivity and participation in services: an empirical test in a health care context. J Acad Mark Sci. 2013;41(3):338–56.

Nabatchi T, Sancino A, Sicilia M. Varieties of Participation in Public Services: The Who, When, and What of Coproduction. Public Adm Rev. 2017;77(5):766–76.

Larsen T, Karlsen JE, Sagvaag H: Keys to unlocking service provider engagement in constrained co-production partnerships. Action Research 2020:1476750320925862.

Kegan R, Laskow Lahey L. How the way we talk can change the way we work : seven languages for transformation. San Francisco: Jossey-Bass Pfeiffer; Wiley; 2001.

Hill R. Thinking like a round table leader: how mental complexity enables leaders to succeed in a complex environment. Journal of Character and Leadership Development. 2021;8(1):116–30.

Download references

Acknowledgements

The authors wish to thank Forte, the Swedish Research Council for Health, Working Life and Welfare. In particular, we would like to thank Mary McCall for valuable help.

Open access funding provided by Jönköping University. The study of Samskapa, a coproduction research programme, received funding from Forte, the Swedish Research Council for Health, Working Life and Welfare, under grant agreement no. 2018–01431.

Author information

Authors and affiliations.

The Jönköping Academy for Improvement of Health and Welfare, School of Health and Welfare, Jönköping University, Barnarpsgatan 39, Jönköping, Sweden

Sofia Kjellström & Daniel Masterson

Florence Nightingale Faculty of Nursing, Midwifery & Palliative Care, King’s College London, London, UK

Sofia Kjellström & Sophie Sarre

You can also search for this author in PubMed   Google Scholar

Contributions

SK and SS performed the data extraction, qualitative synthesis and drafted the manuscript and Table 1 . SK finalized the manuscript. D.M. screened the data from a previous scoping review, provided the search strategy (Additional file 1 : Appendix 1) and constructed the Prisma flowchart. SS compiled sample description in Additional file 2 : Appendix 2. All authors reviewed and approved the manuscript and agreed to be accountable for all aspects of the work.

Corresponding author

Correspondence to Sofia Kjellström .

Ethics declarations

Ethics approval and consent to participate.

Not applicable; according to Swedish law research, ethical approval is not needed for research that does not involve human persons.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: appendix 1. .

Description of included papers. 

Additional file 2: Appendix 2. 

PRISMA_2020_checklist - Mangement review.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Kjellström, S., Sarre, S. & Masterson, D. The complexity of leadership in coproduction practices: a guiding framework based on a systematic literature review. BMC Health Serv Res 24 , 219 (2024). https://doi.org/10.1186/s12913-024-10549-4

Download citation

Received : 11 April 2023

Accepted : 03 January 2024

Published : 17 February 2024

DOI : https://doi.org/10.1186/s12913-024-10549-4

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Health and welfare

BMC Health Services Research

ISSN: 1472-6963

what is reviewing the literature in a research paper

Academic Entrepreneurship Ecosystems: Systematic Literature Review and Future Research Directions

  • Open access
  • Published: 16 February 2024

Cite this article

You have full access to this open access article

  • Maria Patrocínia Correia 1 , 2 ,
  • Carla Susana Marques   ORCID: orcid.org/0000-0003-1557-1319 2 ,
  • Rui Silva 2 &
  • Veland Ramadani 3  

119 Accesses

Explore all metrics

Research on the entrepreneurship ecosystem, based on different data and scales, limits the acceptance of a single definition. This conceptual limitation and the still recent research and higher education institutions have come to be seen as ecosystems associated with entrepreneurship. The aim of this study is to contribute to the field of knowledge, identify current and emerging thematic areas and trends and reveal the scientific roots of research on entrepreneurial ecosystems and their relationship with higher education institutions. A bibliometric analysis was developed to analyse a final sample of 110 articles published between 2011 and 2022. In order to develop the analysis, Bibliometrix R-Tool was used and the metadata of two databases (Web of Science and Scopus) was retrieved and merged. The software creates a reference co-citation’s map, which allowed emphasize the state of the art and indicate three thematic clusters: (i) the importance of the higher education context for the entrepreneurial ecosystem, (ii) the evolution and challenges of entrepreneurship education and (iii) academic entrepreneurship ecosystems. The paper concludes by suggesting future research focused on the importance of building an integrated approach to entrepreneurial ecosystems and higher education institutions on a context regional scale.

Similar content being viewed by others

what is reviewing the literature in a research paper

Entrepreneurial ecosystem elements

Erik Stam & Andrew van de Ven

what is reviewing the literature in a research paper

Barriers and facilitators of university-industry collaboration for research, development and innovation: a systematic review

André Luis Rossoni, Eduardo Pinheiro Gondim de Vasconcellos & Renata Luiza de Castilho Rossoni

what is reviewing the literature in a research paper

The impact of entrepreneurship on economic, social and environmental welfare and its determinants: a systematic review

Thomas Neumann

Avoid common mistakes on your manuscript.

Introduction

The new research on the “entrepreneurship ecosystem” (EE) limits the acceptance of a single definition. According to this conceptual limitation and the still recent research, higher education institutions (HEIs) have come to be seen as ecosystems associated with entrepreneurship. While several bibliometric and systematic literature reviews have advanced for a research agenda for academic entrepreneurial ecosystems (AEEs), a holistic approach that integrates theories, attributes and methods is still necessary.

The concept of EE in HEIs has emerged in the literature (Fetters et al., 2010 ). Consequently, initial studies have addressed the components of these ecosystems (Fetters et al., 2010 ; Graham, 2014 ; Meyer et al., 2020 ), and internal and external actors have been identified (e.g. Hayter, 2016 ; Hayter et al., 2018 ; Meyer et al., 2020 ). Hayter ( 2016 ) and Hayter et al. ( 2018 ) further elaborated on the research by relating the effectiveness of academic EEs to the levels of the interconnectedness of the constituent elements and their collective capacity.

Higher education institutions (HEIs) and their surroundings play a “fundamental role for contemporary societies in the field of education and knowledge generation” (Kobylinska & Lavios, 2020 : 118). For the authors, during the last decade, the university and its surroundings have become a special ecosystem. Specifically, favourable conditions are created for cooperation between various entities, namely, HEI, business incubators, technology transfer centres and funding institutions, which contribute to developing academic entrepreneurship ecosystem (AEE) (Meyer et al., 2020 ; Kobylinska & Lavios, 2020 ). The combination of EE and HEI requires further research.

The systematic literature review (SLR) developed in this article found five studies that allow us to assess what is known about this subject. Malecki ( 2018 ) reviews the literature, concepts and operationalizations of the concept of EE with a bibliometric analysis. Kansheba and Wald ( 2020 ) present a systematic review of the existing literature, develop a research agenda and analysing, only, articles that focused on EEs (conceptual, theoretical or empirical). They concluded that the concept of EEs is poorly theorised and dominated by conceptual studies, revealing existing theoretical and empirical gaps on EEs. In the third SLR found, Kobylinska and Lavios ( 2020 ) aimed to analyse the state of research on University EE and to identify research trends related to the topic. They concluded that the study of University EE is little recognized in the literature, lacking a solid methodological basis and revealed that the topic may constitute a research area of interest. In the fourth review, Guindalini et al. ( 2021 ) present an SLR with bibliometric and network analysis, with the aim of mapping AEE. In this SLR, as in the two previously mentioned, the authors conclude that this topic is at an “embryonic stage of academic research” (Guindalini et al., 2021 : 6). They also find a gap in research regarding evaluation studies that support the targeting of potential scientific discoveries in the market. With bibliometric and SLR, the study develops a holistic framework that integrates sustainability factors into the EE literature. They confirm that EE research has mostly focused on academic entrepreneurship, innovation and regional development, among others.

The originality of this research is directly linked to the chosen emerging theme. In this context, this study aims to complement and stand out from the five reviews found and understand the characteristics of an AEE and their successful development as a potential research area relevant in the future. To this end, a bibliometric analysis is proposed to answer the following research questions: (a) RQ1: Is it possible establish common attributes for AEE?; (b) RQ2: What are the opportunities and challenges that HEIs must recognize to achieve an successful EE?; (c) RQ3: What key areas require further research with regards to AEE?

In order to complement the proposed research questions, this study also responds to the subsequent objectives: to provide a comprehensive overview of the origins of the EE concept, to explore the research conducted so far in this field of study, to reveal the scientific roots of research on EEs and their relationship with the HEIs and to create knowledge for future research on AEEs.

To achieve them, the SLR followed in this article included a rigorous protocol and definition of research steps and a literature review based on scientific articles published in Web of Science (WoS) and Scopus. In addition, the 110 articles related to EEs were submitted to a bibliometric analysis with the Bibliometrix-R tool . In this quantitative bibliometric, we used the analysis of co-citations, which allowed obtaining a citation network composed of clusters.

The article is structured in seven parts. After this introductory section, the theoretical framework on the concept is presented in the second section of the paper and is organized as follows: entrepreneurial ecosystems and academic entrepreneurial ecosystems. In the third section, the methodological characteristics of the research used in the SLR, the sample and the bibliometric analysis method are presented. The results are explained in the fourth section. The thematic analysis exposing the resulting visual maps and discussing the results of the articles classified by clusters is the fifth section. In the sixth and final section, the future lines of research and conclusions are addressed presenting limitations that resulted from the review and future of research.

Theoretical Framework

Defining entrepreneurial ecosystems and academic entrepreneurship ecosystem.

The concept of entrepreneurial ecosystem is an ambiguous term, but, in fact, this concept has been increasingly explored by researchers over the years (Bischoff et al., 2018 ; Clarysse et al., 2014 ; Cohen, 2006 ; Isenberg, 2010 , 2011 ; Kansheba & Wald, 2020 ; Stam & Spigel, 2017 ; Van de Ven, 1993 ). The term entrepreneurial ecosystem (EE) is a composite of two terms.

The component of the term—entrepreneur—according to Mason and Brown ( 2014 ) is often associated with “high growth start-ups” or “economies of scale” as being a source of innovation and growth in productivity and employment. The other component of the term—ecosystem—is associated with biology and is defined as the physical environment and all possible interactions in the complex of living and non-living components (Stam, 2015 ). As in ecology, the biological perspective focuses on the rise and fall of many organizations and institutions that are mutually related and play different but complementary roles that enable their birth, growth and survival (Astley & Van de Ven, 1983 ; Freeman & Audia, 2006 ).

Cohen ( 2006 ) was the first to use the concept of EE building on the study of Neck et al. ( 2004 ). Neck et al. ( 2004 ) used qualitative analysis to identify the components present in the EE in Boulder, USA. This concept became more prominent through Daniel Isenberg, in 2010. For this author, an EE is a set of individual elements combined in a complex way. In isolation, each can generate entrepreneurship but cannot sustain it (Isenberg, 2010 , 2011 ). Mason and Brown ( 2014 : 5) more broadly defined an EE as a “set of interrelated entrepreneurial actors, entrepreneurial organizations, institutions and entrepreneurial processes that formally or informally cooperate in relating and mediate performance within the local entrepreneurial environment.” Audretsh and Belitski ( 2017 : 1031) define EE as “institutional and organisational systems as well as other systemic factors that interact and influence the identification and commercialisation of entrepreneurial opportunities.” Acs et al. ( 2014 ) defined entrepreneurial ecosystems as a dynamic, institutionally embedded interaction between entrepreneurial attitudes, capabilities and aspirations of individuals that drives the allocation of resources through the creation and operation of new projects. Stam and Spigel ( 2017 ) point out that it is the coordination that occurs between actors and interdependent factors that enables productive entrepreneurship in each territory.

As this term has captured the attention of researchers, experts and policymakers significant knowledge gaps have also emerged in terms of its conceptual meaning, theoretical foundation and application (Audretsh et al., 2019 ; Kansheba & Wald, 2020 ). According to Audretsh et al. ( 2019 ), the question remains as to what exactly an EE is and what it comprises. It also mentions that the definition of EE does not add value to academic discourses that rely on “networks”, “cluster initiatives”, “triple helix initiatives” or “public–private partnerships”. For the authors, thinking in terms of EEs may only reflect the importance of a particular topic, such as “business ecosystems”, “digital ecosystems”, “financial ecosystems” and “university ecosystems”, among others.

Combining EEs and HEIs: An Overview of Academic Entrepreneurship Ecosystems

In recent decades, some universities have oriented themselves towards a more entrepreneurial direction through the realization of the third mission as a key player in promoting national and regional economic and social development (Etzkowitz & Leydesdorff, 2000 ; Yi & Uyarra, 2018 ) resulting from the interaction of three actors belonging to different helixes—university-industry-government: triple helix model (Etzkowitz & Leydesdorff, 2000 ). Etzkowitz and Zhou ( 2017 ) point out that the thesis of the model is that the university starts to abandon a social, yet important, role of providing higher education and research and starts to assume an essential role equivalent to that of industry and government as a generator of new industries and enterprises. As a result, the entrepreneurial university has become an increasingly significant academic configuration and is considered a vital element (Etzkowitz & Zhou, 2017 ; Wang et al., 2021 ). Pita et al. ( 2021 ) agree, pointing out that universities actively contribute to the development of EEs by providing a skilled workforce and stimulating new enterprises, such as start-ups or spin-offs.

In the entrepreneurial university, knowledge-sharing processes are outlined, which requires the university to reconfigure its traditional educational programmes and approaches to create a favourable context for university entrepreneurship by supporting students in a process that moves from idea generation to idea development, business model and commercialisation (Secundo et al., 2021 ). Another challenge facing HEIs is to shift their focus from education about entrepreneurship to educating for entrepreneurship. This encompasses any programme or pedagogical process of education aimed at achieving entrepreneurial skills and attitudes (Bischoff et al., 2018 ).

Against entrepreneurial HEIs and their pedagogical competencies of entrepreneurship education, researchers highlight that the entrepreneurial university itself can form an EE (Miller & Acs, 2017 ; Wang et al., 2021 ). The EE developed with an academic campus as a context is referred to as “University-based Entrepreneurship Ecosystem” (UBEE) or “University Entrepreneurship Ecosystem” (UEE) or “Academic Entrepreneurship Ecosystem” (AEE). All these terms refer to the ecosystem developed on the university campus, which are part of a wider ecosystem. For Wang et al., ( 2021 : 2), the creation of UEEs, currently, is a “hot topic.”

Naturally, many definitions were put forward, leading to the decision to present, chronologically, a selection of definitions (Table  1 ).

An effective AEE is critical for entrepreneurial academic activities as they not only act as a catalyst for the acceleration of knowledge commercialisation but also as a platform and dynamic in maintaining the sustainable development of academic entrepreneurship (Yi & Uyarra, 2018 ). However, little literature exists on the AEE’s structure and function and particularly how the transition from the academic entrepreneurial system to an AEE occurs (Hayter, 2016 ; Yi & Uyarra, 2018 ).

Similarly, to research on EE, academics attach greater importance to the conceptualisation and elements of the UEE. Several authors identify the factors contributing to the evolution of EEUs (Fetters et al., 2010 ; Graham, 2014 ; Meyer et al., 2020 ). Fetters et al. ( 2010 ) cite seven factors contributing to the evolution of UBEEs: senior leadership, strong teaching and programmatic capacity, long-term commitment, the commitment of financial resources, the commitment to continuous innovation in programmes and curricula, adequate organizational infrastructure and the commitment to increasing critical mass and creating enterprises. Graham ( 2014 ) also identifies seven factors that underpin UEEs: institutions, culture, university leadership, university research capacity, regional or governmental support, effective institutional strategies and strong demand for entrepreneurial students.

Brush ( 2014 ) believed that entrepreneurship education is the core of the UEE. The researcher divided the internal entrepreneurial education ecosystem into three broad areas (introductory/curricular courses, extracurricular activities and research) and four dimensions (stakeholders, resources, infrastructure and culture). Sherwood ( 2018 ), in addition to the elements, identified curricular, extra-curricular components, Technology Transfer Offices (TTO), resources and informal and community engagement. For Wang et al. ( 2021 ), diversified extracurricular activities have played an important role in stimulating students’ interest in entrepreneurship by providing them with a large number of resources. For the authors, student entrepreneurs also tend to get the guidance and resources they need through these activities.

For Bischoff et al. ( 2018 ), although the concrete strengths and conceptualization of UBEEs generally vary between universities, a number of common characteristics can be identified. Secundo et al. ( 2021 ) mention that UBEE facilitates innovation and entrepreneurial opportunities thanks to the knowledge-sharing processes between the various actors. Within a UBEE, for the author, each actor needs to be connected to the other members through a constant flow of knowledge from information that enables the overflow of entrepreneurial knowledge. The author points out that universities may assume different roles according to the size and composition of the entrepreneurial ecosystem, interacting through different channels.

In accordance with the review carried out, the other authors initiate the development of methods to evaluate an AEE. Table 2 shows three of the conceptual models highlighted in the literature review and published chronologically in the last 5 years.

Within this context, further research work on evaluations of AEE is needed. The findings draw attention to considerations as “unique entrepreneurial architecture” (Prokop & Thompson, 2022 : 17). The Prokop and Thompson ( 2022 : 181) study include 81 UEE and, according to the author, “it is in no way reflective of all types of sub-ecosystems, or broader ecosystems.” The study of university and broader EEs is a critical feature to recognize and involve in future studies. This study aims to contribute to this challenge.

Methodology

To produce a comprehensive review article, Hulland ( 2020 ) refers that authors should carry out their studies in a systematic way. A systematic review needs the definition of clear questions, criteria and conclusions that provide new information based on the examined content. According to Aria and Cuccurullo ( 2017 ), this means that the phases adopted in the review can be replicated in all procedures and there should be clarity in all of them. The authors state that the working model of an SLR is based on five stages: study design, data collection, data analysis, data visualization and interpretation.

Ferreira et al. ( 2019 ) mention that one of the most suitable methods for analysing past research works is bibliometric analysis. According to Aria and Cuccurullo ( 2017 ) and Thelwall ( 2008 ), there are relevant points when using bibliometric. For Aria and Cuccurullo ( 2017 ), there are three types of research questions that can be answered using bibliometrics: identify the knowledge base of a topic or field of research, examine the conceptual structure of a topic or field of research and produce a network structure based on a particular scientific community. The relevance for Thelwall ( 2008 ) concerns the types of procedures in bibliometric analysis. The author identified two types of procedures, evaluation bibliometric and relational bibliometric. The first evaluates the productivity and impact of researchers, research centres and countries. The second type examines the similarity and relationship between publications, authors and keywords using co-word, co-authorship and co-citation analyses.

The article will use the suggestions of both authors in bibliometric analysis. It will respond to the three types of questions posed by Aria and Cuccurullo ( 2017 ) and uses both types of procedures, evaluation bibliometric and relational bibliometric. In evaluation bibliometric, mappings, qualitative analyses and baseline indicators are carried out. In relational bibliometrics will analyse co-citations and the respective clusters.

Data Collection and Eligibility Criteria

In additional search, the research papers were determined through the comprehensive advanced search in two databases including Scopus and Web of Science. These choices were justified for two reasons: they are two multidisciplinary databases that include all indexed journals with the highest number of citations in their respective areas of scientific specialization (Huang et al., 2020 ; Pranckuté, 2021 ). They also provide a citation index, generating information about each publication in documents that cite them as well as cited.

Table 3 elucidates the stages that followed in this study.

The keywords come from the research question and was defined the following search query: “entrepreneur* ecosystem*” (in title) AND “universit*” OR “polytechnic*” OR “higher education institution*” (in topic). All the articles from the current year were excluded because at the time of this research the year had not finished. The document type was limited to “article” and “review.” After applying these criteria, it was obtained 183 papers from the research process (104 obtained in SCOPUS and 79 results in Web of Science) (stages 1 and 2 from Table  3 and Fig.  1 ).

figure 1

Process of data collection and analysis

In the third stage, wherein some records were excluded, the data was filtered. To this end, other restrictions were applied:

Eliminating the repeats by cross-referencing the databases (62 documents)

The exclusion of 11 documents, after analysing the content of each, because the global subject of the articles was different from the scope of the study

Although language was not a filter, it should be noted that the search was developed utilizing English, which could be understood as “quasi-filter.”

The procedures followed in the data collection and the application of the eligibility criteria complete Fig.  1 which demonstrates the careful way in which the final database was obtained ( n  = 110).

Mapping and Qualitative Analysis

R-Bibliometrix summarized the mapping of the documents included in the final database with the information considered relevant, as shown in Table  4 . Table 4 reveals that the dataset contains 110 documents published between 2011 and 2022, representing the work of 276 authors from 32 different countries. The average years from publication is 3.31 and the average number of citations per documents 13.4. The number of authors and co-authors per document is 2.5 and 2.7.

The first study in the final database addressed the entrepreneurship ecosystems, and the global innovation networks were written by Malecki in 2011. For the author, the existing knowledge is dispersed as it results from entrepreneurial activity originating from small and medium enterprises, research institutes and universities. Malecki ( 2011 ) suggested the simultaneous integration of local and global knowledge as well as internal and external.

A reading of Tables  4 and  5 reveals that various articles have been published recently (during 2011–2022). Moreover, an increase of publications (except 2012 and 2013) shows an increasing trend, suggesting that the subject has been progressively gaining popularity in the academic community. The results reveal and confirm the increase prevalence of research on EEs over the past 11 years.

In 2022, the number reached 24 articles in the last year of the period. After 2014, there was a considerable increase in the number of published articles. The data shows a turning point in 2018 (14) and 2019 (23). This latter year and 2022 standing out with the highest number of published articles. It is important to mention that more than half of the articles (62) were published in the last 3 years. The production growth rate is 33.5%.

According to the average number of citations, per year, the articles written in 2022 were those with a higher number (9.79) followed by articles from the years 2011, 2018 and 2019. This increment in the interest of EE results from the fact that this concept has assumed a global and multidisciplinary dimension recognized and associated with innovation by the various economic and social actors.

Table 6 presents the five authors and journals that have contributed for research’s development. The most cited papers by author were those of Malecki, with 185, followed by Audretsh, with 111, and Carayannis, with 110. The three authors who have published the most with the highest local impact (TC index) are Cunningham (4 publications, TC 156), Audretsh (3 publications, TC 184) and Menter (3 publications, TC 154).

R-Bibliometrix software was used to identify the keywords mentioned in the 110 documents of the final sample. As can be seen in the Fig.  2 , the most frequently terms mentioned are “entrepreneurial ecosystem”, “entrepreneurial university”, “entrepreneurial education”, “university”, innovation” and “higher education”. This also shows that of the studies analysed word association results as “academic entrepreneurship”.

figure 2

Most mentioned keywords

Table 7 summarizes the applied methodologies. As an emerging theoretical stream, EEs have been studied through qualitative methods. Thus, several articles use a case study technique. There is an increase on quantitative methods using factor analysis and structural equation modelling to understand variations in entrepreneurship and develop metrics. Researchers have used mixed methods, both qualitative and quantitative data collection techniques to address the complexity of the phenomenon.

Concerning methodologies, of a total 110 articles, 59 documents (54%) use a qualitative approach, through the technique of data collection via interviews (in-depth and semi-structured), samples, observation and documentary analysis. The case study technique, inserted in this approach, focuses on 25 articles, meaning that its weighting is 42% in relation to the total number of articles that use qualitative methodologies. The 28 articles (around 25%) use a quantitative approach through data collection techniques involving the application of questionnaires and secondary data (statistics) and eight articles (7%) use mixed methods, namely, they use both qualitative and quantitative data collection techniques. Eight conceptual articles (7%) and seven literature review articles (6%) were identified. Of this literature review, five are based on systematic literature reviews. From the numbers, we deduce that there is no balance of methods in EE and HEI studies and literature reviews are the least frequent type of publication.

Thematic Analysis

In this part of the article, the thematic analysis results will be examined. It will start with the strategic and evolutionary analysis and, subsequently, the networks created by the co-citation analysis. The subsequent figures will be presented all results.

Strategic and Evolutionary Thematic Analysis

The strategic diagram for the studied subject is presented in Fig.  3 . The size of the circles represents the number of occurrences of these words. The upper right quadrant represents the main themes, and the upper left quadrant depicts the more specific themes, considered niche themes. The lower right quadrant represents the basic themes, and the lower left means that the theme may be emerging or disappearing.

figure 3

Strategic diagram

The themes in the upper right quadrant are “academic entrepreneurship” and “entrepreneurial”. All these sets of themes are crucial to the research in this paper.

The theme in the upper left quadrant is “start-ups”, “case study” and “networks.

The lower right quadrant represents the basic themes necessary for understanding the present study: “entrepreneurial ecosystem”, “entrepreneurial education”, “entrepreneurial university”. Also “university” and “technology transfer” are essential for the understanding on the topic. The lower left quadrant given the inexistence of declining themes but also gives the emerging themes, “entrepreneurial education” and “entrepreneur”. All this fact enhances the importance of the sets of themes in the article.

Thus, “networks”, “case study” and “academic entrepreneurship” reveal themselves as major themes. The transversal themes are “entrepreneurial ecosystems” and “university incubators”. This last phase, 2022, was the growth stage of an approach integrating Entrepreneurial Ecosystems and the Entrepreneurial University. Therefore, 2023 could be a high growth phase for an integrated approach to AEEs.

Figure  4 presents the evolution of research topics in entrepreneurial ecosystems and the relationship with the university. The data were analysed using the author’s keywords and cut-off points in the years 2014, 2018 and 2020. The results reveal a thematic evolution of the conceptual frameworks from 2011 to 2022. From the general concept of “Entrepreneurial Ecosystem” (2011–2014), “innovation” emerges in the thematic evolution (2015–2017). Therefore, the cut-off points were two periods when the first publications on the topic of the paper appeared (three publications in 2011–2014 and nine publications in 2015–2017).

figure 4

Thematic evolution, with cut-off points

In 2018, results of the emergence of thematic areas such as “education” and “higher education” are revealed. From 2019, “entrepreneurial ecosystem” gives way to “entrepreneurial education”, “entrepreneurial university” and its “ecosystem”. Likewise, the area of “innovation” gives way to a unique “entrepreneurial ecosystem” based on “entrepreneurial education”, “university”, “higher education” and “academic entrepreneurship”. The thematic evolution of the conceptual framework between 2018 and 2022 revealed that these periods are the most productive and creative with the highest number of base themes and driving themes evolving in these periods.

Cluster Analysis

A bibliometric analysis was carried out to understand how this field of study is divided into research clusters, and the co-citations were analysed. No cut-off point for the number of citations per document has been defined. All linked documents were selected, leaving us with a final analysis with 50 documents distributed by clusters. Each of the clusters, identified with different colours, can be observed in Fig.  5 . The colours indicate the clusters and the articles belonging to them. In addition, each article’s weight is assigned based on the links’ total strength, and the number of citations the publication has received. The top nodes are the publications with the highest link strength.

figure 5

Clusters networks through the co-citation analysis technique

Based on the visualization of Fig.  5 and after analysing the resulting network and the content of the articles, it is concluded that the research is divided into three thematic clusters (Table  8 ).

Cluster 1 (Blue)—Conceptualization and Attributes of Entrepreneurship Ecosystems

The first cluster is focused on the definition and attributes present in EEs. No consensus has been reached in the academic community on the theoretical characterization of the concept and the elements that characterize it.

While there is none accepted definition of an EE, as Spigel ( 2018 ) points out, the most active area of interest has been around the types of domains (Isenberg, 2010 , 2011 ), components (Cohen, 2006 ) or attributes (Spigel, 2017 ).

Diverse literature provides tools that show several factors considered important for a successful EE. Cohen ( 2006 ) refers to formal and informal networks, government, university, skilled human resources, support services, funding and talent. The works of Isenberg ( 2010 , 2011 ) list six domains present in the ecosystem: policy, funding, culture, support, human capital and markets.

Spigel ( 2017 ) efforts to rank the categories of an EE in terms of (i) cultural attributes (entrepreneurship stories, supportive culture), (ii) social attributes (talent, mentors, networks, investment capital) and (iii) material attributes (infrastructure, universities, support services, public policies, open markets). Spigel and Harrison ( 2018 ) give attention to several factors such as governance, knowledge, industry, actors, resources and benefits.

Table 9 summarizes the attributes by applying them to the EEs.

Although the topic on the attributes of EEs is innovative, it has not been without trials. Several articles highlight criticisms of previous work (Alvedalen & Boschma, 2017 ; Brown & Mason, 2017 ; Malecki, 2018 ; Nicotra et al., 2018 ; Stam & Spigel, 2017 ). Alvedalen and Boschma ( 2017 ), Nicotra et al. ( 2018 ) and Stam and Spigel ( 2017 ) highlighted the lack of a clear analytical framework to empirically explain the cause-effect relationship of EEs’ attributes and their effects on productive entrepreneurship. The static approach of EE studies was another criticism highlighted as its evolution over time was not considered. Finally, Malecki ( 2018 ) noted the lack of an issue related to spatial scale.

Cluster 2 (Red)—Spatial Context and Knowledge Ecosystems

Beyond definitional debates, the lead author of this cluster, Stam ( 2015 ), expresses himself critically concerning studies of EEs. He underlines that it is not only generating entrepreneurship that makes it a good EE. He also mentions that the approaches only offer a long list of elements without a cause-effect relationship and concludes that it is unclear what level of geographical analysis the approaches have taken into consideration. The author refers that a new emerging approach to EE occurs, conveying a new view on people, networks and institutions. From this emerging approach, differentiations have emerged at two levels: spatial context and dynamics of knowledge ecosystems.

The first sub-division of this cluster refers to the importance of context in EEs (Acs et al., 2014 ; Cohen, 2006 ; Spigel, 2017 ; Stam, 2015 ). For Stam ( 2015 ), the common denominator in this sub-cluster seems to be that entrepreneurs create value in a specific institutional context. The author approach emphasizes the interdependencies within the context and provides a bottom-up analysis of the performance of regional economies. Stam ( 2015 ) argues that EEs open the door to a shared responsibility among actors that foster, encourage and support entrepreneurs, asking about the systemic services that a region tries to achieve.

The second sub-cluster analyses the dynamics of knowledge ecosystems, namely, the role of HEIs for value creation in a given context. Kuratko ( 2005 ), in his study, notes that younger people have become the most entrepreneurial generation since the Industrial Revolution. The growth and development in programmes and curricula dedicated to entrepreneurship and the creation of new projects have been remarkable. The number of colleges and universities offering entrepreneurship-related courses has increased. However, among this enormous expansion, for Kuratko ( 2005 ) there remains the challenge of the academic legitimacy of entrepreneurship. Although there has been this significant growth, the author points out two specific challenges to academia: (i) development of academic programmes and specialized human resources to improve the quality of courses and (ii) commitment by institutions to create formal academic programmes.

Clarysse et al. ( 2014 ) analysed the tension between knowledge and business ecosystems. In relation to the success factors, they seem similar: diversity of organizations and key actors. However, regarding the factors, anchor organizations in knowledge are universities and public research organizations that do not directly compete with the ecosystem. In contrast, key actors in EEs are based on companies that are competitors in the ecosystem. Another difference lies in value creation. In knowledge ecosystems, to Clarysse et al. ( 2014 ), the value creation flows from upstream to downstream, while in EEs, the value creation process is non-linear . The author’s note that some studies already include universities as part of the knowledge system but that further research could focus on analysing the circumstances under which a university could be considered an ecosystem and how the interaction between knowledge and business ecosystems would occur. Miller and Acs ( 2017 ) explore the EE of higher education by choosing a university campus because the “entrepreneurial opportunities had been identified and/or the process of firm-formation had begun by multiple founders…” (p. 82).

Cluster 3 (Green)—Inter-institutional Relationships in University’s Ecosystem

This third cluster leads us to the wider set of relationships in the university’s ecosystem, strategies and their specificities of regional/local factors. Audretsch et al. ( 2019 ) refers that EE is a vehicle for carrying entrepreneurs, policymakers and managers of linked companies and all their relationships organizing the EE. For the author, an EE is defined by frontiers, and the necessary resources are produced and absorbed within and beyond those boundaries.

Audretsch and Belitski ( 2017 ) set out to develop a model that captured both regional and local systemic factors to better understand and explain variations in entrepreneurial activity. In their study, they found four domains under EEs in European cities: norms and culture, infrastructure and equipment, formal institutions and Internet access and connections. To Audretsch and Link ( 2017 : 431), conceptually a university represents a “reservoir of knowledge, knowledge embodied in faculty…”. Universities are one part of the complexity of the research. They have evolved towards taking an active role in regional development and the dynamics of local networks. This evolution in the model involves inter-institutional relationships between the three actors, leading to an increasing overlap of their roles. The work of Schaeffer and Matt ( 2016 ) showed that universities cannot replicate the mechanisms that lead to the success of an EE but rather adapt their strategies to the specificities of each regional context.

Can academia encompass a third mission, beyond research and teaching? This question was formulated by Etzkowitz and Leydesdorff ( 2000 : 110). Three spaces emerge from the triple helix model: the consensus space, a knowledge space (R&D activities) and innovation space.

Schaeffer and Matt ( 2016 ) state these are coordinated and managed by a regional innovation officer. The authors refer that this responsibility can be assigned to the university to contribute to developing the regional networks. They analysed the university of Strasbourg’s Technology Transfer Offices (TTO) and supported entrepreneurial academic activities over 15 years. The study reveals a strong growth in the structure of the TTO and its role as a boundary, changing objectives and developing collaborations with other regional actors. As pointed by Fini et al. ( 2011 ) and Vohora et al. ( 2004 ), since university faculty have limited entrepreneurial experience, networks with outside contacts are crucial to motivate the creation of entrepreneurial activities as well as their success.

In addition to TTOs, entrepreneurship education, either as part of the academic programme or as an extra-curricular offering, can provide students and faculty with important knowledge to stimulate and support entrepreneurial efforts (relationship to Cluster 2). While most of the study streams have focused on the role of faculty as academic entrepreneurs, Boh et al. ( 2016 ) focused on the role of students. The typology created by the authors provides insight into the various responsibilities of students and faculty in technology commercialisation. It is the different relationships between students, faculty and entrepreneurs and the analysis of the strengths and weaknesses of each that can lead to the creation of a successful spinoff. The authors, Boh et al. ( 2016 ), group into six the university practices, independent of the TTOs: project disciplines for technology commercialisation, mentoring programmes, incubator programmes, entrepreneurial business plans and entrepreneurial education for students and university professionals.

Other authors analyse the relation between social networks and academic entrepreneurship (Clarysse et al., 2011 ; Fini et al., 2011 ; Vohora et al., 2004 ), Spinoffs (Lockett & Wright, 2005 ; Fini et al, 2011 , 2017 ; Vohora et al., 2004 ; Clarysse et al., 2011 ; Hayter, 2016 ) and the entrepreneurial environment and academic programmes supporting entrepreneurship (Fini et al., 2011 ). As pointed by Fini et al. ( 2011 ) and Vohora et al. ( 2004 ), since university faculty have limited entrepreneurial experience, networks with outside contacts are crucial to motivate the creation of entrepreneurial activities as well as their success. Vohora et al. ( 2004 ) argues that networks are pathways through which access to opportunities will be achieved, for example, gaining knowledge of the market that motivates the creation of the spinoff. Hayter ( 2016 ) uses Vohora et al. ( 2004 ) qualitative model of entrepreneurial development and that includes four stages of development: opportunity recognition, commitment, credibility and sustainability, as well as the resources and network elements associated with each stage. Entrepreneurial development and its success are reflected in the progression of the university spinoff , overcoming the obstacles of each stage, with the aim of achieving entrepreneurial sustainability.

Hayter ( 2016 ), using mixed methods, compares the composition and contribution of social networks among entrepreneurial academics and analyses how these networks relate to the development trajectory of university spinoffs . The traditional definition of spinoff , according to Hayter et al. ( 2017 ) focuses on the role of faculty establishing a company based on a technology licensing agreement, with their home university. University spinoffs , for Hayter ( 2016 ), are an important vehicle for generating productivity, job creation and prosperity for regional economies. The author also mentions that spinoffs are a window through which the contributions of universities can be examined. He compares the composition and contribution of social networks among entrepreneurial academics and analyses how these networks relate to the development trajectory of university spinoffs.

Cluster Relations

The three clusters are related. The cluster 2 indicates the importance of higher education for EE and cluster 3 leads us to the triple helix model with the focus on university entrepreneurial experience. Cluster 1 introduces definitions and attributes necessaries to understand the EE and their relationship with or within the HEIs. This cluster creates a theoretical background with relevant publications in entrepreneurship research.

Clusters 2 and 3 have a robust relation. Notably, the position of Stam ( 2015 ) and Spigel ( 2017 ) influences 2 clusters, indicating higher link strength and confirming its centrality in the EE literature. Various articles from cluster 2 criticize the analytical framework that produces long lists of factors that enhance entrepreneurship. Their perspective enables researchers to measure an EE within a country or territory by considering their specificities. This understanding highlights the configuration, structure and evolution of ecosystems influenced by ecosystem process and territorial boundaries.

In cluster 3 it is evident that the challenge of the third mission that academia encompass emphasizes entrepreneurship and the corresponding emergence of the entrepreneurial university. The relationships between students, faculty and entrepreneurs and the analysis of the strengths and weaknesses of each can lead to the creation of a successful spinoff.

To understand the substance of AEE and how the broad research was advanced, the group of these three clusters creates a fundamental and theoretical base to: the terminology of EE, the higher education context and the emergence of an AEE (Fig.  6 ).

figure 6

Academic entrepreneurship ecosystem model

Contributions and Future Research Directions

The scientific literature about entrepreneurial ecosystems has been growing, and within it, one area that has been gaining impulse has been the academic ecosystem. This paper contributes by attempting to consolidate the most important of this growing literature and to try to confirm it.

This study brings important theoretical contributions to the existing literature. Firstly, this study led to a survey and mapping of the main investigations on EE and their relationship with the HEI. Secondly, this study strengthens the credibility of the AEE theoretical frameworks in lending support to the importance of analysing the specific contributions of HEIs to the development of an EE. Thirdly, the developed co-citation analysis allowed obtaining an understanding about the existing field of knowledge on EEs and AEE, identifying their scientific origins and revealing research roots.

Most contributions are conceptual providing an understanding of the different elements that form conducive AEE. Therefore, as a fourth contribution, this study emphasizes the need for more empirical research, especially regarding potential causal relations between elements, context factors, outputs and outcomes of entrepreneurial ecosystems. The few empirical studies on entrepreneurial ecosystems have majorly applied case studies including qualitative methods (Kansheba & Wald, 2020 ; Malecki, 2018 ; Nicotra et al., 2018 ). There is a need of deploying other methodological approaches for more rigor and generalizability purposes.

The above leads us to propose as possible future research directions. As mentioned, most research studies on EEs and AEEs have adopted the qualitative methodological approach (particularly case studies), which is understandable since the research topic is emergent. However, considering the systematic research conducted here, it is believed that this topic would benefit from implementing mixed methodologies (as has already been carried out by some of the authors included here). Thus, with the adoption of qualitative and quantitative methodologies, it will be attempted, in a future line of research, to build an assessment tool for an AEE.

The composition of clusters groups generated research points. Studying an AEE based on a regional scale will imply, firstly, building a theoretical framework, based on multiple dimensions, which allows the development of the EE model. HEIs are a complex process which involves an extensive research approach to accurately represent the levels and components of the entire entrepreneurial ecosystem (cluster 1). It will be necessary to study whether the HEI develops strategies adapted to the specificities of its EE. Likewise, to explore the pillars of the model from the point of view of young university students who show varying degrees of entrepreneurial intention (cluster 2). Several studies have found that entrepreneurship education has a positive impact on students’ entrepreneurial intention (Peterman & Kennedy, 2003 ; Souitaris et al., 2007 ; Pruett et al., 2009 ; Engle et al., 2010 ; Lanero et al., 2011 ; Sanchez, 2013 ; Bae et al., 2014 ; Sansone et al., 2021 ). Vanevenhoven ( 2013 ) and Fiore et al. ( 2019 ) have warned of the need for more research into the impact of entrepreneurship education on students in different contexts. Although there has been a growing number of publications on the role of intentions in the entrepreneurial process (Liñán & Fayolle, 2015 ; Ferreira-Neto et al, 2023 ), there is still a gap in research on how to improve the presence of higher education students in entrepreneurial activities so that they can face the problems of the labour market. A broader study could be undertaken, from a mixed approach, to establish mechanisms to collect appropriate data and to establish the different levels of success of EE outcomes, by the HEI (cluster 3).

Finally, the relevance of knowledge of skilled people has brought to the policy agenda of governments worldwide the need to modernize science and higher education systems and institutions (Santos et al., 2016 ; Scott, 2000 ). Portugal is characterized as a developed country but with a poorly qualified workforce in European average terms, facing structural barriers to economic growth (Carneiro et al., 2014 ). It was also a country that has seen one of the fastest developments in its scientific system at the beginning of the twenty-first century (Heitor et al., 2014 ). The emergence of the COVID-19 pandemic has brought new challenges to the country: the establishment of telework and the intense decline in economic activity were some of the most evident cross-cutting changes, with direct consequences for the emergence of new forms and policies to support the employment (Sousa & Paiva, 2023 ).

All these reasons have been supporting the need to make a RSL focused on how young graduates capture new forms and conditions of the exercise of work. This knowledge is crucial to investigate wow the entrepreneurial skills or the academic entrepreneurship path is in the future.

Conclusions and Limitations

The quest to identify and define EEs has become an issue of great importance as countries, regions and cities handle with an entrepreneurial economy. The range of these topics is wide and ambiguous. Researchers and practitioners have assessed various contributions, most of which identify HEIs as important development institutions. Marques et al., ( 2021 : 133) highlight their importance, stating that HEIs “… are seen as organizations responsible for human resource training, knowledge transfer, and regional development”.

This work used data from the Scopus and WoS databases. Based on 110 academic articles obtained through a rigorous data collection process, the study went beyond describing elementary information, standing out in relation to the review studies found and filling a gap in the field of EEs taking into consideration higher education institutions. It also revealed the embryonic state of research (2011–2022) and reinforced the scientific importance of the topic since about 56% of the articles were published in the last 3 years. The results were published in a variety of indexed journals. However, this study shows the limitations in other literature reviews.

Despite considering that this study constitutes a work that will be the object of the development in the coming years, the study is not without limitations. The first limitation concerns to the search strategy. This study is based on the regular updating of databases with the consequent increase or decrease in the number of indexed journals, so a bibliometric analysis of an emerging topic can be subject to substantial variations in just a very few years. The other limitation of this study is that it used two different databases to analyse a particular topic. Despite being two of the most influential databases, the overview could be improved by including other databases. Another limitation is the subjectivity present in the scientific articles analysis. Although bibliometric methods help to reduce subjectivity, it is not possible to completely exclude some interpretative biases.

Data Availability

Available upon reasonable request from the corresponding author.

Acs, Z. J., Autio, E., & Szerb, L. (2014). National systems of entrepreneurship: Measurement issues and policy implications. Research Policy, 43 (3), 449–476.

Article   Google Scholar  

Allahar, H., & Sookram, R. (2019). A university business school as an entrepreneurial ecosystem hub. Technology Innovation Management Review, 9 (11), 15–25.

Alvedalen, J., & Boschma, R. (2017). A critical review of entrepreneurial ecosystems research: Towards a future research agenda. European Planning Studies, 25 (6), 887–903.

Aria, M., & Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Infometrics, 11 (4), 959–975. RSL.

Astley, W. G., & Van de Ven, A. H. (1983). Central perspectives and debates in organization theory. Administrative Science Quarterly, 28 (2), 245–273. https://doi.org/10.2307/2392620

Audretsch, D., & Belitski, M. (2017). Entrepreneurial ecosystems in cities: Establishing the framework conditions. The Journal of Technology Transfer, 42 (5), 1030–1051.

Audretsch, D., Cunningham, J., Kuratko, D., Lehman, E., & Menter, M. (2019). Entrepreneurial ecosystems: Economic, technological, and societal impacts. The Journal of Technology Transfer, 44 , 313–325.

Article   PubMed   Google Scholar  

Audretsch, B., & Link, N. (2017). Universities and the entrepreneurial ecosystem (pp. 13–50). Edward Elgar.

Bae, T., Qian, S., Miao, C., & Fiet, J. (2014). The relationship between entrepreneurship education and entrepreneurial intentions: A meta-analytic review. Entrepreneurship Theory & Practice, 38 (2), 217–254.

Bischoff, K., Volkmann, C., & Audretsch, D. (2018). Stakeholder collaboration in entrepreneurship education: An analysis of the entrepreneurial ecosystems of European higher educational institutions. Journal of Technology Transfer, 43 , 20–46.

Boh, W., De-Haan, U., & Strom, R. (2016). University technology transfer through entrepreneurship: Faculty and students in spinoffs. The Journal of Technology Transfer, 41 (4), 661–669.

Breznitz, S., & Zhang, Q. (2019). Fostering the growth of student start-ups from university accelerators: An entrepreneurial ecosystem perspective. Industrial and Corporate Change, 28 (4), 855–873.

Brown, R., & Mason, C. (2017). Looking inside the spiky bits: A critical review and conceptualisation of entrepreneurial ecosystems. Small Business Economics, 49 , 11–30.

Brush, C. G. (2014). Exploring the concept of an entrepreneurship education ecosystem. In  Innovative pathways for university entrepreneurship in the 21st century  (vol. 24, pp. 25–39). Emerald Group Publishing Limited.

Carayannis, E., Grigoroudis, E., Campbell, D., Meissner, D., & Stamati, D. (2017). The ecosystem as helix: An exploratory theory-building study of regional co-opetitive entrepreneurial ecosystems as Quadruple/Quintuple Helix Innovation Models. R & D Management , 148–162.

Carneiro, A., Portugal, P., & Varejão, J. (2014). Catastrophic job destruction during the Portuguese economic crisis. Journal of Macroeconomics, 39 , 444–457.

Clarysse, B., Wright, M., & Van de Velde, E. (2011). Entrepreneurial origin, technological knowledge, and the growth of spin-off companies. Journal of Management Studies, 48 (6), 1420–1442.

Clarysse, B., Wright, M., Bruneel, J., & Mahajan, A. (2014). Creating value in ecosystems: Crossing the chasm between knowledge and business ecosystems. Research Policy, 43 (7), 1164–1176.

Cohen, B. (2006). Sustainable valley entrepreneurial ecosystems. Business Strategy Environment, 15 (1), 1–14.

Article   MathSciNet   ADS   Google Scholar  

Colombo, M. G., Dagnino, G. B., Lehmann, E. E., & Salmador, M. (2019). The governance of entrepreneurial ecosystems. Small Business Economics, 52 , 419–428.

Engle, R., Dimitriadi, N., Gavidia, J., Schlaegel, C., Delanoë-Gueguen, S., Alvarado, I., He, X., Baume, S., & Wolff, B. (2010). Entrepreneurial intent: A twelve country evaluation of Ajzen’s model on planned behavior. International Journal of Entrepreneurial Behaviour and Research., 16 , 35–57.

Etzkowitz, H., & Leydesdorff, L. (2000). The dynamics of innovation: From national systems and “mode 2” to a triple helix of university–industry–government relations. Research Policy, 29 (2), 109–123.

Etzkowitz, H., & Zhou, C. (2017). Hélice Tríplice: Inovação e Empreendedorismo Universidade-Indústria-Governo. Estudos Avançados, 31 (90), 23–48.

Feldman, M., Siegel, D. S., & Wright, M. (2019). New developments in innovation and entrepreneurial ecosystems. Industrial and Corporate Change, 28 (4), 817–826.

Ferreira, J., Fernandes, C., & Kraus, S. (2019). Entrepreneurship research: Mapping intellectual structures and research trends. Review of Managerial Science, 13 , 181–205.

Ferreira-Neto, M., de Carvalho-Castro, J., de Sousa-Filho, J., & Souza-Lessa, B. (2023). The role of self-efficacy, entrepreneurial passion, and creativity in developing entrepreneurial intentions. Frontiers in. Psychology, 14 , 1–14.

Fetters, L., Patricia, G., Mark, P., & Butler, J. (2010). The development of university-based entrepreneurship ecosystems: Global practices . Edward Elgar.

Book   Google Scholar  

Fini, R., Grimaldi, R., Santoni, S., & Sobrero, M. (2011). Complements or substitutes? The role of universities and local context in supporting the creation of academic spin-offs. Research Policy, 40 , 1113–1127.

Fini, R., Fu, K., Mathisen, M. T., Rasmussen, E., & Wright, M. (2017). Institutional determinants of university spin-off quantity and quality: A longitudinal, multilevel, cross-country study. Small Business Economics, 48 , 361–391.

Fiore, E., Sansone, G., & Paolucci, E. (2019). Entrepreneurship education in a multidisciplinary environment: Evidence from an entrepreneurship programme held in Turin. Administration Science, 9 (1), 28.

Google Scholar  

Freeman, J. H., & Audia, P. G. (2006). Community ecology and the sociology of organizations. Annual Review of Sociology, 32 , 145–169.

Graham, R. (2014). Creating university-based entrepreneurial ecosystems evidence from emerging world leaders . MIT Skoltech Initiative.

Guindalini, C., Verreyenne, M.-L., & Kastelle, T. (2021). Taking scientific inventions to market: Mapping the academic entrepreneurship ecosystem. Technological Forecasting & Social Change, 173 , 1–12.

Hallam, C., Novick, D., Gilbert, D., Frankwick, G., Wenker, O., & Zanella, G. (2017). Academic entrepreneurship and the entrepreneurial ecosystem: The UT transform project. Academy of Entrepreneurship Journal, 23 (1), 77–90.

Hayter, C. (2016). A trajectory of early-stage spinoff success: The role of knowledge intermediaries within an entrepreneurial university ecosystem. Small Business Economics, 47 , 633–656.

Hayter, C., Lubynsky, R., & Maroulis, S. (2017). Who is the academic entrepreneur? The role of graduate students in the development of university spinoffs. The Journal of Technology Transfer, 42 , 1237–1254.

Hayter, C., Nelson, A., Zayed, S., & O’Connor, A. (2018). Conceptualizing academic entrepreneurship ecosystems: A review, analysis and extension of the literature. The Journal of Technology Transfer, 43 , 1039–1082.

Heitor, M., Horta, H., & Mendonça, J. (2014). Developing human capital and research capacity: Science policies promoting brain gain. Technological Forecasting and Social Change, 82 , 6–22.

Huang, C.-K., Neylon, C., Brookes-Kenworthy, C., Hosking, R., Montgomery, L., Wilson, K., & Ozaygen, A. (2020). Comparison of bibliographic data sources: Implications for the robustness of university rankings. Quantitative Science Studies, 1 , 445–478.

Hulland, J. (2020). Conceptual review papers: Revisiting existing research to develop and refine theory. AMS Review, 10 (1–2), 27–35.

Isenberg, D. (2010). How to start an entrepreneurial revolution. Harvard Business Review, 88 (6), 40–50.

Isenberg, D. (2011). The entrepreneurship ecosystem strategy as a new paradigm for economic policy: Principles for cultivating entrepreneurship . Institute of International European Affairs.

Johnson, D., Bock, A., & George, G. (2019). Entrepreneurial dynamism and the built environment in the evolution of university entrepreneurial ecosystems. Industrial and Corporate Change, 28 (4), 941–959.

Kansheba, J., & Wald, A. (2020). Entrepreneurial ecosystems: A systematic literature review and research agenda. Journal of Small Business and Enterprise Development, 27 (6), 943–964.

Kobylinska, U., & Lavios, J. (2020). Development of research on the university entrepreneurship ecosystem: Trends and areas of interest of researchers based on a systematic review of literature. Oeconomia Copernicana, 11 (1), 117–133.

Kuratko, D. (2005). The emergence of entrepreneurship education: Development, trends, and challenges. Entrepreneurship Theory and Practice, 29 (5), 577–597.

Lanero, A., Burguete, J., Rodriguez, P., & Miguélez, M. (2011). The Impact of entrepreneurship education in European universities: An Intention-based approach analyzed in the spanish area. International Review on Public and Nonprofit Marketing, 8 (2), 111–130.

Liguori, E., Bendickson, J., Solomon, S., & McDowell, W. (2019). Development of a multi-dimensional measure for assessing entrepreneurial ecosystems. Entrepreneurship & Regional Development, 31 (1–2), 7–21.

Liñan, F., & Fayolle, A. (2015). A systematic literature review on entrepreneurial intentions: Citation, thematic analyses, and research agenda. International Entrepreneurship Management Journal, 11 , 907–933.

Lockett, A., & Wright, M. (2005). Resources, capabilities, risk capital and the creation of university spin-out companies. Research Policy, 34 , 1043–1057.

Malecki, E. (2011). Connecting local entrepreneurial ecosystems to global innovation networks: Open innovation, double networks and knowledge integration. International of Journal Entrepreneurship and Innovation Management, 14 (1), 36–59.

Malecki, E. (2018). Entrepreneurship and entrepreneurial ecosystems. Geography Compass, 12 , 1–21.

Marques, C., Marques, A., Braga, V., & Ratten, V. (2021). Technological transfer and spillovers within the RIS3 entrepreneurial ecosystems: A quadruple helix approach. Knowledge Management Research & Practice, 19 (1), 127–136.

Mason, C., & Brown, R. (2014). Entrepreneurial ecosystems and growth oriented entrepreneurship . OECD LEED Programme. Dutch Ministry of Economic Affairs.

Meyer, M. H., Lee, C., Kelley, D., & Collier, G. (2020). An assessment and planning methodology for university-based: Entrepreneurship ecosystems. The Journal of Entrepreneurship, 29 (2), 259–292.

Miller, J. D., & Acs, J. Z. (2017). The campus as entrepreneurial ecosystem: The university of chicago. Small Business Economic, 49 , 75–95.

Neck, H., Meyer, G., Cohen, B., & Corbett, A. (2004). An entrepreneurial system view of new venture creation. Journal of Small Business Management, 42 , 190–208.

Nicotra, M., Romano, M., Giudice, M., & Scillaci, C. (2018). The causal relation between entrepreneurial ecosystem and productive entrepreneurship: A measurement framework. Journal of Technology Transfer, 43 , 640–673.

O’Brien, E., Cooney, T. M., & Blenker, P. (2019). Expanding university entrepreneurial ecosystems to under-represented communities. Journal of Entrepreneurship and Public Policy, 8 (3), 384–407.

Pita, M., Costa, J., & Moreira, A. C. (2021). The effect of university missions on entrepreneurial initiative across multiple entrepreneurial ecosystems: Evidence from Europe. Education Sciences, 11 (12), 762.

Peterman, N. E., & Kennedy, J. (2003). Enterprise education: Influencing students’ perceptions of entrepreneurship. Entrepreneurship theory and practice, 28 (2), 129–144.

Pranckuté, R. (2021). Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications, 9 , 12. https://doi.org/10.3390/publications9010012

Prokop, D., & Thompson, P. (2023). Defining networks in entrepreneurial ecosystems: The openness of ecosystems. Small Business Economics, 61 , 517–538.

Pruett, M., Shinnar, R., Toney, B., Llopis, F., & Fox, J. (2009). Explaining entrepreneurial intentions of university students: A cross-cultural study. International Journal of Entrepreneurial Behaviour & Research, 15 (6), 571–594.

Sanchez, J. C. (2013). The impact of an entrepreneurship education program on entrepreneurial competencies and intention. Journal of Small Business Management, 51 (3), 447–465.

Sansone, G., Ughetto, E., & Landoni, P. (2021). Entrepreneurial intention: An analysis of the role of student-led entrepreneurial organizations. Journal of International Entrepreneurship, 19 (3), 399–433.

Santos, S., Costa, S., Neumeyer, X., & Caetano, A. (2016). Bridging entrepreneurial cognition research and entrepreneurship education: What and how. Annals of Entrepreneurship Education and Pedagogy , 83–108.

Scott, P. (2000). Globalisation and higher education: challenges for the 21st century. Journal of Studies in International Education, 4 , 3–10.

Schaeffer, V., & Matt, M. (2016). Development of academic entrepreneurship in a non-mature context: The role of the university as a hub-organisation. Entrepreneurship & Regional Development, 28 (9–10), 724–745.

Secundo, G., Mele, G., Del Vecchio, P., & Degennaro, G. (2021). Knowledge spillover creation in university-based entrepreneurial ecosystem: The role of the Italian “contamination labs.” Knowledge Management Research & Practice, 19 (1), 137–151.

Sherwood, A. (2018). Universities and the entrepreneurship ecosystem. In S. Globerman, & J. Clemens (Eds),  Demographics and entrepreneurship. Mitigating the effects of an aging population (239–282). Fraser Institute.

Sousa, L., & Paiva, T. (2023). Work risks in pandemic times. EDULEARN23 Proceedings , 526–535.

Souitaris, V., Zerbinati, S., & Al-Laham, A. (2007). Do entrepreneurship programmes raise entrepreneurial intention of science and engineering students? the effect of learning, inspiration and resources. Journal of Business Venturing, 22 , 566–591.

Spigel, B. (2017). The relational organization of entrepreneurial ecosystems. Entrepreneurship Theory and Practice, 41 (1), 49–72. https://doi.org/10.1111/etap.12167

Article   ADS   Google Scholar  

Spigel, B., & Harrison, R. (2018). Toward a process theory of entrepreneurial ecosystems. Strategic Entrepreneurship Journal, 12 (1), 151–168. https://doi.org/10.1002/sej.1268

Spigel. (2018). Envisioning a new research agenda for entrepreneurial ecosystems: Top-down and bottom-up approaches. In J. A. Katz, & A. C. Corbett (Eds.), Reflections and extensions on key papers of the first twenty-five years of advances (advances in entrepreneurship, firm emergence and growth) (Vol. 20, pp. 127–147), Emerald Publishing Limited. https://doi.org/10.1108/S1074-754020180000020004

Stam, E. (2015). Entrepreneurial ecosystems and regional policy: A sympathetic critique. European Planning Studies, 23 (9), 1759–1769.

Stam, E., & Spigel, B. (2017). Entrepreneurial ecosystems. In R. Blackburn, D. De Clercq, J. Heinonen (Eds.), The Handbook for entrepreneurship and small business and entrepreneurship . SAGE.

Thelwall, M. (2008). Bibliometrics to webometrics. Journal of Information Science, 34 , 605–621.

Theodoraki, C., Messeghem, K., & Rice, M. (2018). A social capital approach to the development of sustainable entrepreneurial ecosystems: An explorative study. Small Business Economics, 51 , 153–170.

Van de Ven, A. H. (1993). The development of an infrastructure for entrepreneurship. Journal of Business Venturing, 8 , 211–230.

Vanevenhoven, J. (2013). Advances and challenges in entrepreneurship education. Journal of Small Business Management, 51 (3), 466–470.

Vohora, A., Wright, M., & Lockett, A. (2004). Critical junctures in the development of university high-tech spinout companies. Research Policy, 33 , 147–175.

Wang, X., Sun, X., Liu, S., & Mu, C. (2021). A preliminary exploration of factors affecting a university entrepreneurship ecosystem. Frontiers in Psycology, 12 , 1–12.

Yi, G. & Uyarra, E. (2018). Process mechanisms for academic entrepreneurial ecosystems: Insights from a case study in China. Science, Technology & Society, 23 (1), 85–106. RSL.

Download references

Open access funding provided by FCT|FCCN (b-on). This research is supported by national funds, through the FCT–Portuguese Foundation for Science and Technology under the project UIDB/04011/2020 ( https://doi.org/10.54499/UIDB/0401 1/2020), and by NECE-UBI, Research Centre for Business Sciences, Research Centre under the project UIDB/04630/2022 and by CEECINST/00127/2018/CP1501/CT0010.

Author information

Authors and affiliations.

Instituto Politécnico de Bragança – ESACT, Mirandela, Portugal

Maria Patrocínia Correia

CETRAD Rearch Unit and University of Trás-os-Montes e Alto Douro and NECE Research Center for Business Sciences, Vila Real, Portugal

Maria Patrocínia Correia, Carla Susana Marques & Rui Silva

Faculty of Business and Economics, South East European University, Tetovo, North Macedonia

Veland Ramadani

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Carla Susana Marques .

Ethics declarations

Conflict of interest.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Correia, M.P., Marques, C.S., Silva, R. et al. Academic Entrepreneurship Ecosystems: Systematic Literature Review and Future Research Directions. J Knowl Econ (2024). https://doi.org/10.1007/s13132-024-01819-x

Download citation

Received : 20 June 2023

Accepted : 02 February 2024

Published : 16 February 2024

DOI : https://doi.org/10.1007/s13132-024-01819-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Academic entrepreneurship
  • Entrepreneurial ecosystems
  • Higher education institutions
  • Universities
  • Bibliometric analysis
  • Systematic literature review

Advertisement

  • Find a journal
  • Publish with us
  • Track your research

IMAGES

  1. Example of a Literature Review for a Research Paper by

    what is reviewing the literature in a research paper

  2. 15 Literature Review Examples (2024)

    what is reviewing the literature in a research paper

  3. How To Make A Literature Review For A Research Paper

    what is reviewing the literature in a research paper

  4. basic parts of a literature review

    what is reviewing the literature in a research paper

  5. The Importance of Literature Review in Scientific Research Writing

    what is reviewing the literature in a research paper

  6. How to Write a Literature Review Complete Guide

    what is reviewing the literature in a research paper

VIDEO

  1. How To Read Research Papers For Literature Review #shorts

  2. Research Methods: Writing a Literature Review

  3. REVIEWING LITERATURE REVIEW DALAM PENELITIAN QUALITATIVE

  4. Review of Literature

  5. Write Your Literature Review FAST

  6. Review of Literature #research #researchproposal

COMMENTS

  1. How to Write a Literature Review

    A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic. There are five key steps to writing a literature review:

  2. Writing a Literature Review

    A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays).

  3. What is a literature review?

    A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations.

  4. How to write the literature review of your research paper

    Literature review is one of the pillars on which your research idea stands since it provides context, relevance, and background to the research problem you are exploring. Types of literature review Literature reviews can be categorized as experimental and theoretical.

  5. How To Write A Literature Review

    A literature review is much more than just another section in your research paper. It forms the very foundation of your research. It is a formal piece of writing where you analyze the existing theoretical framework, principles, and assumptions and use that as a base to shape your approach to the research question.

  6. What is a Literature Review?

    A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research. There are five key steps to writing a literature review: Search for relevant literature Evaluate sources Identify themes, debates and gaps

  7. Literature Review

    A literature review is a comprehensive and critical analysis of the existing literature on a particular topic or research question. It involves identifying, evaluating, and synthesizing relevant literature, including scholarly articles, books, and other sources, to provide a summary and critical assessment of what is known about the topic.

  8. Steps in Conducting a Literature Review

    A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question. That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

  9. Research Guides: Literature Reviews: What is a Literature Review?

    A literature review is meant to analyze the scholarly literature, make connections across writings and identify strengths, weaknesses, trends, and missing conversations. A literature review should address different aspects of a topic as it relates to your research question.

  10. How to write a superb literature review

    The best proposals are timely and clearly explain why readers should pay attention to the proposed topic. It is not enough for a review to be a summary of the latest growth in the literature: the ...

  11. Getting started

    What is a literature review? Definition: A literature review is a systematic examination and synthesis of existing scholarly research on a specific topic or subject. Purpose: It serves to provide a comprehensive overview of the current state of knowledge within a particular field. Analysis: Involves critically evaluating and summarizing key findings, methodologies, and debates found in ...

  12. Literature Reviews

    Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field.

  13. Literature Review: The What, Why and How-to Guide

    "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are.

  14. 5. The Literature Review

    Definition A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated.

  15. Writing a Literature Review Research Paper: A step-by-step approach

    A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.

  16. What is a "Literature Review"?

    help "make the case" for why someone is writing their paper or conducting their research; can be the "background" section of a larger paper or it can be the focus of an entire paper; Goals of a Literature Review. provide an overview of the scholarly literature on a chosen topic including the major theories, issues, works, and debates in the field

  17. Learn how to write a review of literature

    Generally, the purpose of a review is to analyze critically a segment of a published body of knowledge through summary, classification, and comparison of prior research studies, reviews of literature, and theoretical articles. Writing the introduction In the introduction, you should:

  18. Writing a literature review

    Writing a literature review requires a range of skills to gather, sort, evaluate and summarise peer-reviewed published data into a relevant and informative unbiased narrative. Digital access to research papers, academic texts, review articles, reference databases and public data sets are all sources of information that are available to enrich ...

  19. Reviewing literature for research: Doing it the right way

    Review of research literature can be summarized into a seven step process: (i) Selecting research questions/purpose of the literature review (ii) Selecting your sources (iii) Choosing search terms (iv) Running your search (v) Applying practical screening criteria (vi) Applying methodological screening criteria/quality appraisal (vii) Synthesizin...

  20. Ten Simple Rules for Writing a Literature Review

    Reviewing the literature requires the ability to juggle multiple tasks, from finding and evaluating relevant material to synthesising information from various sources, from critical thinking to paraphrasing, evaluating, and citation skills [7].

  21. Reviewing the Research Literature

    Reviewing the research literature means finding, reading, and summarizing the published research relevant to your question. An empirical research report written in American Psychological Association (APA) style always includes a written literature review, but it is important to review the literature early in the research process for several reasons.

  22. Writing a Literature Review

    A literature review provides a reader with a comprehensive look at previous discussions prior to the one the reviewer will be making in his/her own research paper, thesis, or dissertation. In short, a literature review shows readers where the reviewer is entering the academic conversation on a particular topic in the context of existing ...

  23. Literature Review Research

    Literature Review is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works. Also, we can define a literature review as the ...

  24. Literature review as a research methodology: An ...

    In addition, a literature review is an excellent way of synthesizing research findings to show evidence on a meta-level and to uncover areas in which more research is needed, which is a critical component of creating theoretical frameworks and building conceptual models.

  25. Research Guides: Literature Reviews: Concept Mapping

    A concept map or mind map is a visual representation of knowledge that illustrates relationships between concepts or ideas. It is a tool for organizing and representing information in a hierarchical and interconnected manner. At its core, a concept map consists of nodes, which represent individual concepts or ideas, and links, which depict the relationships between these concepts.

  26. Home

    We would like to show you a description here but the site won't allow us.

  27. 'It depends': what 86 systematic reviews tell us about what strategies

    This review updates and extends our previous review of systematic reviews of interventions designed to implement research evidence into clinical practice. To identify potentially relevant peer-reviewed research papers, we developed a comprehensive systematic literature search strategy based on the terms used in the Grimshaw et al. [ 9 ] and ...

  28. The complexity of leadership in coproduction practices: a guiding

    This systematic literature review is based on a study protocol on coproduction research in the context of health and social care sectors [], and data were obtained from a published scoping review, where the full search strategy is provided [].The scoping review set out to identify 'what is out there' and to explore the definitions of the concepts of coproduction and codesign.

  29. Academic Entrepreneurship Ecosystems: Systematic Literature Review and

    Research on the entrepreneurship ecosystem, based on different data and scales, limits the acceptance of a single definition. This conceptual limitation and the still recent research and higher education institutions have come to be seen as ecosystems associated with entrepreneurship. The aim of this study is to contribute to the field of knowledge, identify current and emerging thematic areas ...