Evaluating the Performance of Active Learning within Systematic Reviews

This systematic review focused on synthesizing information on studies that evaluated the performance of Active Learning compared to human reading.

Specifically, the goal was to create an overview of studies and or reports on simulation studies which investigate the benefit of Active Learning to accelerate systematic reviews within the screening of title and abstract phase compared to human screening.

More about this systematic review (methods and datasets) can be found on the OSF-page.

 

Van den Brand, S. A. G. E., & van de Schoot, R. (2021, September 17). A Systematic Review on Studies Evaluating the Performance of Active Learning Compared to Human Reading for Systematic Review Data. https://doi.org/10.17605/OSF.IO/T9HGM

Statistics of the systematic review on active learning performance in systematic reviews
Progress plot of the title and abstract screening. The number of relevant articles (in green) is shown compared to the number of irrelevant articles (in orange).
OSF-page
Categories: Data, Scientific Papers

Check out similar projects

Optimizing ASReview simulations

Optimizing ASReview simulations with multiprocessing solutions for ‘light-data’ and ‘heavy-data’ users via a Kubernetes cluster.

The FORAS project

The FORAS project will replicate and extend an original review integrating advanced machine-learning techniques via the OpenAlex database.

The Mega Meta project: Substance use, anxiety and depression

The MegaMeta project is a large scale project to review factors that contribute to substance use, anxiety and depressive disorders. Read more information on the search and screening protocol, hyperparameter tuning and post-processing used in this post.

Using ASReview on your tablet

AI-aided literature screening in medical guideline development

In a time of exponential growth of new evidence supporting clinical decision making, combined with a labor-intensive process of selecting this evidence, there is a need for methods to speed up current processes in order to keep medical guidelines up-to-date.

ASReview paper explosion

Paper introducing the ASReview project

We show that by using active learning, ASReview can lead to far more efficient reviewing than manual reviewing, while exhibiting adequate quality. Furthermore, the presented software is fully transparent and open source.

Systematic review data about depression

Explore the systematic review dataset that was used for the publication “Psychological theories of depressive relapse and recurrence” from Brouwer et al., 2019. From pre-processing to the final dataset, a look into the complete systematic review process behind this publication.