Researcher-in-the-loop for systematic reviewing

The idea of combining human intelligence and machine learning can be found in techniques like active learning (AL) and Human-in-the-Loop (HITL) machine learning. In AL and HITL, the human classifies unlabeled items the model selects to learn from, e.g., items for which the model is uncertain. These techniques are proven to be effective for training models. WIthin the ASReview-universe, this technique is called Researcher-in-the-loop for systematic reviewing.

Van de Schoot, Rens, & De Bruin, Jonathan. (2020). Researcher-in-the-loop for systematic reviewing of text databases. Presented at the SciNLP: Natural Language Processing and Data Mining for Scientific Text, Zenodo. http://doi.org/10.5281/zenodo.4013207.

Human-in-the-loop
Go to paper
Go to video
Categories: Introduction, Scientific Papers

Check out similar projects

Optimizing ASReview simulations

Optimizing ASReview simulations with multiprocessing solutions for ‘light-data’ and ‘heavy-data’ users via a Kubernetes cluster.

The FORAS project

The FORAS project will replicate and extend an original review integrating advanced machine-learning techniques via the OpenAlex database.

The Mega Meta project: Substance use, anxiety and depression

The MegaMeta project is a large scale project to review factors that contribute to substance use, anxiety and depressive disorders. Read more information on the search and screening protocol, hyperparameter tuning and post-processing used in this post.

Using ASReview on your tablet

AI-aided literature screening in medical guideline development

In a time of exponential growth of new evidence supporting clinical decision making, combined with a labor-intensive process of selecting this evidence, there is a need for methods to speed up current processes in order to keep medical guidelines up-to-date.

ASReview paper explosion

Paper introducing the ASReview project

We show that by using active learning, ASReview can lead to far more efficient reviewing than manual reviewing, while exhibiting adequate quality. Furthermore, the presented software is fully transparent and open source.