Simulation Study on Risk Analysis Documents

The research team of ASReview conducted a simulation study on risk analysis documents to evaluate the performance of Active Learning to conduct systematic reviews for the Royal Dutch Pharmacists Association (Koninklijke Nederlandse Maatschappij ter bevordering der Pharmacie, KNMP in Dutch).

Skip right to:

Research partner ASReview: KNMP

The research questions

The project aims to answer three research questions:

  1. How much time can be saved by using active learning on different risk analysis documents of the Medicine Information Centre (Geneesmiddel Informatie Centrum, GIC in Dutch)?
  2. Is it useful to include the relevant papers from the previous studies as prior information in ASReview when updating an existing risk analysis document?
  3. Is it useful to include relevant papers from a previous risk analysis document within a certain group of medication as prior information in ASReview for a different risk analysis document from the same group?

Systematic Review Data

Within the OSF repository you can find the steps and script that produced the datasets which were used for simulation studies. It also details which datasets were used to answer specific research questions as well.

Gipmans, S., Ferdinands, G., van den Brand, S. A. G. E., van de Schoot, R., & Cheung, K.-C. (2021, September 21). Systematic Review Data for Risk Analysis Documents Medicine Information Centre from the Royal Dutch Pharmacists Association. OSF. doi: 10.17605/OSF.IO/F7MEV

Systematic Review Data – OSF

Scripts to perform the simulation studies

The actual simulation studies were run using the scripts stored in this repository.

 

Ferdinands, Gerbrich, De Bruin, Jonathan, van den Brand, Sofie, Cheung, Ka-Chun, Gipmans, Suzan, & Van de Schoot, Rens. (2021). Scripts for simulation report on risk analyses of the KNMP (v1.0). Zenodo. doi: 10.5281/zenodo.5771612

Simulation scripts – GitHub

Simulation Output

After running the pre-processing and simulation scripts you obtain the output, the results of the study. Take a look at the repository below!

 

Ferdinands, G., Gipmans, S., van den Brand, S. A. G. E., de Bruin, J., Cheung, K.-C., & van de Schoot, R. (2021, September 15). Results for Simulations of Risk Analysis Documents Medicine Information Centre from the Royal Dutch Pharmacists Association. OSF.  doi: 10.17605/OSF.IO/KCQHZ

Simulation Output – OSF
Categories: Scientific Papers, Simulation Studies, Special Use-Cases

Check out similar projects

Optimizing ASReview simulations

Optimizing ASReview simulations with multiprocessing solutions for ‘light-data’ and ‘heavy-data’ users via a Kubernetes cluster.

The FORAS project

The FORAS project will replicate and extend an original review integrating advanced machine-learning techniques via the OpenAlex database.

The Mega Meta project: Substance use, anxiety and depression

The MegaMeta project is a large scale project to review factors that contribute to substance use, anxiety and depressive disorders. Read more information on the search and screening protocol, hyperparameter tuning and post-processing used in this post.

Using ASReview on your tablet

AI-aided literature screening in medical guideline development

In a time of exponential growth of new evidence supporting clinical decision making, combined with a labor-intensive process of selecting this evidence, there is a need for methods to speed up current processes in order to keep medical guidelines up-to-date.

ASReview paper explosion

Paper introducing the ASReview project

We show that by using active learning, ASReview can lead to far more efficient reviewing than manual reviewing, while exhibiting adequate quality. Furthermore, the presented software is fully transparent and open source.

Systematic review data about depression

Explore the systematic review dataset that was used for the publication “Psychological theories of depressive relapse and recurrence” from Brouwer et al., 2019. From pre-processing to the final dataset, a look into the complete systematic review process behind this publication.