Researcher-in-the-loop for systematic reviewing

The idea of combining human intelligence and machine learning can be found in techniques like active learning (AL) and Human-in-the-Loop (HITL) machine learning. In AL and HITL, the human classifies unlabeled items the model selects to learn from, e.g., items for which the model is uncertain. These techniques are proven to be effective for training models. WIthin the ASReview-universe, this technique is called Researcher-in-the-loop for systematic reviewing.

Van de Schoot, Rens, & De Bruin, Jonathan. (2020). Researcher-in-the-loop for systematic reviewing of text databases. Presented at the SciNLP: Natural Language Processing and Data Mining for Scientific Text, Zenodo.