The idea of combining human intelligence and machine learning can be found in machine learning techniques like active learning (AL) and Human-in-the-Loop (HITL) machine learning. In AL and HITL, the human classifies unlabeled items the model selects to learn from, e.g., items for which the model is uncertain. These techniques are proven to be effective for training models.
Van de Schoot, Rens, & De Bruin, Jonathan. (2020). Researcher-in-the-loop for systematic reviewing of text databases. Presented at the SciNLP: Natural Language Processing and Data Mining for Scientific Text, Zenodo. http://doi.org/10.5281/zenodo.4013207.