The use of artificial intelligence and algorithms can cause problems in the education sector. This is evident from research by the Dutch Data Protection Authority (AP). Published in a Wednesday report the supervisor states that these technologies can increase inequality of opportunity in the classroom. Another concern of the AP is that students’ private data is stored in online learning environments. This can have major consequences in the event of a data breach, for example.
With the help of artificial intelligence and algorithms, teachers have direct insight into the progress, behavior and development of students in the classroom. In online learning environments, students complete assignments about the course material. Teachers receive various data about assignments from behind their own computer screen. In addition to the answers, they can also see how long it took students to answer a question. This should ensure that the teacher can better respond to what the class has difficulty with or is good at.
But according to the AP, that does not always work out well. It can damage the development of pupils and students, the privacy regulator writes in the report. For example, the program may misinterpret the information about the assignments completed and thus bias students. This can be at the expense of equality of opportunity and diversity in the classroom. Moreover, the autonomy of students and teachers is coming under pressure.
The regulator also points out that artificial intelligence and algorithms are not transparent enough. According to the AP, it is important to discuss these risks in class. The AP wants a policy on the desirability of these technologies in education and believes that teachers should gain more knowledge about artificial intelligence and algorithms.