Record conversations for training purposes? Last week is clothing brand Patagonia sued for using Talkdesk's AI tools as part of the contact center solution. That use would involve recording conversations and using them to train AI. This puts the well-known message text in the IVR in a different light. Who or what is trained with recorded conversations?
Talkdesk and many other CCaaS vendors use the content of their own users' customer conversations to train their AI models. CX Today now raises the question on whether the customers of the customers of CCaaS providers are aware of this and whether they are offered an opt-out.
In the case of Patagonia, it was not the CCaaS supplier (in this case Talkdesk) that was charged, but the customer who purchased the application. US analysts expect more of these types of lawsuits, because the standard IVR message – such as “this call is being recorded for training purposes” – will not be enough; According to them, Californian legislation goes much further.
There was a somewhat similar case in California in 2019 in which a Salesforce customer and Salesforce itself were sued. Another case has been filed against Navy Federal Credit Union and Verint, alleging that Verint "listens in on conversations" for real-time agent assist or speech analytics solutions without permission.
The analysts at CX Today suggest that end users should also provide information about where the call data is sent, whether it is kept in a different location, and so on. The question is whether this all fits in an understandable way in one understandable IVR communication.
Recording for AI, is that allowed under the GDPR?
There are two laws relevant when it comes to recording conversations for AI purposes. On the one hand, there is the AI Act, which requires transparency obligations. Part of that transparency provision is that people have the opportunity to “make well-considered choices or distance themselves from a certain situation.” The other law is the GDPR, relevant in the context of 'listening in' and storing conversations.
Arnoud Engelfriet van ICTRecht says that the GDPR has been requiring you to be clear about any reuse of personal data since 2018. “The well-known sentence about training purposes is very poor in that respect; I think it gives you little more than the right to train employees. There is certainly no authority to train an AI with it,” says Engelfriet.
“There is some debate as to whether training an AI is even covered by the GDPR, because it has an exception for statistical analysis and the result is not a file with personal data but a model with probabilities – this word usually comes after this word, unless it is phrase stood for it. But in many cases, the raw source data carries over and is left for retraining and checking. And that is certainly a file with personal data.”
Engelfriet would not be able to come up with a 'new standard sentence' so quickly that also covers the use of conversations for AI training.
Be careful when offering conversations to AI
Micha Groeneveld van BDO believes that the AI Act does not change much about this practice. The most important obligation under the AI Act regarding these types of applications concerns transparency. But this must involve direct interaction with AI systems and that is not the case with the IVR. The software supplier and its customer must comply with the AI Act.
Groeneveld sees more starting points from the GDPR. “It is clear that you can feel unobserved in a changing room, so it is not possible to simply hang cameras there. Similarly, you could argue that training AI with this kind of data is not easy. In addition, I find it extra important that the secrecy of correspondence and telecommunications is protected by Article 13 of our constitution,” says Groeneveld.
“In any case, you should be careful about indiscriminately recording telephone conversations for 'quality and training purposes', but especially if you then feed that information to AI, which may cause data to become anchored in a system where you do not want it.”
Moreover, as far as Groeneveld is concerned, the context also plays a role. “It seems obvious to me that it is even less likely that you will be able to use AI to conduct telephone conversations with mental health care workers than simple customer questions about the delivery time of the new sofa.” (Ziptone/Erik Bouwer)
Customer Experience, Featured


