Teleperformance SE, the largest call-center operator in the world, is rolling out an artificial intelligence system that softens English-speaking Indian workers’ accents in real time in a move the company claims will make them more understandable.
I work in 911 dispatch in the US, in addition to my local callers who come from a variety of backgrounds with various accents and speech impediments, I also get calls from alarm companies and a lot of them seem to be outsourcing their call centers or at least hiring a lot of non-native speakers (looking at you, Johnson Controls)
When their accents are so thick that you can’t even understand a basic address, like 123 Main St in Springfield, and you’re counting on a timely dispatch for a fire alarm, that’s a problem.
We also have access to a translation service, but that really slows everything down because everything has to go through the interpreter, so off the bat it’s taking twice as long, and often significantly longer because I can’t know when to cut my caller off because the interpreter can’t really start until the caller finishes talking, so I don’t know if the 3 minute rant the caller went on actually is pertinent information I need to know, or are they just rambling and repeating the same useless details over and over again.
I sometimes have to use that translation service when the caller actually speaks pretty decent English but their accent is just totally incomprehensible to my English-speaking ears (especially when you throw in a bad phone connection, I swear some of my callers have found a way to make a phone call from a kazoo.) I’ve gotten a pretty good ear for the more common accents we get- Spanish, Korean, Hindi, Haitian Creole, Arabic, etc. but every once in a while a curveball gets thrown at me, I legitimately don’t think I’d ever heard someone speak Berber or Albanian until I got a call from someone who did, so I’ve never had a chance to train my ear to those accents.
You even get some situations where due to different dialects and regional accents, even the interpreters sometimes have trouble understanding the caller. For example, different Arabic dialects for example can have a lot of variation, and there’s some variation in Spanish dialects. If the interpreter is mostly fluent in Egyptian Arabic or Castilian Spanish, they can sometimes have a hard time understanding a caller who speaks Saudi Arabic or Guatemalan Spanish.
I’m not convinced that the AI tech is ready to be inserted into a 911 call, but if it ever does get to that point it could be a very useful tool for some of my callers. If we can sort of neutralize their accents, we may not need to use translators as often when the caller speaks OK English, and I may not have to ask the alarm to operator to repeat themselves 3 times to understand that they’re saying the alarm is at the “Wendy’s” (I would have sworn that they were saying “Landis,” we have a couple businesses by that name in the area, but none in that shopping center)
Even people who are native English speakers can be kind of hard to understand because of accents. Once in a while I get someone from the UK, or the US south, or hell, even just certain neighborhoods of the city I live just outside of, that can be hard to understand.
And don’t get me wrong, I love all the different accents, I’m proud of my own local linguistic quirks, I’m sad that my own ancestors didn’t keep their native languages alive with their children (I would be able to speak at least 4 or 5 different languages if they did) and these people who speak English with a heavy accent speak more languages than I can, so I can’t really talk shit on them. But it does present a significant barrier to communication and being able to smooth that out would be really useful sometimes
I work in 911 dispatch in the US, in addition to my local callers who come from a variety of backgrounds with various accents and speech impediments, I also get calls from alarm companies and a lot of them seem to be outsourcing their call centers or at least hiring a lot of non-native speakers (looking at you, Johnson Controls)
When their accents are so thick that you can’t even understand a basic address, like 123 Main St in Springfield, and you’re counting on a timely dispatch for a fire alarm, that’s a problem.
We also have access to a translation service, but that really slows everything down because everything has to go through the interpreter, so off the bat it’s taking twice as long, and often significantly longer because I can’t know when to cut my caller off because the interpreter can’t really start until the caller finishes talking, so I don’t know if the 3 minute rant the caller went on actually is pertinent information I need to know, or are they just rambling and repeating the same useless details over and over again.
I sometimes have to use that translation service when the caller actually speaks pretty decent English but their accent is just totally incomprehensible to my English-speaking ears (especially when you throw in a bad phone connection, I swear some of my callers have found a way to make a phone call from a kazoo.) I’ve gotten a pretty good ear for the more common accents we get- Spanish, Korean, Hindi, Haitian Creole, Arabic, etc. but every once in a while a curveball gets thrown at me, I legitimately don’t think I’d ever heard someone speak Berber or Albanian until I got a call from someone who did, so I’ve never had a chance to train my ear to those accents.
You even get some situations where due to different dialects and regional accents, even the interpreters sometimes have trouble understanding the caller. For example, different Arabic dialects for example can have a lot of variation, and there’s some variation in Spanish dialects. If the interpreter is mostly fluent in Egyptian Arabic or Castilian Spanish, they can sometimes have a hard time understanding a caller who speaks Saudi Arabic or Guatemalan Spanish.
I’m not convinced that the AI tech is ready to be inserted into a 911 call, but if it ever does get to that point it could be a very useful tool for some of my callers. If we can sort of neutralize their accents, we may not need to use translators as often when the caller speaks OK English, and I may not have to ask the alarm to operator to repeat themselves 3 times to understand that they’re saying the alarm is at the “Wendy’s” (I would have sworn that they were saying “Landis,” we have a couple businesses by that name in the area, but none in that shopping center)
Even people who are native English speakers can be kind of hard to understand because of accents. Once in a while I get someone from the UK, or the US south, or hell, even just certain neighborhoods of the city I live just outside of, that can be hard to understand.
And don’t get me wrong, I love all the different accents, I’m proud of my own local linguistic quirks, I’m sad that my own ancestors didn’t keep their native languages alive with their children (I would be able to speak at least 4 or 5 different languages if they did) and these people who speak English with a heavy accent speak more languages than I can, so I can’t really talk shit on them. But it does present a significant barrier to communication and being able to smooth that out would be really useful sometimes