A world where you never know if you're talking to another human being unless you're right in front of them.
You wouldn't be able to trust that it's your own mother on the phone. Every thread and chat may just be you talking to yourself through a pile of code. And god knows who that code's talking to. Photo, video evidence in court? Can't prove it's not real, your honor.
An artificial world. Everyone sequestered away into their own bespoke realities, separated by unbreakable walls of uncertainty.
I think it's just the nature of the beast, a lot of AI generated stuff seems to work with a 'platonic ideal' if you want something that outputs believable stuff that ideal needs to be enforced quite strongly and that'll then override what makes things special that's why when I put in three voice samples it output the right pitch but a completely wrong 'dialect/accent' i.e. it enforced the 'platonic ideal' it had of what language is, so far the believeable stuff I've heard is all voice actors who due to the nature of their work have to have a standard accent, emulating a mom that maybe says a word weird or who has a strong xyz accent is pretty far away and might never happen unless someone spends hours to imitate a specific speech pattern.