Like in Stalker where the mutant dogs will turn tail and flee if they take too much damage or if you kill enough of their pack members. Red Dead Redemption's animals also ran away if a fight wasn't going their way.
Actually, Rockstar games are pretty good with this sort of stuff in general. I'm pretty sure you could shoot guns of of people's hands in RDR to make them put their hands up, or cause a fatal gunshot wound that would make them crawl around on their belly and call for help. Both GTA 4 and 5's enemies have injury states where they will take potshots at you with a pistol while bleeding on the ground or just passively clutch their wounds until they die.
I guess it wouldn't work in arcadey or linear games where the point is to kill everything on screen, but for anything more open-ended that tries to go for something approaching realism it'd be nice if the enemies you faced felt more alive and/or showed some basic survival instincts.
i think it's just that the most popular TTRPGs mechanically revolve around killing enemies and getting rewarded for killing enemies
Blades in the Dark has mechanics that explicitly punish you for killing, and 90% of its rules don't revolve around a separate wargame minigame you pull out every time you start a fight
I don't think I've played a loot and kill-xp RPG in ages, but nonetheless very few surrendering gangers or stormtroopers. Maybe it's my GMs.
The last part of combat is usually just mopping up anyway, can probably be handwaved
I give players XP for resolving the encounter. Doesn't matter how they do it - Sneaking by, talking their way through, fighting, or one of the absolutely bizarre take a third option things players come up with. As long as they figure out a way to "win" (and usually if they "lose") they get XP and usually some amount of treasure out of it. Something I really dislike about older D&Ds and Pathfinder is how tightly player progression is tied to finding treasure and gold, as it can get in the way of narrative.
it's not just that kill = xp, it's also that popular TTRPGS whether it's GURPS, D&D, or the newest Star Wars rpg, will have like 500 rules for bashing someone's health bar to zero in the wargame minigame and then have one line at the back of the dusty GM section going "i guess you can make people retreat or surrender or whatever lmao". yeah you can handwave it, but it's a problem when the default assumption for the game's rules and balancing is that everyone fights to the death and surrender/retreat being treated as optional rules or often not at all
the game mechanics affect how the players and GM interact with the setting, and Blades in the Dark ending up less lethal was a reflection of it not being focused on murder minigames and having mechanics reinforcing less lethal resolution