Soul Memory would have been a much better mechanic if they had it work off of souls that you've invested in some way rather than just souls that you've had (and maybe also checked for the level of your weapons the way DS3 ended up doing). That way, you could intentionally lose souls to keep Sunbroing, and also a regular player who loses a bunch of souls by accident doesn't end up being as heavily penalized.