Innate differences do not necessitate hierarchies. Someone can be better at something than someone else without a hierarchy being formed off of that difference. There’s value judgment and measurement, but they don’t have to go hand in hand, and they definitely don’t universally. I can be better at turning a shoe into a projectile than someone else but there’s no additional hierarchy formed off of that. I can be the best jumper without the authority to tell other people how to jump.

So I wanna say; I don't disagree with you in saying that there isn't anything about innate differences that logically necessitates hierarchy (and indeed, I would personally prefer if it didn't). However it is my opinion, based off of my personal experience as somebody with ASD, that those differences are very likely to elicit value judgments whether that's formally recognized, or not. One of the reasons why I tend to prefer formal & explicit systems of power (such as States), over informal ones (which I think would ultimately still exist within a nominally Anarchist society tbh), is because it gives a definite entity & structure one can appeal to (or challenge!) for redress & compensation for violation of ones social rights.

My concern with an Anarchist social order, is that much like the way that the "Free Market" aims to make invisible the structure of Labor Exploitation & Class Power at the heart of Capitalism. The devolution of social structure down to the free-associative networks of disaggregated individuals that (IMO) Anarchism generally seems to aim towards, could plausibly render invisible all manner of forms of interpersonal prejudice & systematic biases against social minorities & the disabled.

That's at least I think the best way I can articulate my core concern at the moment.