Try growing out all those seeds at once and culling the males as they appear, else it really is a crapshoot

Also depending on how big the present plant is it may/not be worthwhile to extract from. Trichomes cover the entire above-ground portion of the plant (it's sunscreen and insect repellant), but the concentration and type differs between stalk and flower. Flower is covered in the easily visible capitate stalked trichs, whereas the (bark on the) stems is covered in less visible flat/platelike trichs of which I can't recall the name.
Tldr: if considering steeping stems, consider steeping just the bark