If you prefer to use potted flowers, you can try planting them into relatively small pots so that root growth has limitations.
Anything shorter can result in it not being tightly woven into the yarn, causing it arrive lose and increase pilling. https://pinterest.com/celestialstem/