I'm pretty sure that anyone using your planbuild blueprint file will need the same mods to see what you see. If you can load up the file, people can test it then let you know. I'm happy to download and check it out.
Have you checked the 'marcopogo' configuration file on the server side? There are a few check boxes to all allow the blueprint rune and sharing of all players on the server. If these are not set up for access , you will have no access.
I do enjoy playing modded Valheim but not for building. Clutter is excellent as is the HoneyPlus mod(please update this if the creator is reading!!), but not the build mods. I know they are brilliant but with the Vanilla build, its a lot easier for a lot more people to enter the competition as the Gizmo and the likes take a lot of time and effort to perfect to get the most out of it with only a few being able to do so.