I have to say that I clean my trunks with a soft toothbrush and fresh water to keep them clean.
No, it does no harm but it can get out of control and lets face it we work hard on our nabari, to make a focal point of it, such a shame to let it get covered up with moss.
Just my 2 cents...
Mike