So are you wearing hair elastic(s) on your wrist or diving in head first?
If on your wrist, they cause no harm, but why not take them off before diving in?
That way they won't be all soggy the rest of the day.
In any case, I doubt the plants need trimming or the decor needs moving daily and I can't imagine how one would justify being arm deep in the tank for an entire day. If so, just maybe it's time to give your fish a break and find another obsession.
When I service my tank, my fish are timid and huddle in the opposite corner showing signs of fear and distress. For this reason, I minimize my interference in their world.
If your fish swim around happily while you do whatever you do, then I guess it doesn't matter.