Any negative effects by using rubber mallets? I know it barely moves the thing but can it cause any damage?

Also seen it done by putting a large flat piece of timber across the face of the pulley and hitting that with a mallet? Same story can this cause damage?

Or is it mainly metal to metal contact which can kill bearings?