Jeff,
One of my cam lobes has a scratch, too; it doesn't seem to be causing any harm. I'd probably feel them both carefully to see if there is any raised metal that might continue scratching the other surface, but if there is no raised metal, it probably won't get any worse. I'd guess there isn't any raised metal, but it's something to check for peace of mind.
Regarding the slight change in clearance as you move the rocker, that's probably due to wear at the contact points. As you move it, the contact point moves onto a less worn section, slightly raising or tilting the rocker and changing the clearance.
George Davis
'69 280 SL Euro manual