I will need to. The saw was ordered over the internet, so I'm going to consider it "untuned". I'll likely tune it by ear over the weekend, but I have a tach on the way. For the $10 it'll take to get replacement caps (for this saw and the 620pw on the way), I'll probably just order them. It makes sense that new, never installed caps would fit tightly, and I can see how it would help to get a screwdriver on there.
I'll have to see how well my little splined Poulan tool works, though. If it works well, I'll only put replacement caps on to keep the adjusters from spinning.