Working the bolt in the quickest manner possible does not equal rushing shots, in fact it is the opposite. Working the bolt in the quickest manner possible gives MORE time to make a good shot.
We stress this in handgun training, the faster out of the holster, the faster reloads, the faster...