I shoot rimfire silhouette (offhand) and use several rifles.. I use an Anschütz (54.18) which is great out of the box, however mine has modifications such as Lilja barrel. stock Anschütz triggers are two stage and excellent. I also use a Ruger 10/22 that is completely TONY KIDD as far as trigger two stage (3oz) , barrel .920 20" and all internal components, bell and carlson anschutz style stock). Also I use a Remington 40x that is also modified, action blueprinted, squared, second action screw, Lilja barrel, mark pharr stock. For benchrest, I would stay away from semi-autos due to the fact that they have many moving parts that would cause more jump on the barrel. Annies and Rem40x are your best shot in my opinion due to the experience I have had with them. they are very good rifles and need no extreme modifications. Single shot setups make it even more accurate. I would also suggest that buy a rifle that is already top top of the line. The rem40x and Anschutz are very solid reliable actions that last a lifetime. My ruger started out as a $180 rifle and ended up being $1000+ after modifications, and still cant outshoot my annie. annies are in the $1000's but one can find used ones at lower prices. dont forget a good quality scope as well. I use leupolds with target dot reticle witch is very useful in benchrest. Also ammo has alot to do with accuracy. especially in target rifles as their chambers are target chambers, that are more finicky with ammo. I use Lapua, Eley, and at times I use Sk or Wolf as practice rounds. Target ammo will be more expensive. starting anywhere from $7 a box (50ct) to $20+ a box of (50ct) bulk ammo will be less consistent with more fliers and missfires, also they are can damage the chambers due to low quality materials.
hope my experience helps.
-Fer