I grew up in colorado and have backpacked over half the fourteener's and hunted a fair bit in the 9-12000 foot level. I hate brakes, but it is your rifle. I would recommend a couple things. Get the rifle and shoot it without the brake and see how you react to the recoil, make sure the rifle fits you properly, rifle fit in the big mid bore (9.3 and 375) is where improper fit starts to rear its ugly head. Take the gentlemen up on his offer to shoot his 500 Jeffery, after you shoot a big bore like the 500 a couple times the 375 feels like a 308. The big bore resets the giro in the brain housing group to a after this everything small is easy.
The last is that off all the things you will take out for a day hunt, bino's, spotting scope, day pack with food water survival gear are all more important weight wise than your rifle weight. Do some serious working out and hiking at altitude and the 2 lbs difference in a browning vs CZ, Sako, Winchester, and ruger will feel irrelevant.
Last if you do put a brake on it don't take it to africa should you ever decide to go as it is more than your hearing that will be affected.