Impressment wasn't that common against normal people as made out. It definitely preferred sailors, and grabbing random peasants was very rare, since they would frequently be opposed by local authorities even up to the point of armed conflict when trying to just drag random people off the streets. It was safer and easier to justify taking sailors, as well as frankly just plain better for the ship. Eventually any non-sailor was legally referred to as a 'Landsman' and exempt from impressment except during wartime, and furthermore could not be tricked into going (the shilling in the beer myth) and had a 4 day period in which to change his mind with no ill effects.

Even on the rare instances of legal impressment into the army in Britain, it only applied to anyone who couldn't manage to prove they had a legitimate trade, so only the 'idle' were taken.