It's a good theory that Jesus was a very masculine and buffed man. Leaders of men are usually in very good physical shape so as to pander to the superficial nature of mankind.

Plus, Jesus went through the temple and overturned tables and things like that. If he was not a strong man, chances are he would have had not been the one to do that.