Yes. Even in heavy rain, archers will massacre warrior monks on a bridge. You should have charged your daimyo over first and tried to get the AI to chase him (bit of a cheat) or built some naginata in hitachi.

Personally I like that bridge battles can be hard.