So is killing - but the Templars did a lot of killing keeping the roads open in the Holy land (and not just Muslims).
Adultery is a far worse sin than "fornication". The Former involves one person breaking an oath, which is one of the greatest sins for a Christian, and it harms the cuckold despite them having done nothing wrong. Adultery also often leads to violence, family breakup, not uncommonly people are injured or murdered, sometimes the children also.
The issue around sex is something that has bothered the clergy but it honestly wasn't a big deal until the Renaissance.
Read Dante's Inferno, see where "lust" is in Hell as compared to betrayal.
Bookmarks