those would be sappers - and yes they will beeline to your colony going through walls or mountains - they default back to normal AI once all the grenade armed raiders are dead so a mortar attack or a well place sniper is the best defence against them.