If I'm not mistaken all settlements can build temples. Perhaps the settlement you took over still has their culture's temple standing. Demolish it and you should be able to build one from your faction's culture.