i dont think your Culture can decline , i havent had that happen , it can be very hard to get it up it takes a long time , just keep building your colony crap where you can , it come up every 16 turns or so .