Trees did grow out there.

So when you as an old man explain the different circumstances, explaining that you climbed a tree far away, now out to sea, would be a powerful tool.
Eitherway, the tree itself would stand around for quite a long time after it died. You can see that in the many places where trees have in fact been gobbled up by water.
In Brazil they are even conducting some underwater logging.