In the early 80's I was working off the Ivory Coast, on a job that was a two day steam from port, we regularly encountered blokes in dugout canoes fishing. It must have taken them days to get there and back.
I seem to remember reading of accounts of Carribean fishermen occasionally fetching up on the African coast too.