I have to say that I really like where you are going with this map. The semi random scrap boards thrown together is a cool concept. Might be even better if you could have some boards of different textures in addition, but not sure how easy that would be to pull off.
The only thing throwing me off so far is still the water color on the left with the white haze effect. Perhaps it's just me, but that just looks odd to my eyes for what i would think would be a fetid swamp town type thing.