Aww, this looks great !
What I do when I struggle with this kind of dilemma is to take a pic of my traditional work (no need for a scan here), open it on the computer and add color digitally : this visual helps a lot to check if the color works or not, without ruining the original map. Would this help ?