Nice track plan, but as a layout plan, I agree access and reach are a problem, and will likely detract from your enjoyment. Perhaps another revision could be worked out?
Not sure about elevations, and where tracks would meet at crossing rather than crossing above or below, put perhaps something like this could be worked-out:
