..."have it high enough to clear all building"... You may have just answered your own question???
My elevated high line was at 7".
My present point to point high line is 4" above the highest adjacent track. It is setback some what near the wall at 58" high.