I know I've seen pictures of artifacts from Penn station in their new locations. I don't have any of the sites bookmarked. I'd guess a web search would be in order.
Here is a NY Times article on one piece.
And here is an article about bits and pieces that still exist at the current station.