I've heard much worse in terms of hiss. I would leave it, maybe just normalize the whole show at once and cut on the cd sectors.
the fastest way to ruin a show is by somebody with little experience using nr.
you could try
this setting but listen to the results, there is less hiss but it sounds lifeless & bleh, plus I haven't tested it on the music portions which you said yourself don't need nr anyways, so it would only do harm. I strongly recommend not using nr, it sounds excellent without it.
No members have liked this post.