There are a number of options: Soak with Acetone and scrap, Soak with WD40 and scrap, some have had luck with 3M adhesive remover, and use some plastic scrapers very carefully with a heat source (ie. blow dryer or heat gun).
RTV is designed to withstand oils and chemicals so it is tuff stuff. Good luck and let us know what worked for you.