Using any type of polishing compound will produce a shine that will stand out from the matt finish.
I would first try a wet Q tip and lightly rub the area. It may be styrafoam not rubbed paint and the Q tip may wash it away. Don't press too hard or the Q tip will also polish the paint. If water doesn't work try a dip in alcohol.
Pete