Yes, Wood Elixir will do the job and no, you do not have to remove the trim. Apply Wood Elixir ...wait a few minutes for it to seep between the paint smear and the original finsh and then remove the paint with steel wool or in the case of a paint spot, something sharp. (My wife dosen't like me doing this but, I sometimes use my finger nail to remove paint spots) Your trim will be cleaned at the smae time.