So a couple things here -
First, once you have antibodies to hsv1, it is very, very unlikely that you would ever autoinoculate (spread it to another part of your body). You've had this for a really long time, and antibodies develop within a few months, so I wouldn't worry about that at all.
The other thing is that herpes infects nerve groups. Oral herpes infects the trigeminal nerve. That nerve affects the mouth, nose and eyes.