Hi,
You're likely not "doing this to yourself", but yes, negative emotions (anxiety, stress, depression) are likely to increase the frequency of "skipped" beats (premature heart beats, PACs or PVCs).
You need to remember that premature beats are normal. Everyone have them, and we notice them more or less. Some of us are blissfully unaware of what their hearts are doing, some of us freak out every time we feel a little skip or chest discomfort.