Do you think I have herpes simplex 2 orally or genitally?

had sexual intercourse for the first time 1 month and 2 week ago with a 21 year old female who I only just met that night, I remember using a condom for sex and her performing oral on me, I performed oral on her (unprotected) got in from a big night of drinking at 6:30am and woke up around 10-11am with dry skin round my mouth, later through the day I got what looked like a pimple on the corner of my lip and on the flight home I got another, when I got home I went straight to the doctor and he said it looks like HSV1, even though he diagnosed me with this I felt no pain, itchiness, burning, tingling and apparently I had some on the inside of my mouth these showed no symptoms of herpes to me, I have also been told by my mother that I had a cold sore and chickenpox when I was a child so I must be already infected with HSV1, I have been tested for HIV,aids, syphilis I have also been tested for chlamydia and gonorrhoea twice and all the test I had came back negative, he said he wouldn't test me for herpes as I didn't have any symptoms anywhere on my body but he also seems to think that seen as I used a condom my chances are 0-5% should I be as paranoid as I am? also the girl has claimed to be clean and lives in spain so I couldn't see why she would lie because I don't know anyone she knows