There is a gap between thought and action , however I would very strongly urge you to get professional treatment and for you and that professional to together determine your actual risk to children. The thoughts are intrusive , but they are in fact bothering ou for a reason. The "typical" psyche profile of " pedophile is not a stranger, and is not single man - most are or were married, engage in adult sexual relationships as well, and the vast majority are related to the child. Excerpts from Psychology today "Facts on Pedophilia" -
For all the worries about "stranger danger," 70 percent of reported abuses involve an offender who knows the child, including relatives.Pedophiles often feel guilt and shame about their activities, say therapists. Most are male, though about 6 percent are female. "People don't grow up and say, 'I want to be a pedophile,' " however most psychologists believe that people with pedophilia will eventually act on it in some way — by exposing themselves to, spying on, or sexually touching children. About 4 percent of the population is believed to have pedophilic urges. Psychologists now categorize it as a sexual orientation much like heterosexuality and homosexuality, in the sense that the sexual attraction to children appears to be involuntary. The term can be used to describe anyone who fantasizes about, is sexually aroused by, or experiences urges toward children, whether or not they act on them. Stephen Rossetti, who runs a psychiatric hospital near Washington, D.C. "All the people I've ever talked to hate it."
Is it a concern? Of course it is- it is to you clearly which is why you are asking about it. But please do in fact talk to professionals and get help because it is too important an issue to try to go it alone or depend on lay advice.