The error in your reasoning is that you fail to acknowledge that including that caloric dose from candy may also displace the calories from something else that might have been eaten.
And, that allowing yourself sweets (and everything else) in moderation, decreases preoccupation with what you "can't" have, which may result in binge eating.

Please post the research form peer reviewed journals. I'd love to see your references. Just last month yet another article was published on managing weight with inclusion of your so called "junk food".