Felicity is the perfect person for him to discuss his timeline woes with; she’s smart enough to understand what happened, but she isn’t so directly involved in the changes he made that it would freak her out to know that he went and screwed with the timeline.
And, when he finally puts things back, he sees that all is not as it was before.
Who doesn’t like to talk to Felicity when they need a friendly ear?