Solskjaer expressed his disappointment after another opportunity to level with Manchester City was missed.
The Red Devils surrendered a 2-0 lead in the encounter before Scott Mctominay restored their lead with the third goal before poor defending by Manchester United defenders allowed Calvert-Lewin to score a 95th minute equaliser.
“First half I did not feel we played particularly well but scored two fantastic goals. You go in at the break 2-0 up feeling we have not hit where we could do.
“After 2-2 we played really well then the last kick of the ball kicks us in the teeth and we go home disappointed.
“We have to focus on improving as a team. We are scoring more goals, creating chances and you felt you dominated the game and should have won it.”
Everton scored with all three of their shots on target, while Manchester United found the net with three of their five attempts on target.