Tottenham crashed to their fourth defeat in five games when they lost 2-1 to West Ham at home on Thursday night.
The north London club have not won a game in in their last five league outings and are sitting fifth in the league table on 27 points, level with Manchester United, who are having a wobbly campaign.
While it seemed early in the season that Spurs would finish in the top four, Brown admitted that he is no longer certain that is going to happen.
The former Spurs star feels that Tottenham lack the consistency and the ability to see out games that is needed to break into the top four.
He conceded that they will continue to struggle until they get their major players back from injury.
Brown said on BBC Radio 5 Live: “I have concerns about that [finishing in the top four].
“I don’t see that level of consistency or the way they are going to see out games.
“Until they get more players back, it is going to take longer and that’s one of the reasons why.”
Tottenham have a tough game on the cards this Sunday when they host Newcastle United at home.
