Jamie Reid scored to give Stevenage the lead at the Memorial Stadium just before half time in the League One contest, but Bristol Rovers rescued a point from a Chris Martin goal in the 83rd minute.
The away side looked good to earn three points before Bristol Rovers got the equaliser and Evans was bitterly disappointed.
He pointed out that his team dominated a good Bristol Rovers side away from home and were very comfortable throughout the game before conceding the goal in the last few minutes.
The Stevenage boss slammed the referee for failing to miss an offside and handball that preceded Martin’s equaliser in the 83rd minute and questioned the quality of the officials on display.
Evans said on Stevenage’s media: “Let’s first and foremost talk about the performance.
“The performance away from home was outstanding. That’s a good Bristol Rovers team with huge resources and a good manager and we outplayed them over long spells.
“We missed some ridiculous chances to be two or three or four ahead.
“I don’t remember them having a chance and in simple terms we were 1-0 ahead, we were quite comfortable, we were going forward missing opportunities and then the referee and the assistant referee gave the most ridiculous goal.
“The boy has come from ten yards offside, gets back on, handballs it and then Chris Martin does what Chris Martin is capable of and chips it in from 40 yards.
“Another St. George’s Park Championship referee; Championship my knackers.”
Stevenage are sitting just outside the playoff spots in the League One table in seventh and Evans will hope to see his side push for promotion.
