Following their 2-0 loss to Hearts on Saturday, the players were seen climbing Conic Hill and swimming in the loch on Monday afternoon.
The trip came as manager Russell Martin sought to build team spirit after the defeat.
Ferguson, who took interim charge of Rangers at the end of last season, expressed his disagreement with the approach.
Speaking on Go Radio, he said: “Look, managers have all got different ways, maybe to take them out of the environment for the day.
Read more:
- ‘I need to hold my hands up’: Boyd makes Russell Martin Rangers admission
- Union Bears demand Martin and Stewart be sacked by Rangers
“But for me, I would be on the training pitch and making sure I am getting a team ready to rock on the Saturday in the quarter-finals against Hibs.”
Rangers currently have four points from their first five league games, placing them 10th in the Scottish Premiership.
They could drop to the bottom of the table by the time they next play in the league.
Ferguson continued: “We all know it [Ibrox] is a tough place to play but you need to be able to handle these situations.
“I have always said it, the Rangers fans are very demanding and that is the way it’s been since I have been following the club and it will never change.
“You need to be able to handle those situations.
“When you are getting noise from the stands you need to be brave and want to take the ball.
“Overall, it has not been good enough.
“The performances and results have not been good enough and that just continues to pile the pressure on.
“First five games, four points.
“That is not good enough.
“There is no getting away from that and it needs to change quickly.”
