Celtic lost another game away from home on Sunday when they suffered a 1-0 defeat at Livingston in the Scottish Premiership.
They are now sixth in the league table and are four points behind league toppers Rangers, who also dropped points this weekend.
Furuhashi has made a major impact since joining Celtic in the summer and has scored seven times in nine appearances for the club in all competitions.
But he is currently out with a knee injury and Rice conceded that the Hoops are seriously struggling to score goals without their new summer signing.
He admits that Albian Ajeti has netted a few in recent games but feels without Furuhashi Celtic look a bit blunt in attack.
Rice said on the Go Radio Football Show: “Ajeti has come in and has done reasonably well by getting himself a few goals.
“But Kyogo is a massive miss and I think everybody sees that.
“I think even in the last ten minutes against Rangers when he was put through the middle, the threat he offered there gave Celtic fans hope.
“They are definitely lacking goals.”
Furuhashi is expected to be out for a few more weeks with Ange Postecoglou desperate to see his other Celtic forwards step up to the plate.
