Tendulkar, the most prolific batsman in the international game, made his 200th and final Test appearance as India thumped West Indies by an innings and 126 runs in Mumbai to claim a 2-0 series win.
MS Dhoni's side must now attempt to cope without a batsman who contributed a staggering 15,921 Test runs following his debut in 1989.
Rohit, who marked his first taste of five-day international cricket with back-to-back hundreds in the two matches against West Indies, is aware Tendulkar's exit from the India team will leave a huge hole.
"The team won, so I'm happy, and since I've contributed it's all the more nice. But there's one thing that we're going to be tormented by for the next few days, that from now on Sachin Tendulkar will not play with us," said Rohit in quotes reported on Cricinfo.
"This will keep on coming back to our hearts again and again.
"His presence in the dressing room will really be missed. It's not just about batting; it's about a lot of things that you need in yourself to succeed. All those things will be missed.
"I don't know how the team members are going to react to the situations which we'll be confronted with now on, now that we finally know that he will not be with the team any more.
"We need to get over this very quickly, but I don't know how we're going to do it. It's never going to be easy."
On the day Tendulkar's final match came to an end, the Indian Prime Minister's Office confirmed the 40-year-old will become the first sportsperson to be conferred the Bharat Ratna, India's highest civilian honour.
A PMO statement read: "Shri Sachin Tendulkar is undoubtedly an outstanding cricketer - a living legend who has inspired millions across the globe.
"He has been a true ambassador of India in the world of sports. His achievements in cricket are unparalleled, the records set by him unmatched, and the spirit of sportsmanship displayed by him exemplary."