Hughes was struck by a bouncer while batting for South Australia against New South Wales on Tuesday, leaving the 25-year-old in a critical condition in hospital.
The opener remains in intensive care at St Vincent's Hospital in Sydney, with his crticial condition remaining unchanged in recent days.
Hughes was Fraser's first signing as Middlesex managing director of cricket in 2009 and impressed during his short stay with four centuries in all formats.
"[The] news leaves you numb," Fraser told Perform. "I will always will have a soft spot for Phil as he was the first player I signed and he did very well when he came across.
"He's a lovely lad, he fitted in very well and there's some very upset people at Middlesex because they've continued their relationships with Phil since he was here.
"It goes without saying that at Middlesex we hope he makes a full and quick recovery from this."
While the injury has shocked the former England seamer, he insists cricket does everything it can to make sure the players are protected, but some accidents are tough to prevent.
"I think the game is a more aggressive game now," he added. "Batsmen are expected to play all the shots, therefore they attempt to play all the shots.
"There's more short bowling now than previously, bowlers are bigger and strong, and bowl quicker than they did 20 more 30 years ago.
"Cricketers are looking to impose themselves on a match, whether it's through skill or personality.
"There have been a number of whacks where players have been hurt badly, but nothing like the situation that has arisen in Sydney, it makes you very thoughtful.
"There is danger in every sport, the sports do all they can to make the arena as safe as they can, but I don't think you can protect a player from every eventuality."