In one of the more bizarre coaching sagas in AFL history, St Kilda's late sacking of Scott Watters left the Saints searching for a new coach deep into November, a period when 2014 planning was well and truly under way.
An angry Koch came out on breakfast television on Thursday morning, declaring the Power would block any move for Richardson.
But, while the chairman had softened his stance by later in the day, Port have played hardball with the Saints, saying they will have to pay the Power compensation for their late poaching of Richardson, while also forcing the AFL to consider rule changes to prevent such situations occurring again.
Port were also left red-faced by the fact they put out a media release on Tuesday evening, saying Richardson wasn't going anywhere, only to do an abrupt about face less than 24 hours later, saying their director of coaching would be interviewed by the Saints.
But Koch refused to buy into suggestions Richardson may have lied to Port about negotiating with the Melbourne club.
"I wouldn't go as hard as a liar," Koch told Triple M in Adelaide.
"I would say it's disappointing. The temptation of a senior coaching role is pretty strong and you know it's the pinnacle for AFL coaches.
"We found out at 11pm Tuesday night and that was after we put out the statement.
"I was having a really good day on Tuesday. I was fast asleep, you know I got to bed early because of Sunrise and I've woken up at three o'clock to a text message and thought, 'bloody hell'.
"I'd really hate to paint Richo as a demon in this because he is a terrific fella and there are a lot of other parties involved," he added.
"There are managers involved and as you know, managers can be fishing without their client knowing and all that sort of thing.
"I'm realistic enough to know that happens and it's very unlike Richo, in fact I would be stunned if he knew about this before Tuesday."
Koch said Port were particularly aggrieved as the football department structure implemented by the club last year saw Richardson as a director of coaching, a role virtually on the same level as senior coach Ken Hinkley, leaving the former Collingwood player responsible for managing all the coaches at the club.
Having given Richardson such responsibility, Koch said the Saints move had particularly surprised Port as Richardson seemed intent on performing the role.
"(Richardson) had categorically re-committed to us," Koch said.
"He's a pretty popular bloke and no doubt Brisbane was after him, Essendon was after him.
"(Club CEO) Keith Thomas sat down with Richo and said, 'mate, you've got to make a decision. Do you want to be a senior coach or not?
"'Because you came over here and worked with us because this was what you saw the direction of you career, that you would be a coaching director, a broader role but just as important but a different role to a senior coach. Otherwise we're going to have this conversation every year. So you've got to make a career decision'.
"And, he made a career decision after the Essendon and Brisbane approaches and we locked him away until the end of 2015, six-month non-compete, the whole lot because that was a career decision."
Koch said the club never seriously considered stopping Richardson from going.
"It's not a matter of keeping Richo back," he said. "We would never stand in his way.
"The issue for us is that this is all being done in November, the middle of November, the week before the Draft.
"We have spent money on his professional development. He's been away during the off-season and for this to be foisted on us at this time is a bit rich and we think we need some consideration in the transfer.
"What we're saying is, 'hey guys we've got an interest in this as well, you just can't come and pinch one of our key staff and put us on the back foot to solve your problem'.
"It disadvantages us and that's unfair."