Prime Minister Stephen Harper's chief of staff Guy Giorno is stepping down, according to a report, leaving a large void in the PMO.

The Globe and Mail reported Giorno's departure on Friday, citing anonymous sources.

The move comes after a tumultuous summer for the Conservatives. The move to abolish the mandatory long-form census and the decision not to extend the contract for the veterans' ombudsman were just two of the recent storms that developed under Giorno's watch, said CTV's parliamentary correspondent Richard Madan.

Giorno, who has been in the role since July 2008, was also the architect of last year's controversial plan to end taxpayer-funded allowances for political party campaigns -- which almost resulted in a snap election.

However, Madan said it's unlikely that Giorno is being pushed out. Madan added Harper has leaned heavily on his chief of staff and the loss will be felt in the PMO.

"Certainly it is quite an impact and losing your chief of staff, your right hand guy, it's a pretty big deal for any leader of any party, whether it be the prime minister, whether it be a premier or whether it be the leader of the opposition," Madan told CTV News Channel.

Giorno, who recently became a father for the second time, reportedly wants to spend more time with his family.

There is buzz on Parliament Hill that Harper will look outside of the typical political elite to replace Giorno, Madan said.

It appears Giorno will remain in his post until the end of the year, at which time there will be a transition period of a month or two before the new chief of staff is brought in.

Madan said Giorno "views politics like a combat sport" and hasn't always been popular, as a result.

"He's a polarizing guy to many people here on Parliament Hill and in particular to some Conservative MPs who didn't like his style," Madan said.

"But on the other hand he's a very effective strategist and he's an effective communicator within the party and his departure will certainly leave a hole at the PMO."

Giorno, a lawyer, worked for former Ontario premier Mike Harris and was a key architect of his Common Sense Revolution.