
Crozier became a director at Debenhams in April 2006, before he took up the role as ITV chief executive on 26 April 2010.
He will stand down from the role on 1 September, which marks the end of Debenham's financial year.
Debenhams handed Crozier the role of chairman of the remuneration committee in April 2009, and his role as chair of the committee will now be filled by Dennis Millard, the chair of the audit committee.
It is thought that Crozier and Debenhams are parting ways amicably, with both parties believing six years a reasonable time for Crozier to be in the role.
Crozier's exit comes on the same day (28 June) that Debenhams put out an interim statement on a boost in sales as a result of its 'Life Made Fabulous' marketing activity.
The retailer has seen a 3% increase in like-for-like sales including VAT in the 16 weeks leading to 23 June.
Debenhams also noted that its performance was propelled by events including Easter, Mother's Day and the Queen's Diamond Jubilee.
It added that development of its business in the non-clothing categories including beauty, accessories and home, helped alleviate the impact of the cold and wet spring on seasonal clothing categories, in particular womenswear.
Debenhams claimed a higher marketing spend meant its profit expectations were on course for the financial year.
The retailer continued to make good strides in its online offering, with online sales growing 34.9% in the 16 weeks to 23 June, with mobile being the fastest -rowing channel as it now accounts for 30% of website traffic.
Debenhams is also rolling out free Wi-Fi for customers in all its UK stores.
Michael Sharp, chief executive at Debenhams, said: "Debenhams has again demonstrated the efficacy of our strategy to build a leading international, multi-channel brand and our ability to trade well in difficult market conditions, as well as the inherent strength of the department store model."
"Looking forward, there is little sign of an imminent recovery in consumer confidence."
Follow Matthew Chapman at