Brownlee will step down at the end of October, having joined in January 2008. She cited family reasons for resigning her position as the AOP's most senior contracted employee.
Brownlee was previously connected to the AOP, working as a strategic advisor, and her career has taken in spells at Handbag.com, Yahoo! and Channel 4.
Simon Waldman, chairman of the AOP, said that Brownlee had given the trade body much needed energy and clarity of purpose in her eight months in the role.
The AOP is seeking a replacement.