In his new role, Baker will work alongside his former colleague and fellow joint managing director George Nimeh.
While at Ogilvy Interactive, Baker led the agency's flagship digital accounts: BP, Unilever and American Express.
Before that, he helped set up the London office of Organic, Omnicom's US digital agency, where he first met Nimeh.
Nimeh said: "We're thrilled to have John on board. I'm looking forward to renewing our business partnership."
OgilvyOne has bolstered its digital department following Baker's exit. Ed Hornby is joining from Agency.com as the director of digital operations and Publicis Modem's Melanie Ferguson has taken the role of digital creative director on American Express, while LBi's Paul Randall and Agency.com's Mark Sweatman join as head of digital production and head of technical.