Mr Hayward, who was ousted from the oil giant after the Gulf of Mexico spill, was appointed interim chairman of the enlarged mining and commodities trading group after a shareholder rebellion removed present incumbent Sir John Bond.
He was ejected from the board by more than 80% of voting shareholders, while three other directors, Ian Strachan, Con Fauconnier and Peter Hooley were also ousted. A fifth director, Sir Steve Robson, resigned earlier in the day.
The boardroom clean-out removes Xstrata's influence from the top of the company, after its takeover by Glencore earlier this month sealed the biggest mining deal in history. Mr Hayward, already a director of Glencore, was axed from the BP board in July 2010 after fierce criticism of his handling of the vast oil spill.
Mr Hayward had complained at the height of the crisis ''I want my life back'' and also attempted to downplay the impact of the incident by suggesting the Gulf was ''a big ocean''. His days were numbered when US president Barack Obama said he would sack him if he were his boss.
Sir John said: "I recognise and respect the strong opposition among many to the retention arrangements which the board felt appropriate to ensure management stability."
Glencore has started the search for new board members after voting at its annual meeting in Switzerland left it with just four directors.
The Glencore Xstrata deal brought together Glencore's commodities trading expertise and Xstrata's mining clout to form a group which hopes to compete better against the might of miners BHP Billiton and Rio Tinto.
The takeover created a group with more than 190,000 staff and over 150 mines and production sites in more than 50 countries, headed by Glencore boss Ivan Glasenberg and headquartered in Switzerland.