James Drummond, 4t Yerl o Perth