Very good observation! You're right. The z_j's will be history-dependent. Therefore, given the same words in the text, the z_j's of these words will be different if they have different history i.e. part of different n-grams.