Attention and the Transformer make it possible to recognize that the probability...

		nborwankar on May 18, 2023 \| parent \| context \| favorite \| on: Ask HN: Can someone ELI5 transformers and the “Att... Attention and the Transformer make it possible to recognize that the probability of “black” applying to the cat is much much higher than to the mat due to the phrasing “which is” in between the cat and black.

Thank you. So this is based on the training data, I assume.