Isn't "adding" the same as "moving closer" ? E.g. the vector for "bank" is mid-w... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		riffraff on April 15, 2023 \| parent \| context \| favorite \| on: What are transformer models and how do they work? Isn't "adding" the same as "moving closer" ? E.g. the vector for "bank" is mid-way between the geographical and financial meaning, "bank + money" is closer while "bank + river" if further away.

jaidhyani on April 16, 2023 [–]

It depends on the values of the vectors. (4, 4) + (3, 3) results in a new vector (7, 7) which is further away from both contributing vectors than either one was to each other originally. Additionally, negative coefficients are a thing.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact