This post is for subscribers only
Sign up now to read the post and get access to the full library of posts for subscribers only.
Sign up now Already have an account? Sign inSign up now to read the post and get access to the full library of posts for subscribers only.
Sign up now Already have an account? Sign inTransformers take static vector embeddings, which assign single values to every token, and expand their context, nearly simultaneously as they process the context of every other word in the sentence. But who cares, let's listen to a pop song!