In this video learn about some important concepts in Text based generative AI like tokens, vectors, and similarity.
Humans are vague! One of the big advances in these generative AI technologies is due to their ability to infer meaning from vague instructions, to ignore our spelling and grammatical mistakes and not behave like command lines. They are fuzzy and to be fuzzy they need all this apparatus to find similar meanings and text to predict what the answer should be.
If you're coding with generative AI like Open AI you'll need to know what tokens are, how to work with them and what vectors mean in embedding models.
Ещё видео!