Канал: Greg Durrett

CS378NLP Fall 2020 "intro"

CS378NLP Fall 2020 "intro"

CS371N/388 NLP "trailer" (fall 2023)

CS371N/388 NLP "trailer" (fall 2023)

Position Encodings (Natural Language Processing at UT Austin)

Position Encodings (Natural Language Processing at UT Austin)

Using Transformers (Natural Language Processing at UT Austin)

Using Transformers (Natural Language Processing at UT Austin)

Reinforcement Learning from Human Feedback (Natural Language Processing at UT Austin)

Reinforcement Learning from Human Feedback (Natural Language Processing at UT Austin)

Intro to ChatGPT and NLP (NLP for High School)

Intro to ChatGPT and NLP (NLP for High School)

Neural Chatbots (Natural Language Processing at UT Austin)

Neural Chatbots (Natural Language Processing at UT Austin)

Zero-shot Prompting (Natural Language Processing at UT Austin)

Zero-shot Prompting (Natural Language Processing at UT Austin)

Language Grounding (Natural Language Processing at UT Austin)

Language Grounding (Natural Language Processing at UT Austin)

T5 (Natural Language Processing at UT Austin)

T5 (Natural Language Processing at UT Austin)

Factuality of LLMs (Natural Language Processing at UT Austin)

Factuality of LLMs (Natural Language Processing at UT Austin)

Transformer Language Modeling (Natural Language Processing at UT Austin)

Transformer Language Modeling (Natural Language Processing at UT Austin)

Future Risks of Large Language Models (NLP for High School)

Future Risks of Large Language Models (NLP for High School)

Language and Vision (Natural Language Processing at UT Austin)

Language and Vision (Natural Language Processing at UT Austin)

Transformer Architecture (Natural Language Processing at UT Austin)

Transformer Architecture (Natural Language Processing at UT Austin)

Chain of Thought (Natural Language Processing at UT Austin)

Chain of Thought (Natural Language Processing at UT Austin)

Seq2seq Models (Natural Language Processing at UT Austin)

Seq2seq Models (Natural Language Processing at UT Austin)

Mathematics of Language Modeling (Advanced) (NLP for High School)

Mathematics of Language Modeling (Advanced) (NLP for High School)

Ethics: Exclusion (Natural Language Processing at UT Austin)

Ethics: Exclusion (Natural Language Processing at UT Austin)

Self Attention (Natural Language Processing at UT Austin)

Self Attention (Natural Language Processing at UT Austin)

Ethics: Dangers of Automation (Natural Language Processing at UT Austin)

Ethics: Dangers of Automation (Natural Language Processing at UT Austin)

How does ChatGPT know things? (NLP for High School)

How does ChatGPT know things? (NLP for High School)

Chain of Thought: Extensions and Analysis (Natural Language Processing at UT Austin)

Chain of Thought: Extensions and Analysis (Natural Language Processing at UT Austin)

Transformer Extensions (Natural Language Processing at UT Austin)

Transformer Extensions (Natural Language Processing at UT Austin)

Ethics: Unethical Use (Natural Language Processing at UT Austin)

Ethics: Unethical Use (Natural Language Processing at UT Austin)

LM Evaluation (Natural Language Processing at UT Austin)

LM Evaluation (Natural Language Processing at UT Austin)

Nucleus Sampling (Natural Language Processing at UT Austin)

Nucleus Sampling (Natural Language Processing at UT Austin)

Few-shot Prompting (Natural Language Processing at UT Austin)

Few-shot Prompting (Natural Language Processing at UT Austin)

BART (Natural Language Processing at UT Austin)

BART (Natural Language Processing at UT Austin)

Course Preview (Natural Language Processing at UT Austin)

Course Preview (Natural Language Processing at UT Austin)

Language Modeling (NLP for High School)

Language Modeling (NLP for High School)

Risks of Large Language Models (NLP for High School)

Risks of Large Language Models (NLP for High School)

Where to go next (NLP for High School)

Where to go next (NLP for High School)

ChatGPT The Basics (NLP for High School)

ChatGPT The Basics (NLP for High School)

Instruction Tuning (Natural Language Processing at UT Austin)

Instruction Tuning (Natural Language Processing at UT Austin)

Neural and Pretrained Machine Translation (Natural Language Processing at UT Austin)

Neural and Pretrained Machine Translation (Natural Language Processing at UT Austin)

GPT-3 (Natural Language Processing at UT Austin)

GPT-3 (Natural Language Processing at UT Austin)

Machine Learning (NLP for High School)

Machine Learning (NLP for High School)

Understanding ICL: Induction Heads (Natural Language Processing at UT Austin)

Understanding ICL: Induction Heads (Natural Language Processing at UT Austin)

Multi Head Self Attention (Natural Language Processing at UT Austin)

Multi Head Self Attention (Natural Language Processing at UT Austin)

ChatGPT Part 2 (NLP for High School)

ChatGPT Part 2 (NLP for High School)

Attention (Natural Language Processing at UT Austin)

Attention (Natural Language Processing at UT Austin)

Ethics: Bias (Natural Language Processing at UT Austin)

Ethics: Bias (Natural Language Processing at UT Austin)

Beam Search (Natural Language Processing at UT Austin)

Beam Search (Natural Language Processing at UT Austin)

RNNs and their Shortcomings (Natural Language Processing at UT Austin)

RNNs and their Shortcomings (Natural Language Processing at UT Austin)

Mathematics of Language Modeling (NLP for High School)

Mathematics of Language Modeling (NLP for High School)

[COLING 22 Workshop Talk] Summarizing Narratives with GPT-3: Measuring the next 5 years of progress

[COLING 22 Workshop Talk] Summarizing Narratives with GPT-3: Measuring the next 5 years of progress

UT Austin CS378/388 (NLP) Fall 2022 "Trailer"

UT Austin CS378/388 (NLP) Fall 2022 "Trailer"

What's Next (NLP for High School 2021-2022 version)

What's Next (NLP for High School 2021-2022 version)

Language Models in the News (NLP for High School 2021-2022 version)

Language Models in the News (NLP for High School 2021-2022 version)

Discussion: Write with Transformer (NLP for High School 2021-2022 version)

Discussion: Write with Transformer (NLP for High School 2021-2022 version)

Hands On: Write with Transformer (NLP for High School 2021-2022 version)

Hands On: Write with Transformer (NLP for High School 2021-2022 version)

Querying the LM (Python) (NLP for High School)

Querying the LM (Python) (NLP for High School)

Querying the LM (Java) (NLP for High School)

Querying the LM (Java) (NLP for High School)

Bigram LM Code (Python) (NLP for High School)

Bigram LM Code (Python) (NLP for High School)

Bigram LM Code (Java) (NLP for High School)

Bigram LM Code (Java) (NLP for High School)

Building n-gram LMs (NLP for High School 2021-2022 version)

Building n-gram LMs (NLP for High School 2021-2022 version)

Language Modeling (NLP for High School 2021-2022 version)

Language Modeling (NLP for High School 2021-2022 version)

Machine Learning (NLP for High School 2021-2022 version)

Machine Learning (NLP for High School 2021-2022 version)

What Is NLP? (NLP for High School 2021-2022 version)

What Is NLP? (NLP for High School 2021-2022 version)

Why natural language is the right vehicle for complex reasoning: Greg Durrett at Baidu (4/19/2022)

Why natural language is the right vehicle for complex reasoning: Greg Durrett at Baidu (4/19/2022)

Sentiment Analysis and Basic Feature Extraction (Natural Language Processing at UT Austin)

Sentiment Analysis and Basic Feature Extraction (Natural Language Processing at UT Austin)

Logistic Regression (Natural Language Processing at UT Austin)

Logistic Regression (Natural Language Processing at UT Austin)

Optimization Basics (Natural Language Processing at UT Austin)

Optimization Basics (Natural Language Processing at UT Austin)

Linear Binary Classification (Natural Language Processing at UT Austin)

Linear Binary Classification (Natural Language Processing at UT Austin)

Multiclass Perceptron and Logistic Regression

Multiclass Perceptron and Logistic Regression

Multiclass Classification (Natural Language Processing at UT Austin)

Multiclass Classification (Natural Language Processing at UT Austin)

Basics of Learning, Gradient Descent (Natural Language Processing at UT Austin)

Basics of Learning, Gradient Descent (Natural Language Processing at UT Austin)

Sentiment Analysis (Natural Language Processing at UT Austin)

Sentiment Analysis (Natural Language Processing at UT Austin)

Perceptron as Minimizing Loss (Natural Language Processing at UT Austin)

Perceptron as Minimizing Loss (Natural Language Processing at UT Austin)

Introduction (Natural Language Processing at UT Austin)

Introduction (Natural Language Processing at UT Austin)

Perceptron (Natural Language Processing at UT Austin)

Perceptron (Natural Language Processing at UT Austin)

Multiclass Classification Examples (Natural Language Processing at UT Austin)

Multiclass Classification Examples (Natural Language Processing at UT Austin)

Applying Embeddings, Deep Averaging Networks (Natural Language Processing at UT Austin)

Applying Embeddings, Deep Averaging Networks (Natural Language Processing at UT Austin)

Conditional Random Fields (Natural Language Processing at UT Austin)

Conditional Random Fields (Natural Language Processing at UT Austin)

Word Embeddings (Natural Language Processing at UT Austin)

Word Embeddings (Natural Language Processing at UT Austin)

Hidden Markov Models (Natural Language Processing at UT Austin)

Hidden Markov Models (Natural Language Processing at UT Austin)

HMMs: Viterbi Algorithm (Natural Language Processing at UT Austin)

HMMs: Viterbi Algorithm (Natural Language Processing at UT Austin)

Fairness in Classification (Natural Language Processing at UT Austin)

Fairness in Classification (Natural Language Processing at UT Austin)

CKY Algorithm (Natural Language Processing at UT Austin)

CKY Algorithm (Natural Language Processing at UT Austin)

Inference And Learning In CRFs (Natural Language Processing at UT Austin)

Inference And Learning In CRFs (Natural Language Processing at UT Austin)

Forward-Backward Algorithm (Natural Language Processing at UT Austin)

Forward-Backward Algorithm (Natural Language Processing at UT Austin)

Dependencies (Natural Language Processing at UT Austin)

Dependencies (Natural Language Processing at UT Austin)

NER (Natural Language Processing at UT Austin)

NER (Natural Language Processing at UT Austin)

Feedforward Neural Networks, Backpropagation (Natural Language Processing at UT Austin)

Feedforward Neural Networks, Backpropagation (Natural Language Processing at UT Austin)

State of the Art Parsers (Natural Language Processing at UT Austin)

State of the Art Parsers (Natural Language Processing at UT Austin)

Neural Networks (Natural Language Processing at UT Austin)

Neural Networks (Natural Language Processing at UT Austin)

Neural Net Implementation (Natural Language Processing at UT Austin)

Neural Net Implementation (Natural Language Processing at UT Austin)

Bias In Word Embeddings (Natural Language Processing at UT Austin)

Bias In Word Embeddings (Natural Language Processing at UT Austin)

Neural Net Training, Optimization (Natural Language Processing at UT Austin)

Neural Net Training, Optimization (Natural Language Processing at UT Austin)

Part-of-Speech Tagging (Natural Language Processing at UT Austin)

Part-of-Speech Tagging (Natural Language Processing at UT Austin)

Features For NER (Natural Language Processing at UT Austin)

Features For NER (Natural Language Processing at UT Austin)

Beam Search (Natural Language Processing at UT Austin)

Beam Search (Natural Language Processing at UT Austin)

HMMs: Parameter Estimation (Natural Language Processing at UT Austin)

HMMs: Parameter Estimation (Natural Language Processing at UT Austin)

Refining Grammars (Natural Language Processing at UT Austin)

Refining Grammars (Natural Language Processing at UT Austin)

Other Word Embedding Methods (Natural Language Processing at UT Austin)

Other Word Embedding Methods (Natural Language Processing at UT Austin)

Skip-gram (Natural Language Processing at UT Austin)

Skip-gram (Natural Language Processing at UT Austin)

Probabilistic Context Free Grammars (Natural Language Processing at UT Austin)

Probabilistic Context Free Grammars (Natural Language Processing at UT Austin)

Neural Network Visualization (Natural Language Processing at UT Austin)

Neural Network Visualization (Natural Language Processing at UT Austin)

HMMs for POS Tagging (Natural Language Processing at UT Austin)

HMMs for POS Tagging (Natural Language Processing at UT Austin)

Sequence Labeling (Natural Language Processing at UT Austin)

Sequence Labeling (Natural Language Processing at UT Austin)

Transition Based Dependency Parsing (Natural Language Processing at UT Austin)

Transition Based Dependency Parsing (Natural Language Processing at UT Austin)

Constituency Parsing (Natural Language Processing at UT Austin)

Constituency Parsing (Natural Language Processing at UT Austin)

Attention: Model and Implementation (Natural Language Processing at UT Austin)

Attention: Model and Implementation (Natural Language Processing at UT Austin)

Model Theoretic Semantics (Natural Language Processing at UT Austin)

Model Theoretic Semantics (Natural Language Processing at UT Austin)

Phrase Based Machine Translation (Natural Language Processing at UT Austin)

Phrase Based Machine Translation (Natural Language Processing at UT Austin)

Neural Language Models (Natural Language Processing at UT Austin)

Neural Language Models (Natural Language Processing at UT Austin)

Seq2seq Models [old version] (Natural Language Processing at UT Austin)

Seq2seq Models [old version] (Natural Language Processing at UT Austin)

n-gram LMs (Natural Language Processing at UT Austin)

n-gram LMs (Natural Language Processing at UT Austin)

CCG (Natural Language Processing at UT Austin)

CCG (Natural Language Processing at UT Austin)

RNN Language Modeling (Natural Language Processing at UT Austin)

RNN Language Modeling (Natural Language Processing at UT Austin)

MT: Framework, Evaluation (Natural Language Processing at UT Austin)

MT: Framework, Evaluation (Natural Language Processing at UT Austin)

Montague Semantics (Natural Language Processing at UT Austin)

Montague Semantics (Natural Language Processing at UT Austin)

ELMo (Natural Language Processing at UT Austin)

ELMo (Natural Language Processing at UT Austin)

Seq2seq Models: Training, Implementation (Natural Language Processing at UT Austin)

Seq2seq Models: Training, Implementation (Natural Language Processing at UT Austin)

Word Piece And Byte Pair Encoding (Natural Language Processing at UT Austin)

Word Piece And Byte Pair Encoding (Natural Language Processing at UT Austin)

Smoothing In n-gram LMs (Natural Language Processing at UT Austin)

Smoothing In n-gram LMs (Natural Language Processing at UT Austin)

Attention: Problems with Seq2seq Models (Natural Language Processing at UT Austin)

Attention: Problems with Seq2seq Models (Natural Language Processing at UT Austin)

Copying And Pointers (Natural Language Processing at UT Austin)

Copying And Pointers (Natural Language Processing at UT Austin)

BERT: Masked Language Modeling (Natural Language Processing at UT Austin)

BERT: Masked Language Modeling (Natural Language Processing at UT Austin)

BERT: Model and Applications (Natural Language Processing at UT Austin)

BERT: Model and Applications (Natural Language Processing at UT Austin)

Syntactic Machine Translation (Natural Language Processing at UT Austin)

Syntactic Machine Translation (Natural Language Processing at UT Austin)

Basic RNNs, Elman Networks (Natural Language Processing at UT Austin)

Basic RNNs, Elman Networks (Natural Language Processing at UT Austin)

GPT2 [old version] (Natural Language Processing at UT Austin)

GPT2 [old version] (Natural Language Processing at UT Austin)

Transformers [old version] (Natural Language Processing at UT Austin)

Transformers [old version] (Natural Language Processing at UT Austin)

MT: IBM Models (Natural Language Processing at UT Austin)

MT: IBM Models (Natural Language Processing at UT Austin)

Visualizing LSTMs (Natural Language Processing at UT Austin)

Visualizing LSTMs (Natural Language Processing at UT Austin)

Neural Machine Translation (Natural Language Processing at UT Austin)

Neural Machine Translation (Natural Language Processing at UT Austin)

Neural Chatbots [old version] (Natural Language Processing at UT Austin)

Neural Chatbots [old version] (Natural Language Processing at UT Austin)

GPT3 [old version] (Natural Language Processing at UT Austin)

GPT3 [old version] (Natural Language Processing at UT Austin)

BERT For QA (Natural Language Processing at UT Austin)

BERT For QA (Natural Language Processing at UT Austin)

Reading Comprehension: Setup And Baselines (Natural Language Processing at UT Austin)

Reading Comprehension: Setup And Baselines (Natural Language Processing at UT Austin)

Task-Oriented Dialogue (Natural Language Processing at UT Austin)

Task-Oriented Dialogue (Natural Language Processing at UT Austin)

Explainability In NLP (Natural Language Processing at UT Austin)

Explainability In NLP (Natural Language Processing at UT Austin)

Open-Domain QA (Natural Language Processing at UT Austin)

Open-Domain QA (Natural Language Processing at UT Austin)

Extractive Summarization (Natural Language Processing at UT Austin)

Extractive Summarization (Natural Language Processing at UT Austin)

Dialogue And QA (Natural Language Processing at UT Austin)

Dialogue And QA (Natural Language Processing at UT Austin)

Neural Extractive Summarization Models (Natural Language Processing at UT Austin)

Neural Extractive Summarization Models (Natural Language Processing at UT Austin)

Ethical Issues In NLP [old version] (Natural Language Processing at UT Austin)

Ethical Issues In NLP [old version] (Natural Language Processing at UT Austin)

Compressive Summarization (Natural Language Processing at UT Austin)

Compressive Summarization (Natural Language Processing at UT Austin)

Local Explanations: Highlights (Natural Language Processing at UT Austin)

Local Explanations: Highlights (Natural Language Processing at UT Austin)

Improved Reading Comprehension (Natural Language Processing at UT Austin)

Improved Reading Comprehension (Natural Language Processing at UT Austin)

Model Probing (Natural Language Processing at UT Austin)

Model Probing (Natural Language Processing at UT Austin)

Text Explanations (Natural Language Processing at UT Austin)

Text Explanations (Natural Language Processing at UT Austin)

Morphological Analysis (Natural Language Processing at UT Austin)

Morphological Analysis (Natural Language Processing at UT Austin)

Morphology (Natural Language Processing at UT Austin)

Morphology (Natural Language Processing at UT Austin)

Pre-trained Summarization and Factuality (Natural Language Processing at UT Austin)

Pre-trained Summarization and Factuality (Natural Language Processing at UT Austin)

Abstractive Summarization (Natural Language Processing at UT Austin)

Abstractive Summarization (Natural Language Processing at UT Austin)

Reading Comprehension Intro (Natural Language Processing at UT Austin)

Reading Comprehension Intro (Natural Language Processing at UT Austin)

Multi-hop QA (Natural Language Processing at UT Austin)

Multi-hop QA (Natural Language Processing at UT Austin)

Summarization Intro (Natural Language Processing at UT Austin)

Summarization Intro (Natural Language Processing at UT Austin)

Cross Lingual Tagging And Parsing (Natural Language Processing at UT Austin)

Cross Lingual Tagging And Parsing (Natural Language Processing at UT Austin)

Dialogue: Chatbots (Natural Language Processing at UT Austin)

Dialogue: Chatbots (Natural Language Processing at UT Austin)

Attentive Reader (Natural Language Processing at UT Austin)

Attentive Reader (Natural Language Processing at UT Austin)

BART And Other Pre-Training (Natural Language Processing at UT Austin)

BART And Other Pre-Training (Natural Language Processing at UT Austin)

Cross-Lingual Pre-training (Natural Language Processing at UT Austin)

Cross-Lingual Pre-training (Natural Language Processing at UT Austin)

Annotation Artifacts (Natural Language Processing at UT Austin)

Annotation Artifacts (Natural Language Processing at UT Austin)

Problems With Reading Comprehension (Natural Language Processing at UT Austin)

Problems With Reading Comprehension (Natural Language Processing at UT Austin)