Case File No. zjkBMFhNj_gLang: EN

Finding this tool useful? Bookmark us (cmd+D) for easy and fast access!

Get Another Transcript

Transcript

Transcript [EN]: [1hr Talk] Intro to Large Language Models

Author:Andrej Karpathy

Summary

Technical talk

The speaker explains what large language models are, focusing on the two-file packaging of models like Llama 2 and how training creates a 140 GB parameter file from enormous internet data and GPUs. He contrasts pre training with fine tuning to create assistant models, discusses tool use, multi-modal capabilities, and an open versus closed model landscape. The talk covers scaling laws, system design analogies to an operating system, and future directions including system two thinking, self-improvement, customization, and potential security risks like jailbreaks and prompt injections. He also touches on evaluation via leaderboards and emphasizes the evolving security cat and mouse games in LM safety.

Share:

Ask the video

Ask a question and get an answer straight from the transcript.

Tap one, I'll answer it

Sign in to ask questions about this video. Sign in

More transcripts

Browse all transcripts

Finding this tool useful? Bookmark us (cmd+D) for easy and fast access!