Nobody ever wrote the code that lets ChatGPT write Python. Not one line of it. 🤯 Here's how a large language model actually gets built, step by step: 1️⃣ Data. Trillions of words of books, web pages, code and forums, then cleaned: duplicates removed, spam filtered, broken text stripped. One open dataset, FineWeb, is 15 trillion tokens of web text. 2️⃣ Tokens. The model never sees words.
2:57
Nobody ever wrote the code that lets ChatGPT write Python. Not one line of it. 🤯 Here's how a large language model actually gets built, step by step: 1️⃣ Data. Trillions of words of books, web pages, code and forums, then cleaned: duplicates removed, spam filtered, broken text stripped. One open dataset, FineWeb, is 15 trillion tokens of web text. 2️⃣ Tokens. The model never sees words.
14.5萬 觀看人次3 週前
TikTokrick.theengineer
查看更多內容
靜態縮圖預留位置