July 1st, 2024 × #AI#LLM#Tokens
Do More With AI - LLMs With Big Token Counts
Discussion on using large language models with greater token counts to provide more context, allowing for better and more complex outputs to aid software development.
Host
Host
Join Scott and CJ as they dive into the fascinating world of AI, exploring topics from LLM token sizes and context windows to understanding input length. They discuss practical use cases and share insights on how web developers can leverage larger token counts to maximize the potential of AI and LLMs.
Show Notes
- 00:00 Welcome to Syntax!
- 01:31 Brought to you by Sentry.io.
- 02:42 What is a token?
- 04:22 Context window sometimes called "max tokens".
- 10:42 Understanding input length.
- 11:59 Models + services with big token counts.
- 13:22 Generating open API documentation for a complex API.
- 17:29 Generating JSDoc style typing.
- 21:07 Generating seed data for a complex database.
- 24:34 Summarizing 8+ hours of video.
- 29:35 Some things we've yet to try.
- 31:32 What about cost?
Hit us up on Socials!
Syntax: X Instagram Tiktok LinkedIn Threads
Wes: X Instagram Tiktok LinkedIn Threads
Scott: X Instagram Tiktok LinkedIn Threads
