172: Transformers and Large Language Models

172: Transformers and Large Language Models
Intro topic: Is WFH actually WFC?
News/Links:
Falsehoods Junior Developers Believe about Becoming Senior
https://vadimkravcenko.com/shorts/falsehoods-junior-developers-believe-about-becoming-senior/
Pure Pursuit
Tutorial with python code: https://wiki.purduesigbots.com/software/control-algorithms/basic-pure-pursuit
Video example: https://www.youtube.com/watch?v=qYR7mmcwT2w
PID without a PHD
https://www.wescottdesign.com/articles/pid/pidWithoutAPhd.pdf
Google releases Gemma
https://blog.google/technology/developers/gemma-open-models/
Book of the Show
Patrick: The Eye of the World by Robert Jordan (Wheel of Time)
https://amzn.to/3uEhg6v
Jason: How to Make a Video Game All By Yourself
https://amzn.to/3UZtP7b
Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h
Tool of the Show
Patrick: Stadia Controller Wifi to Bluetooth Unlock
https://stadia.google.com/controller/index_en_US.html
Jason: FUSE and SSHFS
https://www.digitalocean.com/community/tutorials/how-to-use-sshfs-to-mount-remote-file-systems-over-ssh
Topic: Transformers and Large Language Models
How neural networks store information
Latent variables
Transformers
Encoders & Decoders
Attention Layers
History
RNN
Vanishing Gradient Problem
LSTM
Short term (gradient explodes), Long term (gradient vanishes)
Differentiable algebra
Key-Query-Value
Self Attention
Self-Supervised Learning & Forward Models
Human Feedback
Reinforcement Learning from Human Feedback
Direct Policy Optimization (Pairwise Ranking)
★ Support this podcast on Patreon ★