Join 📚 Josh Beckman's Highlights
A batch of the best highlights from what Josh's read, .
The other thing about chat was when we had these instruct models. The task of “complete this text, but in a nice or helpful way” is a pretty poorly defined task. That task is both confusing for the model and for the human who's supposed to do the data labeling.
Whereas for chat, people had an intuitive sense of what a helpful robot should be like. So it was just much easier for people to get an idea of what the model was supposed to do. As a result, the model had a much more coherent personality and it was much easier to get pretty sensible behavior robustly.
John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI
Dwarkesh Patel
The great mathematician Gottfried Leibniz who is credited with being one of the inventors of calculus, once said that
> Music is the pleasure the human mind experiences from counting without being aware that it is counting.
Implicit in this statement is the notion that all of us who appreciate music must, on at least a subconscious level, be appreciating its mathematical structure.
Mathematics of Music
ams.jhu.edu
The goal of an antilibrary is not to collect books you have read so you can proudly display them on your shelf; instead, it is to curate a highly personal collection of resources around themes you are curious about. Instead of a celebration of everything you know, an antilibrary is an ode to everything you want to explore.
Building an Antilibrary: The Power of Unread Books
Anne-Laure Le Cunff
...catch up on these, and many more highlights
Readwise