Join 📚 Josh Beckman's Highlights
A batch of the best highlights from what Josh's read, .
Software engineering is what happens to programming
when you add time and other programmers.
What is Software Engineering?
Russ Cox
Luxury always boils down to time: someone is paying a lot of money for a lot of other people’s time. The question is, where do you invest that time? Rather than spending the bulk of it on line cooks fastidiously plating each dish, I’d want to put the time into the sourcing (growing or foraging) of incredible ingredients. Working on slow ridiculous fermentation projects. Gathering together the wisdom of plant-based culinary traditions with hundreds of years behind them. It still wouldn’t be revolutionary, but maybe it would be cool.
The other thing about chat was when we had these instruct models. The task of “complete this text, but in a nice or helpful way” is a pretty poorly defined task. That task is both confusing for the model and for the human who's supposed to do the data labeling.
Whereas for chat, people had an intuitive sense of what a helpful robot should be like. So it was just much easier for people to get an idea of what the model was supposed to do. As a result, the model had a much more coherent personality and it was much easier to get pretty sensible behavior robustly.
John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI
Dwarkesh Patel
...catch up on these, and many more highlights
Readwise