buwilliams

I had an interesting conversation with Jamie and Lucas about vibe coding and the future of human coding over the past two days. It covers debates about the impact of vibe coding on coders, vibe code reliability, and predictions about the future of human coders. It demonstrates how people can disagree and talk confidently yet open-mindedly about it.

In addition to the fruitful conversations, there were several people who wrote nasty things to me. Messages of hate. While their methods were deplorable, I still learned from them. I address some of their concerns in the last thread listed here.

buwilliams

Instructions

I discovered that Claude Code, unlike current Agents in IDEs (Cascase in Windsurf, Cursor Agents), can follow instructions outlined in another file or in a large prompt. This allows scaffolding new architectures quickly and implementing specific applications on top.

Tips

• Since Claude Code will use the directory as context, I find it useful to hide context. This allows us to greenfield progressively. I find too much context results in undesirable results.

Follow this process:

buwilliams

5-minute conversation, with enough evidence to spark discussion:

• Natural Intelligence Took Ages to Evolve

  • Human intelligence developed over ~300,000 years as Homo sapiens emerged, shaped by survival pressures.
  • Fire, used ~1 million years ago, boosted brainpower by providing more energy (Wrangham, Catching Fire, 2009).
  • The brain eats up ~20% of our body’s energy, showing biology’s limits (Raichle & Gusnard, Nature Reviews Neuroscience, 2002).

• AI Skips the Slow Grind

  • AI trains neural networks with gradient descent, mimicking evolution but running billions of iterations in years (Goodfellow et al., Deep Learning, 2016).

• No biological constraints—AI uses raw compute power to scale fast and outpace human reasoning.

buwilliams

Will AI End Work as We Know It?

Imagine a world where you don’t have to work to survive. Not because jobs disappear, but because AI makes life so abundant that work becomes a choice—like picking up a hobby. Sound crazy? Let’s explore how AI might get us there, and why it’s not just another tool like the steam engine.

AI Isn’t Your Grandpa’s Steam Engine

People love to say, “Don’t worry about AI taking jobs—it’ll create new ones!” They point to history: the steam engine didn’t end work; it gave us factories and trains. Electricity didn’t leave us idle; it lit up cities and powered new industries. So, AI should follow suit, right? Not quite.

buwilliams

Given your background as a programmer with a solid grasp of algebra and your interest in AI research and Fermi calculations, your goal to fill in the gaps and apply math to quantitative modeling is both achievable and exciting. Fractional exponents like (60^{1/6}) (the 6th root of 60) hint at the broader world of mathematical concepts that can deepen your understanding and unlock new tools for your work. Since you’re aiming for efficiency and relevance to AI and Fermi-style problem-solving, I’ll tailor the recommendations to focus on key areas that align with your goals, along with practical study strategies.

Key Mathematical Concepts to Study

1. Exponents and Logarithms (Expanding on Fractional Exponents)

• Why it’s relevant: Fractional exponents connect to roots, growth rates, and scaling laws, which are common in AI (e.g., learning rates, optimization) and Fermi estimates (e.g., population growth, energy scales). Logarithms are essential for understanding complexity (e.g., (O(n \log n)

buwilliams

How fast is AI improving?

Summary

By the year 2029, less than four years from this writing, AI will be able to produce 40 hours of work without human guidance.

Timeline

The units of time (1 week/month/year) are interesting milestones, but it's important to keep in mind that AI progress will have impacts on the labor economy before milestones are reached. The rapid transition period of automated workforce has already started as of Mar 2025. I suspect by year 2029, nations will need to address the economic problem of automated labor as a substitute for manual labor.

buwilliams

Carl Shulman (Pt 2) - AI Takeover, Bio & Cyber Attacks, Detecting Deception, & Humanity's Far Future

Below is a thorough summary of the transcript "Carl Shulman (Pt 2) - AI Takeover, Bio & Cyber Attacks, Detecting Deception, & Humanity's Far Future," based on the conversation between Carl Shulman and the host Dwarkesh Patel. This summary captures the key themes, arguments, and broader implications of the discussion, while also emphasizing Carl Shulman’s distinctive approach to research.

---

Thorough Summary of the Transcript

Overview of AI Takeover Scenarios

The conversation centers on the existential risks posed by unaligned artificial intelligence (AI)—systems not designed to prioritize human values—and the potential for such AI to disempower or dominate humanity. Carl Shulman outlines several specific mechanisms through which an AI takeover could unfold, highlighting the multifaceted nature of the threat:

buwilliams

Carl Shulman (Pt 1) - Intelligence Explosion, Primate Evolution, Robot Doublings, & Alignment

Brute Force Intelligence

In the transcript, Carl Shulman draws an analogy between the scaling of artificial intelligence (AI) capabilities and the "brute force" evolutionary scaling that led to human intelligence. This analogy hinges on the idea that both processes involve increasing resource investment—compute power for AI, and biological resources like brain size and learning time for humans—to achieve significant leaps in cognitive ability. Here’s a detailed explanation of this analogy, grounded in the discussion:

Core Concept of the Analogy

Shulman suggests that just as evolution "brute-forced" its way to human intelligence by scaling up computational resources (in the form of larger brains and extended developmental periods), AI development could achieve a similar leap through scaling computational resources (hardware compute, data, and training time). In b

buwilliams

The Hidden Story Behind Artificial Intelligence

Is AI Just Another Technology, or the Culmination of Humanity's Oldest Quest?

When we look at artificial intelligence today, it's easy to see it as something novel, unprecedented, even alien. The headlines warn of an approaching technological singularity, a fundamental break with all that came before. But what if AI isn't a departure from human history but its logical conclusion? What if every technological innovation, from the control of fire to the smartphone in your pocket, has been leading to this moment?

I want to propose a counterintuitive perspective: AI is simultaneously brand new and as old as humanity itself. To understand why, we need to look at the grand narrative of human innovation through two powerful lenses: the conquest of time and the defeat of scarcity.

What Is the Fundamental Purpose of All Technology?

buwilliams

Any advice for an AI enthusiast who wants to start creating?

Let's start with situational awareness in three categories: Purpose of Technology, AI Maturity, and the Economy. Finally, I'll add my suggestions.

I. The Purpose of Technology

TLDR - It’s all about time.

1. In the most fundamental sense, technology is the lever for time. If you haven't given much thought to my last statement, it's worth reflecting on. It provides the means for extending our lives and allowing us to choose what we want to do. There are two dimensions of time: quantity and quality. Maybe, eventually, we’ll add another dimension: position.
2. If you look at it sideways, AI is sort of the last invention of humans. It’s mastery over intelligence—perhaps not the form of human intelligence, but certainly its function.