Episode
11

Peter Wang on What Comes After Code? The Role of Engineers in an AI-Driven Future

Peter Wang—Chief AI Officer at Anaconda and a driving force behind PyData—challenges conventional thinking about AI’s role in software development. As AI reshapes engineering, are we moving beyond writing code to orchestrating intelligence? Peter explores why companies are fixated on models instead of integration, how AI is breaking traditional software workflows, and what this shift means for open source. He also shares insights on the evolving role of engineers, the commoditization of AI models, and the deeper questions we should be asking about the future of software.
March 17, 2025
Listen on
spotify logoApple podcast logo
Guest
Peter Wang

Anaconda

,
Peter Wang is the Chief AI and Innovation Officer and Co-founder of Anaconda. Peter leads Anaconda’s AI Incubator, which focuses on advancing core Python technologies and developing new frontiers in open-source AI and machine learning, especially in the areas of edge computing, data privacy, and decentralized computing. Prior to founding Anaconda, Peter spent 15 years in software design and development across a broad range of areas, including 3D graphics, geophysics, large data simulation and visualization, financial risk modeling, and medical imaging. As a creator of the PyData community and conferences, he devotes time and energy to growing the Python data science community and advocating for increasing data literacy around the world. Peter holds a BA in Physics from Cornell University.
HOST
Hugo Bowne-Anderson

Delphina

Hugo Bowne-Anderson is an independent data and AI consultant with extensive experience in the tech industry. He is the host of the industry podcast Vanishing Gradients, a podcast exploring developments in data science and AI. Previously, Hugo served as Head of Developer Relations at Outerbounds and held roles at Coiled and DataCamp, where his work in data science education reached over 3 million learners. He has taught at Yale University, Cold Spring Harbor Laboratory, and conferences like SciPy and PyCon, and is a passionate advocate for democratizing data skills and open-source tools.

‍

‍

‍

‍

Key Quotes

Key Takeaways

1. AI is Eroding the Value of Coding—System Design is the New Engineering

Writing code is becoming less valuable as AI takes over implementation. What separates engineers now isn’t syntax fluency—it’s the ability to design, integrate, and debug intelligent systems. The bottleneck has shifted from execution to defining the right problems.

2. Software Engineering is Becoming Debugging for Emergent Behavior

Traditional software follows strict logic, but AI systems introduce uncertainty and unpredictability. Instead of writing rules, engineers must now diagnose why an AI system behaves the way it does. Debugging LLM-driven software is less about fixing syntax errors and more about steering complex, probabilistic outputs toward useful results.

3. AI Models Are Converging—Stop Treating Them as a Moat

Every major AI company is distilling competitors’ models, making them less of a differentiator. The real advantage isn’t in having a better model—it’s in how well a company integrates AI into its business workflows. Companies that obsess over model performance while neglecting deployment and data pipelines will lose ground.

4. Stop Expecting Models to Be Correct—Build Workflows for Uncertainty

Businesses still expect AI systems to behave like traditional software. But hallucinations, inconsistencies, and errors are inherent to generative AI. Instead of chasing “fixes,” the real challenge is engineering workflows that handle uncertainty—using ranking, retrieval, and human validation where necessary.

5. You Don’t Need AI Models for Everything—Better Retrieval Often Wins

Companies overuse generative AI when classic search and structured knowledge retrieval would be faster, cheaper, and more reliable. BM25, metadata filtering, and structured queries can often outperform a costly LLM call. The future isn’t just about bigger models—but smarter ways to use data.

‍

You can read the full transcript here.

‍

00:00 Introduction to the Technological Revolution

00:55 Meet Peter Wang -- Chief AI Officer at Anaconda‍

01:16 Big Questions in AI and Software Development

03:44 Peter's Journey to Chief AI Officer‍

04:19 The Hype and Reality of AI‍

06:10 Exploring the Future of Descriptive Analytics

07:02 The Impact of Generative AI on Data Science

10:42 Navigating the Complex AI Landscape

16:26 The Role of Pioneers and Settlers in Business Innovation‍

28:52 The Importance of Open Source in AI Development

33:13 The Backbone of AI: Open Source Contributions

35:26 The Future of AI: Smaller and More Efficient Models‍

38:43 The Role of Data in AI Development

39:38 Legal and Ethical Considerations in AI‍

42:34 Challenges in AI Tooling and Frameworks

57:05 Human-AI Collaboration -- The Cybernetic Approach

01:01:18 Practical Advice for Data Science Leaders‍

01:05:08 Conclusion and Final Thoughts

Links From The Show

‍

Transcript

featured

In the spotlight: Our most popular episodes

Episode
10

Ari Kaplan on Why AI Won't Save You But Data Intelligence Will

Ari Kaplan—Global Head of Evangelism at Databricks and a pioneer in sports analytics—explains why businesses fixated on AI often overlook the real advantage: making better decisions with their own data. He shares lessons from his work building analytics teams for Major League Baseball, advising McLaren’s F1 strategy, and helping companies apply AI where it actually works—without falling into hype-driven traps.

With
Ari Kaplan
Global Head of Evangelism
,
Databricks
Play episode
Episode
5

Gabriel Weintraub on The Hard Truth About Building AI Systems and What Most Leaders Miss About AI

In this episode of High Signal, Gabriel Weintraub (the Amman Professor of Operations, Information, and Technology at Stanford Graduate School of Business), brings his expertise in market design, data science, and operations, enriched by his experience with global platforms like Uber and Mercado Libre, to a conversation that spans practical strategies, cultural insights, and global perspectives on data and AI.
With
Gabriel Weintraub
Amman Mineral Professor of Operations, Information & Technology
,
Stanford Graduate School of Business
Episode
3

Chiara Farronato on Data Science Meets Management: Teamwork, Experimentation, and Decision-Making

Harvard Business School's Chiara Farronato discusses how digital platforms like Airbnb and Uber have transformed industries. She explores the challenges of fostering collaboration between managers and data scientists, bridging communication gaps, and building data-driven cultures. Chiara also delves into the complexities of managing peer-to-peer marketplaces and the evolving role of data in decision-making. This episode offers key insights for business leaders working with technical teams and navigating platform-based innovation.
With
Chiara Farronato
Associate Professor
,
Harvard Business School
most recent

Listen up: Our latest discussions

Hear the hottest takes on data science and AI.

See all episodes
Episode
12

Stefan Wager on Why Your Machine Learning Solves The Wrong Problem

Stefan Wager—Professor at Stanford and expert on causal machine learning—has worked with leading tech companies including Dropbox, Facebook, Google, and Uber. He challenges the widespread assumption that better predictions mean better decisions. Traditional machine learning excels at prediction, but is prediction really what your business needs? Stefan explores why predictive models alone often fail to answer critical “what-if” questions, how causal machine learning bridges this gap, and provides practical advice for how you can start applying causal ML at work.
With
Stefan Wager
Associate professor of operations, information and technology at Stanford Graduate School of Business
,
Stanford University
Episode
11

Peter Wang on What Comes After Code? The Role of Engineers in an AI-Driven Future

Peter Wang—Chief AI Officer at Anaconda and a driving force behind PyData—challenges conventional thinking about AI’s role in software development. As AI reshapes engineering, are we moving beyond writing code to orchestrating intelligence? Peter explores why companies are fixated on models instead of integration, how AI is breaking traditional software workflows, and what this shift means for open source. He also shares insights on the evolving role of engineers, the commoditization of AI models, and the deeper questions we should be asking about the future of software.
With
Peter Wang
Chief AI Officer
,
Anaconda
Episode
10

Ari Kaplan on Why AI Won't Save You But Data Intelligence Will

Ari Kaplan—Global Head of Evangelism at Databricks and a pioneer in sports analytics—explains why businesses fixated on AI often overlook the real advantage: making better decisions with their own data. He shares lessons from his work building analytics teams for Major League Baseball, advising McLaren’s F1 strategy, and helping companies apply AI where it actually works—without falling into hype-driven traps.
With
Ari Kaplan
Global Head of Evangelism
,
Databricks

Get the latest episodes in your inbox

Never miss an episode of High Signal by signing up for the Delphina newsletter.

By clicking Sign Up you're confirming that you agree with our Terms and Conditions.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.