Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Lean Engineering: Engineering for Learning and Experimentation in the Enterprise

Gold
Thursday, May 14, 2015 • Enterprise UX 2015
Share the love for this talk
Lean Engineering: Engineering for Learning and Experimentation in the Enterprise
Speakers: Bill Scott
Link:

Summary

Bill recounts his journey from Netflix, where he witnessed the shift from DVDs to streaming, to PayPal, where he led transformative engineering reforms. At Netflix, he realized that designing software as a throwaway experimentation layer rather than permanent code was key, with multiple concurrent experiments driving user-focused learning. He stresses that engineering should enable learning rather than just code stability. At PayPal, Bill faced legacy technical debt and cultural inertia (organizational antibodies) but pushed for a culture of rapid iteration, collaboration, and customer immersion. He implemented a new technology stack based on Node.js and GitHub, democratized innovation through an internal open source model, and emphasized the need to give Agile a 'brain' by embedding continuous user feedback deeply into the backlog and process. Bill highlights the importance of shared vocabulary between disciplines, collaboration, and continuous customer feedback to keep teams aligned and focused on solving real user problems rather than defending solutions. Drawing on examples from Netflix, PayPal, and Meetup, he underscores that successful teams embrace failure in small increments, enable rapid prototyping, and design for volatility.

Key Insights

  • At Netflix, 95% of the UI layer was thrown away within a year, reframing UI as an experimentation layer rather than durable software.

  • Engineering's primary goal should be enabling learning, partnering closely with design and product teams.

  • Different parts of a software stack have different risk profiles; applying the concept of shearing layers helps accept more risk on the user interface layer to enable faster learning.

  • Organizations contain 'antibodies'—cultural and organizational forces resistant to change—that must be understood and navigated to drive transformation.

  • PayPal's transformation was accelerated by a top-down mandate combined with intense cross-functional collaboration and frequent user testing.

  • Using internal GitHub and open source paradigms democratizes code access and innovation, allowing anyone to contribute and experiment.

  • Prototyping should be considered a first-class engineering activity, not a separate or lesser process.

  • Agile methods lack an inherent ‘brain’; embedding continuous customer feedback and real user context into the backlog gives Agile teams direction and purpose.

  • Engineering teams that share vocabulary and deeply collaborate with designers and product managers produce better outcomes.

  • Embracing small incremental failures enables faster learning and avoids the risk of large-scale failures that can paralyze organizations.

Notable Quotes

"I started thinking of the UI layer as the experimentation layer."

"Engineering’s number one goal should be to enable learning."

"You have to design for throw away ability because the majority of experience gets thrown away."

"Organizations contain antibodies—cultural forces that resist change."

"If you don’t soak teams in real customer context, they do dumb things not because they’re dumb, but because they lack context."

"Features eventually become barnacles that are impossible to scrape off the boat."

"Agile needs a brain, and that brain is the continuous customer feedback loop."

"Prototyping isn’t a second-class citizen, it should be a first-class citizen."

"Democratizing code with an internal open source model accelerates innovation."

"I know I will fail, but I will fail in small increments rather than bet everything and fail big."

Ask the Rosenbot
Sarah Brooks
Theme 3 Intro
2021 • Civic Design 2021
Gold
Jon Fukuda
Design Planning and Management Support
2023 • DesignOps Summit 2023
Gold
Shivanjali M.
From Fragmented to Fluent: The Linguistic Approach to Research Knowledge
2026 • Rosenfeld Community
B. Pagels-Minor
Breaking the Tension: The Power of Enabling Your Employees to Show Up Authentically
2022 • Design at Scale 2022
Gold
Daniel Gloyd
Designing From the Inside Out: How Method Acting Can Inspire Design Research
2026 • Rosenfeld Community
Lada Gorlenko
Theme 1: Discussion
2024 • Enterprise Experience 2020
Gold
Saara Kamppari-Miller
Theme Three Intro
2023 • DesignOps Summit 2023
Gold
Nina Jurcic
The Design System Rollercoaster: From Enabler and Bottleneck to Catalyst for Change
2023 • DesignOps Summit 2023
Gold
Roberta Dombrowski
Making Research a Team Sport
2022 • Advancing Research 2022
Gold
David Conrad
The Feeling of Data
2023 • Enterprise Community
Louis Rosenfeld
Welcome / Housekeeping
2023 • Enterprise UX 2023
Gold
Cassandra Piester
Developing and Deploying Your Design Operations Strategy
2024 • DesignOps Summit 2024
Gold
Peter Merholz
The 2025 State of UX/Design Organizational Health
2025 • Rosenfeld Community
Sarah Sgarlato Pierini
From Passion to Execution: A Story of Evolving Research Maturity at LinkedIn
2022 • DesignOps Summit 2022
Gold
Daniel Korczynski
Why AI Is Bad at Research (and how to make it actually useful)
2026 • Advancing Research 2026
Conference
Renee Bouwens
Landing Product Impact: Aligning Research as a Foundational Driver for Delivering the World’s Best Products
2023 • QuantQual Interest Group

More Videos

Daniel Gloyd

"No role exists in isolation, said Fred Rogers, emphasizing interconnectedness beyond the individual."

Daniel Gloyd

Designing From the Inside Out: How Method Acting Can Inspire Design Research

February 12, 2026

Deirdre Hirschtritt

"Flour is the core structure of our relationships. Like gluten makes dough stronger, background research makes relationships stronger."

Deirdre Hirschtritt Cesar Paredes Marie Perrot

Research is Only as Good as the Relationships You Build

November 17, 2022

Benjamin Real

"It was like arriving to your home after a long day and just right to rest but at the same time you know you could not wait to continue working."

Benjamin Real

Maturity Models: A Core Tool for Creating a DesignOps Strategy

October 1, 2021

Max Gadney

"Go beyond climate, look at the personal systems you understand or want to solve to find your career motivation."

Max Gadney Andrea Petrucci Joshua Stehr Hannah Wickes

Assessing UX jobs for impact in climate

August 14, 2024

Lada Gorlenko

"From fast-paced tech worlds, you will appreciate the patience and perseverance it takes to move an old champion."

Lada Gorlenko

Theme 1: Intro

January 8, 2024

Feyikemi Akinwolemiwa

"If it feels uncomfortable, you’re probably doing something right."

Feyikemi Akinwolemiwa

Play to innovate: How curiosity and experimentation transform UX

March 11, 2026

Bria Alexander

"Lauren Cantor keeps all those links and other resources so we don’t have to be googling while listening."

Bria Alexander

Opening Remarks

March 29, 2023

Llewyn Paine

"User recordings are your most valuable asset but have become riskier due to biometric privacy laws."

Llewyn Paine

[Demo] Deploying AI doppelgangers to de-identify user research recordings

June 5, 2024

Bria Alexander

"It's okay to try and mess up your OKRs in the first few quarters and learn from it."

Bria Alexander Benson Low Natalya Pemberton Stephanie Goldthorpe

OKRs—Helpful or Harmful?

January 20, 2022