Rosenverse
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up

Gold
Thursday, September 30, 2021 • DesignOps Summit 2021
Share the love for this talk
How we Built a VoC (Voice of the Customer) Practice at Upwork from the Ground Up
Speakers: Shipra Kayan
Link:

Summary

Shipra Kayan, the former head of insights at Upwork, will present the origin story of Upwork's hugely successful and long-running VoC program. From the moment that triggered the formation of a VoC initiative, the ups, and downs of experimenting with its operating model, to why this program is still going strong 7 years after it was launched. She will field questions like "Who owns the VoC?", "What is its purpose?", and "Will we just create another presentation that won't have any real impact?"

- 15 minutes Upwork VoC case study

- 15 minutes for Q&A

Key Insights

  • •

    Rapid company growth creates chaotic, conflicting user feedback that overwhelms product managers without a clear VOC process.

  • •

    Crisis moments, like Upwork's NPS drop post-rebrand, can catalyze executive support to start formal VOC programs.

  • •

    Aligning around a single, existing customer loyalty metric (NPS) helps maintain focus rather than fragmenting goals.

  • •

    The key operational metric was the number of VOC-tagged product issues fixed, translating feedback into actionable roadmap items.

  • •

    Manual note-taking and affinity mapping worked initially but required evolution to collaborative software and AI tools as scale grew.

  • •

    UserVoice was adapted internally to aggregate and cluster customer issues before migrating to more automated idiomatic software.

  • •

    Monthly prioritization meetings with cross-functional stakeholders and frequent product leadership syncs ensured transparency and action.

  • •

    VOC ownership was best handled as a coalition with a facilitator rather than a single owner to avoid silos or turf wars.

  • •

    VOC findings expanded impact beyond product to pricing and legal policy changes, showing broader organizational influence.

  • •

    Attempting to change company culture too quickly or solo is less effective than focusing on incremental, visible customer-driven product improvements.

Notable Quotes

"Going from 100 to 200 people, suddenly product managers started hearing from a dozen people a week with conflicting requests."

"I tried to do everything all by myself at first and it didn’t catch on because no one else knew I was doing it."

"The rebrand caused our NPS to plummet and freaked out our executives — that was the trigger to get serious."

"We stuck with NPS because it was a pure metric with a long history we could trend, instead of muddying things with loyalty or revenue."

"Our one metric that mattered was maximizing the number of VOС-tagged tickets solved – showing customer feedback made it to the roadmap."

"We moved from Evernote to spreadsheets, to a giant affinity board in Mirror, then to UserVoice, and finally to idiomatic software with AI."

"We had to push through analysis paralysis and trust our guts as customer-facing teams that knew the business."

"Ownership of VOC is a hot potato, so we built a coalition with a facilitator to keep it collaborative and effective."

"VOC wasn’t a replacement for user research, but an enhancer that captured nuggets researchers might miss during discovery."

"I spent too much time trying to change company culture and should have focused more on just getting things done."

Ask the Rosenbot
Mariah Hay
BUILD: Discussion
2018 • Enterprise Experience 2018
Gold
Jon Fukuda
The Big Question about Innovation: A Panel Discussion
2024 • DesignOps Summit 2024
Gold
Maggie Dieringer
Creating Consistency Through Constant Change
2024 • DesignOps Summit 2020
Gold
Peter Van Dijck
Building impactful AI products for design and product leaders, Part 1: The new product journey
2025 • Rosenfeld Community
Sheryl Cababa
Day 2 Panel
2024 • Designing with AI 2024
Gold
John Calhoun
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
2024 • DesignOps Summit 2024
Gold
Brad Orego
Bringing Customer Research to More Internal Teams
2022 • Advancing Research 2022
Gold
Eduardo Ortiz
Theme 3 Intro
2025 • Advancing Research 2025
Gold
Maria Skaaden
Panel Discussion: Methodologies and Work Environments
2018 • DesignOps Summit 2018
Gold
Bria Alexander
Opening Remarks Day 1
2024 • Advancing Research 2024
Gold
Robin Beers
Navigating organizational systems: Rethinking researcher’s role in driving change
2025 • Advancing Research 2025
Gold
Dan Willis
Enterprise Storytelling Sessions
2017 • Enterprise Experience 2017
Gold
Johnny Michaelsen
Measure Behaviors, Not Results
2026 • Rosenfeld Community
Edward Cupps
The Principal Path: Journeying from Management to Individual Contributor
2021 • Design at Scale 2021
Gold
Mackenzie Cockram
Integrating Qualitative and Quantitative Research from Discovery to Live
2022 • QuantQual Interest Group
Product and Design at Bloomberg: A 15-year Evolution
2022 • Design in Product 2022
Gold

More Videos

Mark Interrante

"Nobody’s gonna listen to you people until you start speaking in the language of business."

Mark Interrante Harry Max

AI for Prioritization (3rd of 3 seminars)

July 11, 2024

Patrizia Bertini

"Next year we need to have an accessibility budget. You do what you want, but that's the choice."

Patrizia Bertini

The (r)evolution of designOps: It’s Time to Think (really) BIG

September 11, 2025

Shan Shen

"You want to be strict in what you emit but liberal in what you accept, to be clear and precise but also give some grace."

Shan Shen

Translating UX Terms into Business Contexts

November 29, 2023

Adam Thomas

"Feature roadmaps are bad because over time coherent actions become noise."

Adam Thomas

Survival Metrics – Making Change in a Fast, Data-Informed, and Politically Safe Way

December 6, 2022

Robin Beers

"In the application process for merchant services, underwriting’s risk-first mindset conflicted with customer needs, causing friction."

Robin Beers

Research as a Catalyst for Organizational Transformation

March 12, 2021

Sheri Byrne-Haber

"Assistive technology has to communicate with the destination, that’s your website or product."

Sheri Byrne-Haber

Accessibility at Scale

June 9, 2021

Joseph Meersman

"There is no formula for good critiques, but mindset is behavior over time: humility, active listening, gratitude, owning blind spots, and acknowledgment."

Joseph Meersman

Sweating the Pixel: Scaling Quality through Critique

June 10, 2021

Deanna Washington

"Go meet someone new at this conference and set up a coffee chat next week."

Deanna Washington Bria Alexander Jon Fukuda Saara Kamppari-Miller Farid Sabitov

Connecting the Ops: Plenary Panel and Closing Circle

September 9, 2022

Aaron Stienstra

"We built an equity learning community with 25 virtual sessions, 4 interagency roundtables, and one-on-one consultations with 37 agencies."

Aaron Stienstra Lashanda Hodge

Leveraging Civic Design to Advance Equity and Rebuild Trust in the US Federal Government

December 8, 2021