Rosenverse
Scaling Research Via an Ops First Model at Clever

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Scaling Research Via an Ops First Model at Clever

Gold
Monday, March 27, 2023 • Advancing Research 2023
Share the love for this talk
Scaling Research Via an Ops First Model at Clever
Speakers: Liza Pemstein and Jane Davis
Link:

Summary

In this Q&A session, we'll hear how Liza Pemstein, Research Operations Manager at Clever, built a robust research practice at one of the fastest-growing EdTech companies. Identifying the friction in the process experienced by design, product, engineering, and marketing, Liza has streamlined and scaled research. She'll share how she got started, what she's learned and what she's excited about in 2023!

Key Insights

  • •

    Clever operates a research operations first model with no dedicated UX researchers, relying on designers and PMs to conduct research.

  • •

    Liza Pennstein’s path to research operations included customer solutions roles emphasizing empathy, listening, and problem-solving.

  • •

    Centralizing participant incentives through a shared credit card and Jira ticket system eliminated confusion and improved process efficiency.

  • •

    Recruiting and scheduling user research participants was a major barrier that was addressed by creating shared participant databases.

  • •

    The ROCKS program at Clever (Research Ops Knowledge Share) facilitates cross-team learning and un-silos research knowledge.

  • •

    Initial focus was on increasing research confidence and comfort among practitioners before emphasizing quality and best practices.

  • •

    Balancing standardization with flexibility is critical; intervention happens when research quality or participant screening falters.

  • •

    Without dedicated UX researchers, Clever prioritizes enabling non-experts with training, templates, and external expert speakers.

  • •

    Building a lightweight repository with Great Question software supports storing and sharing research insights effectively.

  • •

    Future plans include broadening methods like unmoderated research, increasing visibility, and maintaining momentum through speaker series and workshops.

Notable Quotes

"Research is a sales role at its heart, delivering value to people to drive sustainable growth."

"I had a hunger for process and efficiency once I built a feedback bot to share customer insights."

"We don’t have dedicated user researchers, but designers and PMs conduct most research here."

"People were doing incentives in different ways, using their own cards, which was confusing, so I centralized it."

"The biggest struggle was recruiting and scheduling participants, so we started a shared Google sheet."

"Research is a group project and learning is a group project—you don’t have to be an expert but find those who are."

"I want to encourage excitement about research and gradually mold people into better researchers."

"Sometimes you have to make it messy before it can be clean again — disrupt to improve."

"We have the quantity of research work; now we’re focused on building up the quality."

"Unmoderated research is exciting because it lets us gather insights while freeing people up to be in two places at once."

Ask the Rosenbot
Ari Zelmanow
Dark Side of Democratization
2023 • Advancing Research Community
Kelly Dern
AI as a Design Partner: How to Get the Most Out of AI Tools to Scale Your Process
2023 • DesignOps Summit 2023
Gold
Jason Mesut
Shaping design, designers and teams
2018 • DesignOps Summit 2018
Gold
Alicia D. Johnson
Disasters and the 21st Century
2021 • Civic Design 2021
Gold
Melissa Schmidt
How UX Research Hit It Big in Las Vegas
2019 • Enterprise Experience 2019
Gold
James Chudley
Decarbonising User Journeys: How minimising enables us to do more with less
2025 • Climate UX Interest Group
Devon Powers
Imagining Better Futures
2022 • Advancing Research 2022
Gold
Anna Poznyakov
Get The Most Out Of Stakeholder Collaboration—and Maximize Your Research Impact
2021 • Advancing Research 2021
Gold
Louis Rosenfeld
Coffee with Lou #3: What Makes for a Successful UX Conference Presentation?
2024 • Rosenfeld Community
Crystal Yan
Building a Customer-Centric Culture
2020 • Advancing Research 2020
Gold
Caitlyn Hampton
Compass 101: Growing Your Career In A Startup World
2021 • Design at Scale 2021
Gold
Charlotte Vorbeck
Pipeline to Civic Design
2021 • Civic Design 2021
Gold
Sol Mesz
Hands or Brains? How to Hire for Strategy, Strategically
2024 • Enterprise Experience 2020
Gold
Jack Behar
How to Build Prototypes that Behave like an End-Product
2022 • Design in Product 2022
Gold
Karen McGrane
AI for Information Architects: Are the robots coming for our jobs?
2024 • Rosenfeld Community
Chui Chui Tan
Global insights: Embracing international and intercultural research for innovation
2025 • Advancing Research 2025
Gold

More Videos

Marc Fonteijn

"Everyone goes through quite an extensive application process, but it was stress-free and informal."

Marc Fonteijn Ru Butler

Increase your confidence, influence, and impact (through a Professional Community)

December 3, 2024

Dem Gerolemou

"Trust is something to build and maintain, not a box to check or a one-time achievement."

Dem Gerolemou Alexis Oh Neef Rehman

Climate technology fundamentals

May 15, 2024

Daniela Magaña Flores

"Mobile users gave Amazon a higher Net Promoter Score than desktop users, indicating a better mobile experience."

Daniela Magaña Flores Ariane Rahn Jeff Ephraim Bander

Ahead of Competition: Learn What UX Benchmarking Can Do for Your Business Today

March 10, 2022

Abbey Smalley

"We focused on consolidating frameworks and landed on Canvas, which now supports 45 teams and growing."

Abbey Smalley Sylas Souza

Scaling UX Past the Size of Your Team

January 8, 2024

Patrick Commarford

"Anything below zero on the design staffing score indicates we’re staffing lower priority projects over higher ones."

Patrick Commarford

Design Staffing for Impact

January 8, 2024

Xenia Adjoubei

"Data sovereignty is about who owns your data, which country’s laws apply, and how vulnerable groups are fairly protected."

Xenia Adjoubei Sean Bruce

Empowering Communities Through the Researcher in Residence Program

March 29, 2023

Craig Villamor

"Under a system which promotes growth at all cost and views engagement of time and data as monetary gain, digital products converge as they all race to employ the design patterns that generate the fattest bottom line."

Craig Villamor

Design Systems for Ethical Design

January 26, 2023

Jon Fukuda

"We encourage you all to be your own heroes and connect your own documents."

Jon Fukuda Ellie Krysl

Design Planning and Management Support

October 3, 2023

Iain McMaster

"Our hypothesis was we could create better product faster with more eyes looking at the problem, not just product."

Iain McMaster IHan Cheng

Design and Product: from Frenemy to Harmony

November 29, 2023