A missed disconnection notice isn’t a UX gap. It’s a customer who finds out their power is off when the lights don’t come on, not before.
I held design authority on this program from inside the team leading overall delivery and data integration, not from a seat on either team actually producing screens. Notifications were already shipping across six channels: an outage map, a desktop in-app banner on the customer portal, a separate mobile in-app banner inside the mobile app, email, SMS, and IVR. The split wasn’t arbitrary. The outage map only rendered on desktop, and email and SMS behaved differently enough by device that they needed separate channels to track. A seventh channel, push notifications, was just coming online with one category live. Two vendors split the work, a dedicated design execution vendor and a platform vendor’s embedded designers who owned the design system. Neither reported to me. I still had to get both building to one evidence standard, and every notification that didn’t land meant a customer picking up the phone instead, which was at five to fifteen dollars a call.

ROLE
Design Lead and Design Process Owner, embedded in the lead delivery and data-integration team, directing design execution across two external vendor design teams with no direct reporting line
TIMELINE
2.5 years on account; primary focus on the portal and notification workstreams
TEAM
Design execution vendor: designers, business analysts; platform vendor: designers, developers, testers; test vendor: testers; scrum management vendor: scrum masters; my consulting team: developers, testers, business analysts on the core data feed
STAKEHOLDERS
Design execution vendor leadership, platform vendor design system owners, test vendor leadership, scrum management function, client product and process owners
TOOLS / SYSTEMS
Figma for mockups and prototypes, SAP-based core billing platform, legacy on-prem and AWS-migrated notification infrastructure
CONSTRAINTS
Design authority exercised without a direct reporting line into either execution design team, a concurrent data platform migration owned by my own team, regulatory notification mandates for safety and reliability reporting
No One Owned Whether It Landed
Everything on this program shipped on time. Notifications fired on schedule across six channels, and every channel had a delivery team standing behind it. What nobody had was a shared way to say whether a notification that fired on schedule meant anything to the person receiving it. The measurement existed. The process for making five vendor teams answer to it did not, and closing that second gap turned out to be the real work.
A Gap No One Had Closed Yet
Each of the six live channels had a delivery team behind it, with push notifications still coming online when I rolled off, one category live. None of them shared an answer to the question that mattered most. Did the notification actually reach someone in a state where they could act on it?

Six channels live. One still coming online. Same threshold for all of them.
Product leadership had already defined an answer with a Notification Efficacy Ratio (channel views divided by confirmed deliveries) scoring every notification channel on a single, comparable scale. I worked with those product leads to put it to use, applying the ratio to design direction and content decisions across both design teams, even though neither one reported into my consulting team. A ratio above 0.50 meant the message was clear enough to act on without a follow-up call; at 0.49 or below, the customer usually ended up on the phone anyway. That distinction carried a real cost, since call center interactions ran five to fifteen dollars each. A channel scoring below the line represented an operating cost our content and channel decisions were directly accountable to, not a design preference.
A ratio above 0.50 meant the message was clear enough to act on without a follow-up call; at 0.49 or below, the customer usually ended up on the phone anyway.
Getting Five Teams to Row Together
The harder problem wasn’t the measurement. It was getting five vendor teams, each running its own version of agile, to route design and research evidence through a shared process before a feature shipped.
I built the intake as cross-department accountability at the roadmap level, anchored by a shared Definition of Ready that made research findings part of sprint planning instead of an afterthought. It piggybacked on existing OKR readouts, which let every team see its work against the same evidence standard rather than just its own. Getting it live meant working closely with the product owner, process owners, and scrum master to build buy-in, since none of it held up in front of the teams who’d actually run it without their support behind it.

231 in. 132 passed. The tiers are what kept it from becoming chaos.
The design teams and their respective vendor organizations had no reason to adopt any of it. Neither reported to me, and both already had their own definition of done. I got them to the table by making the evidence standard useful to them, not by asking them to comply with it. I showed the design execution team which patterns were generating the most retest failures before a feature even shipped. I showed the platform vendor’s designers where their own design system decisions were driving down the efficacy ratio on channels they owned. Neither wanted a mandate from a team they didn’t answer to. Both wanted fewer defects showing up in their own queue, and the evidence standard was the fastest way to get there.
None of that existed when I joined. I wasn’t installing a new tool for teams, I was asking teams already under real delivery pressure, most of whom had no obligation to listen to me at all, to pause just long enough to align on a customer experience bar we hadn’t agreed on yet, without stalling a schedule five other stakeholders were counting on.
The intake held up under real volume. Across the channels already live, I ran the triage that adjudicated 231 open observations against that same shared evidence standard, closing 132 as passing retests. That’s not a proof-of-concept number. It’s what the process produced once five teams actually started running through it.
What the Intake Actually Proved
- The Notification Efficacy Ratio, applied to real channel and content decisions, gave every live channel a comparable score against a real cost driver: five to fifteen dollars per avoidable call.
- The intake process replaced ad hoc, team-by-team quality checks with a single working standard. Cross-department accountability, a shared Definition of Ready, and OKR readouts all ran through it, and it kept running after I stopped pushing it.
- 231 observations triaged against a five-tier prioritization model, with 132 closing as passing retests, is proof the intake operated under real production volume across all six live channels.
Earning the Claim
The Notification Efficacy Ratio itself belongs to product leadership. What I can stand behind is how I applied it to design and content decisions, not its invention. The intake process is mine, built and then validated through buy-in with the product owner, process owners, and scrum master who had to run it day-to-day. Push notifications were still one category deep when I rolled off, so I’m not claiming a finished channel, only the six that were live and the process that held under all of them.
The Distinction I Look For Now
Neither the metric nor the intake was the hard part. Neither one meant anything until five teams who didn’t report to me agreed to run through it on their own. When I saw a channel underperforming its ratio, my reflex was to redesign the content myself and hand back a fix. What actually moved the ratio was slower work. I had to build enough shared evidence that the teams making channel and content decisions started reaching for the same standard without me in the room.
That’s the distinction I check for now before I propose a process. Am I building something I’ll have to keep enforcing, or something a team will keep using once I’m gone. That question matters most with the teams who were never going to answer to me in the first place.
Interested in how a shared evidence standard can align vendor teams who don’t report to you?
Continue Exploring

Making Payments Make Sense
A cashier guessing which fields depend on which isn’t friction. On a platform touching over 130 million merchants, it’s a lost transaction.

The Loop Healthcare Forgot to Build
Patient and provider needs don’t stay mapped. They keep moving the moment the experience actually improves.