Plays and Resources
On this page:
- Establish Trust and Urgency
- Identify Problems
- Generate Solutions
- Prioritize and Implement
1. Establish Trust and Urgency
It’s crucial to establish a relationship of trust and clear expectations with state partners at the beginning of the project. Every stage of the process is predicated on an open exchange of details and data about how systems are performing.
In addition, all members of the team – including vendors – must understand the urgency and criticality of the project. Leadership should be engaged regularly from the beginning, and the work should be made a top priority. Common goals should be established at the beginning of the project so that everyone understands what success looks like.
- Keep states’ needs top of mind. States are under an immense amount of pressure right now. Be mindful of the amount of work state staff have on their plates, celebrate the great work they’re already doing, and focus the scope of work around the most urgent needs.
- Orient the team towards OUTCOMES, not compliance. Establish common goals with state partners to rapidly alleviate burden on the public and state staff. Discuss norms around confidentiality and information sharing about the project.
- Get buy-in from senior leadership, including the State Medicaid Director and Deputy Director. Establish this work as the top priority for the team.
- Convene a cross functional group of subject matter experts and decision makers, including Policy, Communications, Human-Centered Design and Technical experts across state staff and vendor teams.
- Determine one or two North Star(s). What goals are we specifically working towards? These should be measurable (“increase automatic renewals to XX%”) but don’t have to be numeric (“stand up an online renewal form”).
- Adopt terminology from the state. For example, if a “renewal” is called a “review” in the state, this term should be used throughout the project.
- Go where the work is. Travel to where your state partners and their Medicaid members are. This establishes urgency for the work, builds rapport, and creates momentum around generating solutions and decision-making.
Resources
Guides
Templates
- Project Charter (docx, pdf): An example charter used to establish the goals, dates, and activities of the engagement between the civic tech organization and the state health and human services agency.
- On-Site Schedule: An example schedule for the week of the on-site engagement. Work typically begins virtually 3-4 weeks prior and 3-4 weeks following, but the on-site week is typically the most impactful and intense period of work.
Workshops
- Kickoff Meeting: Sample agenda and materials for the project kickoff, where state staff and the full team align on goals, norms, and the work moving forward.
- Hypothesis Generation Workshop: Sample agenda and materials for a workshop focused on generating hypotheses on where the team could have the biggest impact.
2. Identify Problems
Working with the state and external partners, determine the largest sources of administrative burden and churn during renewal. Where are people being moved from automatic renewal to manual renewal? Where are people struggling or falling off when completing a renewal? What methods are most commonly utilized, and what are the biggest problems with those methods?
When determining the problems, it’s important to keep the focus on the “end-to-end” renewal process. An ex parte attempt is only the first step in a person’s renewal. For the millions of people manually renewing, there are vast opportunities to improve the experience and increase renewal rates.
This example funnel depicts the a population of Medicaid renewals and their various states. Full-size image here.
- Pull the numbers. Pull end-to-end funnel data, including where drop-offs occur at each step in the renewal process. Pull ex parte failure reasons, and organize by the number of people impacted. Pull web traffic numbers to understand how people are accessing online renewal materials.
- Be a renewer. Put your renewer hat on and do some Googling to figure out how to renew Medicaid in your state. Do this on mobile, record screenshots as you go, and note pain points throughout the process. Call customer support when you get stuck, take notes on the interactive voice response (IVR) and overall experience.
- Learn from experts. Meet with Navigators and eligibility workers to identify top challenges across the renewal process that members of their community experience. Meet in smaller groups with state SMEs and decision makers to better understand the challenges they’ve been dealing with.
- Map the experience. Map a high-level user journey of the end-to-end renewal experience, noting common pain points and workarounds. Use this journey map to target the focus of your interventions to specific and achievable areas.
- Don’t split the party. Approach the system from a holistic, human-centered perspective; don’t separate into siloed engineering, policy, design, or research teams. Those responsible for ex parte policy and systems changes may not have had the opportunity to meet with eligibility workers to understand how they process a renewal, necessary context for identifying root causes of ex parte failures. Common challenges reported by Navigators highlight not only opportunities to improve the manual renewal process, but also opportunities for ex parte logic changes.
Resources
Guides
- Navigator Research Guide (docx, pdf): Working with Navigators is crucial for the success of renewals work. This guide provides a set of resources for explaining, justifying, preparing, and performing work with Navigators. It includes background information on Navigator organizations, example research plans, and email templates for correspondence.
Templates
- Data Request Worksheet (xlsx, pdf): A worksheet that can be used by the state to begin measuring their end-to-end renewal funnel. Some states will not be able to fill out all fields in the template; that’s okay! This template can and should be adapted for the particular state.
- State Renewals Funnel: A method for visualizing the end-to-end funnel of Medicaid renewals, and determining which drop-off points are the most critical to focus on.
- Renewal Journey Map: A method for mapping a member’s renewal journey from start to finish. This can be used throughout the investigation and research process for determining challenges and opportunities for improvement.
Workshops
- Navigator Workshop: Typically, at the beginning of the week, we hold a convening of Navigators focused on generating potential solutions.
- Ex Parte Workshop #1: The first ex parte workshop, typically held in the week of the on-site, is focused on identifying opportunities for improvement in the ex parte renewal flow.
- Manual Renewal Workshop #1: The first manual renewal workshop, typically held in the week of the on-site, is focused on bringing the experiences and solutions from research with Navigators to the state so that solutioning can begin.
3. Generate Solutions
Once problems have been identified, work with the broader cross-functional team to start generating solutions. Often times there will be more problems available to solve than possible to talk through in the given time. Start with high-impact and/or low-effort problems, and present them in turn for consideration. Solutions should be high-level, but estimable. Whenever possible, rely on data or similar solutions in other states as evidence that the solution will, in fact, solve the problem.
Whenever possible, scope should be reduced towards the minimum viable solution. When implementation timelines are given, look for reasonable opportunities to reduce estimates and remove unnecessary requirements. Ask for clarity on the stages of implementation, and which are projected to take the most amount of time. Can they be reduced? For example, if a change is completely back-end, eliminate any front-end testing. If a change will only affect mobile users, eliminate desktop testing. If a website is not functional on mobile, change only the pieces to make it functional (as opposed to friendly). Keep asking “why” until the timeline is definitively as small as possible.
- Use the lived experiences of experts. If the team was able to meet with Navigators and case workers before a solutioning session with the state, bring their ideas and solutions to the table. Treat these as expert opinions, and champion them whenever possible.
- Work collaboratively and let states be the heroes. When solutions are being discussed, the decision makers and implementers should be in the room, driving the process. Give equal weight to everyone’s voice, and specifically call out those with on-the-ground knowledge. Empower state policy staff to reconsider assumptions and ask questions about implementation. Pass around artifacts (like a copy of the renewal packet, if available) and let them make changes themselves.
- Reference Medicaid rules and regulations. Any solution MUST be palatable to state policy experts, or it cannot be implemented. Whenever possible, use rules and regulations to create a safe policy space for solutioning. If policy concerns are brought up broadly, read the policy and use it to make a risk calculation. A policy may prohibit something, but in practice that situation may never occur; use lived experiences of Navigators and case workers to make that clear. Ultimately, it is up to the discretion of state Medicaid officials to decide what changes are appropriate and it is the role of civic technologists to empower them with all of the data, evidence, and implementation clarity that they need to make well reasoned decisions.
- Keep asking “why”. If a timeline doesn’t make sense, or seems unrealistic, ask for specifics. If the explanation doesn’t make sense, ask for more. We don’t need to be the experts on the state systems or processes, but we do need to recognize when a solution isn’t as efficient (or impactful) as it can be. “Policy” is often cited as a reason something can’t be done; ask for the regulation.
- Find the minimum viable solution. Working with the state staff, eliminate parts of the implementation process that are unnecessary. Focus specifically on stages that may are prone to inflation: testing, for example, or administrative processes. Can these stages be reduced? Don’t be satisfied until any solution is the smallest viable solution possible. Ask about the emergency release process. Strive to land changes before, rather than just after, any monthly batch run.
Resources
Workshops
- Ex Parte Workshop #2: The second ex parte workshop is focused around implementation details and aligning on potential solutions.
- Manual Renewal Workshop #2: The second manual renewal workshop is focused on determining implementation plans and assigning owners to action items.
4. Prioritize and Implement
There will always be more problems to solve than there are resources available to solve them. State Medicaid teams are overwhelmed with priorities and ongoing work, and providing clarity through data-driven prioritization is critical. Driving clear prioritization with stakeholders allows the implementation teams to focus correctly on areas with the highest impact and quickest timelines.
The two most important metrics to consider when prioritizing are impact and speed. Impact is typically measured in number of successful renewals per month, while speed is measured in time to implementation. Importantly, these numbers are almost always estimates, and can be very rough; for example, improving the design of a renewal notice may increase the number of successful renewals based on the number of people receiving the notice, but it is difficult to estimate.
Once a set of solutions is prioritized, the state and vendor work together to schedule implementation and begin work. If helpful, play a part in that process as well, taking on roles ranging from advisor to individual contributor.
-
Let the state drive implementation. States should own and manage the implementation work, and use the civic technology team as much (or as little) as they see fit. Ensure stakeholders are aware of the team’s availability, strengths, and connections. If they don’t need any extra help, let them do the work!
-
Meet regularly if needed. If helpful, meet with stakeholders on a regular basis after the engagement. Gauge how well the work is progressing, and where potential roadblocks could occur. Providing basic project management of the priorities that you have agreed to can be a powerful tool. In particular, more junior vendor teams may require coaching if they are being asked to deviate from their usual process.
-
Ask for metrics. Measuring the impact of the engagement is crucial to ensuring the state and civic technology team’s time was well spent. If possible, utilize rigorous methods like A/B testing, pilots, and randomized trials to gather quality data of the effectivity of solutions.
Resources
Templates
- Example Recommendations Document(docx, pdf): At the end of the on-site week, all recommendations agreed upon by both the state and the civic technology team are documented in this recommendations report, which is then delivered to the state Medicaid leadership.
Guides
- Benefits Data Trust: Prioritization Tool: Determine what policy and process solutions are feasible by analyzing the risk, value, cost and effort of implementation and establish action steps for implementing proposed policy & process changes.
- Technical System Overview provides a general overview of the system components you should expect to find supporting a Medicaid program, as well as some common shortfalls and limitations.
Workshops
- Closing Meeting: This meeting is typically held at the end of the on-site week. It is an opportunity to present recommendations to the state senior leadership, and re-affirm the agreed upon actions.
- Prioritization Session: This session can help the state determine which recommendations require immediate action versus long-term changes.