Successful MMIS Implementations (Part 3 of 3)

So what action the community take to address the challenges and barriers related to MMIS implementation?

Prior blog entries were an attempt to shed light on the day-to-day situation of an MMIS project and should not be read as complaints or issues directed at any one entity. Good project management practices can and should deal with the issues such as vague requirements, relationship management, fiscal and schedule performance, and project communications. However, the probability of success of MMIS projects can be tremendously increased with a change in framework and approach. We should add that the issues discussed in Parts 1 and 2 are not unique to the MMIS market. Software development projects across all industries face similar situations. The general trend in all industries is that the penalty for underestimation is more severe than the penalty for overestimation. The FFP strategy can be successful, but it is a blunt instrument in current practice. The desire is not to let the pendulum swing completely away from FFP contracts back to the time and materials environment. A balanced approach is warranted and can be implemented to meet everyone’s goals and objectives. The following provides specific recommendations for future MMIS success. We have organized these recommendations by the key stakeholders involved in each MMIS contract: State, CMS, and Vendor.
Recommendations for State Agencies

• Balance between time and materials (T&M) and fixed price contracts. Consider breaking the MMIS procurement into at least two phases: phase 1 - requirements and design and phase 2 – development and implementation. The T&M contract vehicle can be used for phase 1 and FFP for phase 2. It should be noted that it is assumed that the same vendor is recommended to complete both the phases as the context of requirements is bound to be lost in transition if a different vendor is brought in for phase 2.
• Implement award fee or other incentive based contracts. The state has certain goals and objectives for the MMIS procurement. The vendor is motivated to perform. However, the two are not necessarily aligned. Is the vendor motivated to addressing the goals and objectives? Award fee contracts used often in the Federal government contracts are an excellent vehicle to align goal achievement and performance and rewards. The Census Bureau and the Federal Bureau of Investigations have recently awarded these types of contracts.
• Consider performance based contracting (PBC). Again, this is a popular approach in Federal government. The details of performance based contracting are not within the scope of this paper; however, in general PBC focuses on performance and service level agreements. It establishes a quality assurance surveillance plan for contracts administration and this plan is tied intimately to the vendor’s quality assurance and project management.
• Establish statements of objectives (SOO) and a concept of operations document in the RFP and avoid specific requirements. Federal agencies such as the Federal Bureau of Investigation, Department of Defense, and Department of Commerce follow this approach when procuring complex information systems. The general idea is to establish objectives and describe the vision of the operations of the MMIS for the vendor community. The vendors then conduct requirements elicitation during DD&I. This approach avoids the loss of the requirements context discussed earlier in this paper. The vendor’s analysts and design staff will be able to capture precise information necessary to build the MMIS. It also avoids frustrations faced by the state staff in having to participate twice in the same process, namely, during requirements gathering by the vendor helping to write the RFP, and then during the requirements analysis/validation by the vendor building the MMIS.
• Allow the vendor to propose an alternative system development life cycle (SDLC). Most MMIS RFP’s require a waterfall-based SDLC. Vendors can help manage risks and be more responsive with alternative processes such as agile and rapid prototyping. Require parallel system testing. The primary purpose of an MMIS is to pay claims and it is absolutely critical to ensure that differences (if any) in payment amount are fully understood between the old MMIS and the new MMIS. Providers are very politically involved and motivated to use all avenues if the new MMIS pays claims differently than the old MMIS; even if the system is paying more accurately. Parallel testing is a great risk mitigation process prior to going live with the MMIS. Some states recommend parallel testing but this process should be mandated and should not be compromised in any circumstance.
• Avoid big bang implementations. Implementing a large system in one deployment is difficult to manage given the large number of stakeholders and thousands of unknown variables. Many states evolve to some form of phased implementation during DD&I; however, it is a very disruptive process to change to a phased implementation after creating and pricing a work plan for a big bang implementation. It is much easier to plan for a phased implementation as a part of the procurement process.
• Train state business users on how to manage FFP contracts and the project management triangle.

Recommendations for CMS

• Entertain and require alternative acquisition strategies (i.e., T&M, award fee, etc). Ask states to reduce risk and consider alternative acquisition strategies as a part of the Advanced Planning Document approval.
• Be more actively involved during the DD&I phase. CMS is a key stakeholder that funds up to 90% of the DD&I phase of the MMIS. CMS involvement as part of the Project Management Office and governance processes is critical for proper communications. The model of current involvement is passive in terms of status reports and occasional site visits. CMS involvement should be more integral to the project execution than otherwise. It keeps all three parties (i.e., CMS, state, and vendor), fully engaged in the success of the project.
• Consider mandating IV&V activities and/or establish a Project Control Office vendor that reports to CMS. Collect history of project performance on past MMIS implementations and share lessons learned across states. As already mentioned above, MMIS implementations vary; however, there are many similar traits. It would be helpful to have a standard repository of project performance information and a forum for sharing of lessons learned.
• Encourage state/group conferences with the vendor. Encourage states to conduct conferences with the common vendor amongst the states. This will allow states that have similar systems to share best practices and lessons learned in implementing the system.
• If possible, coordinate RFP releases so that they are not all coming out at the same time. Having multiple RFPs out at once reduces competition or dilutes bids. One of the ways that CMS can increase competition is by providing grants to vendors for research and development of new systems and functionality.
• Facilitate a User Group organization that is focused on states with similar issues; states that are embarking on implementing new systems; states that are constructing new systems; and states that have implemented systems. Lessons learned shared from one state to the other will be invaluable. Also, states will be able to share common system components that have generic applicability. Formalize this process since there is already some level of Regional Exchange that exists. This formalization gives it meaning and making it a mandatory process as a part of reporting updates to CMS during the project execution.

Recommendations for Vendors

• Train vendor staff to handle FFP contracts. Project managers may have the knowledge or experience; however, team leads and analysts are often required to face state staff without adequate preparation on how to manage scope.
• For a state to make a good decision, the vendors need to be more open and honest about their staffing and pricing models.
• Vendors should train their staff better prior to engaging with a state. Vendors always have an issue where some of the personnel involved do not know the details of the solution being offered.
• Vendors should be more transparent in their estimation process and willing to share that with the state and CMS during the RFP response.
• Vendors should establish a framework for more state staff quality participation during all the phases of the DDI implementation and not limited to requirements and design phases.
• Communicate openly with the state and with CMS. Don’t become too “bogged down” in competitive posturing to the detriment of the project.