As Quality Maturity evolves based on the FDA’s metrics strategy, it was documented the agency wanted “a maximally efficient, agile, flexible, pharmaceutical manufacturing sector. The goal included high quality drug products, a culture of QA QC, and reduced regulatory oversight. Industry and regulatory agencies continue to make progress in establishing quality metrics for the pharmaceutical industry.
The FDA’s Janet Woodcock stated her agency wanted “a maximally efficient, agile, flexible, pharmaceutical manufacturing sector that reliably produces high quality drug products without extensive regulatory oversight”.
The groundwork to achieve this realization started with the adoption of Title VII, Sections 705 and 706 of the Food and Drug Administration Safety and Innovation Act (FDASIA). It has been over a decade since Dr. Woodcock revealed her vision to establish quality metrics used to determine a manufacturer’s ability to provide quality products to the patient.
So how far have FDA and the industry come in establishing a set of quality metrics applicable to the pharmaceutical industry? The aforementioned sections of FDASIA gave FDA the ability to establish criteria to perform a risk-based FDA inspection of bio/pharmaceutical manufacturers. Further, a certified auditor request certain documents be provided in advance or, in some cases, in lieu of inspections.
Quality Control Metrics
The FDA next published a notice in the Federal Register asking for assistance from industry in developing a strategic plan and quality metrics to prevent drug shortages. FDA’s objective seems to be to reduce companies’ regulatory burden allowing for innovation while protecting the public health.
Quality Metrics in Manufacturing
In response to the Federal Register notice, several manufacturing organizations have made recommendations to the agency on what they perceived as quality metrics. Organizations that independently participated in the development of quality metrics include:
- Parenteral Drug Association (PDA)
- International Society for Pharmaceutical Engineering (ISPE)
- Generic Pharmaceutical Association (GPhA)
- Pharmaceutical Researchers and Manufacturers of America (PhRMA)
- Consumer Healthcare Products Association (CHPA).
These organizations held conferences and wrote white papers to define what specific quality metrics would be appropriate. Representatives from the above organizations, covering all aspects of the pharmaceutical industry, met to try and come to a consensus. Additionally, how quality metrics are used as an indicator to provide high quality medicine to patients.
First Pass Quality
The outcome of the meeting resulted in acceptance rate, product complaint rate, confirmed out-of-specification rate, and recall rate. The proceedings from the meeting clarified that the “consensus set of metrics are somewhat rudimentary, and provide limited information about the culture of quality at a given organization”.
According to the published proceedings, “many [participants] remarked that a strong quality culture is a critical component in driving the system and processes that underpin the quality control and assurance infrastructure at an organization. However, quality culture is also difficult to capture through metrics.”
Supplier Quality Metrics
It was at this point where industry took off in different directions; PDA and ISPE have been the most engaged organizations in subsequent efforts. ISPE designed and asked members to participate in a pilot program for quality metrics, while PDA held a conference on quality metrics that focused on how to define a mature quality culture.
The metrics used in the ISPE Quality Metrics Pilot Program include the consensus metrics from the Brookings meetings as well as others. Some of the unique metrics used by ISPE in their pilot include timeliness of annual product quality reviews, recurring deviations rate, corrective action and preventive action (CAPA) effectiveness rate, process capability, and quality culture.
Quality Assurance Measurements
A PDA quality culture metrics conference that was held focused on metrics in assessing quality assurance. The hypothesis for the meeting was that mature quality attributes have a strong relationship to positive quality culture behaviors. The consensus from the meeting was that measuring a quality culture is subjected and defined by a set of behaviors, beliefs, values, attitudes, and governance and that quality assurance goes beyond traditional quality systems in creating a framework for a strong quality culture.
Training Metrics Scorecard
PDA divided quality systems into three types:
PDA defined traditional quality systems by traditional metrics including deviations, complaints, CAPA, etc. Enhanced quality systems were defined as those that had advanced programs such as risk management, knowledge management, quality by design, quality manual, etc. The other quality systems were much more evolved and have programs like shared quality goals, rewards and recognition programs, and cost of quality awareness programs, etc.
Types of Quality Metrics
Conference attendees defined the top five mature quality attributes as the following:
- Program to show how employee’s specific goals contribute to overall quality goals
- Program to measure, share, and discuss product quality performance and improvement from shop floor to executive management
- Continuous improvement program/plans with active support of CEO and corporate management of quality management systems (QMS)
- Program that establishes quality system maturity model and action plan and tracking to measure progress
- Internal survey measuring a company/site quality culture.
FDA Quality Metrics
Meanwhile, FDA presented the following metrics for measuring a quality system:
- Lot acceptance rate (the number of lots rejected by the establishment in a year divided by the number of lots attempted by the same establishment in the same year)
- Right-first-time rate (the number of lots with at least one deviation by the establishment in a year divided by the number of lots attempted by the same establishment in the same year)
- Product quality complaint rate (the number of complaints received by the manufacturer of the product concerning any actual or potential failure of a unit of drug product to meet any of its specifications, divided by the total number of lots released by the manufacturer of the product in the same year)
- Invalidated out-of-specification (OOS) rate (the number of OOS test results invalidated by the establishment, or contracted establishment in a year divided by the total number of tests performed by the establishment in the same year).
Future of Quality Metrics
So what is the future of quality metrics? The most important part of the puzzle is important to keep in mind that there are no perfect answers and collaboration is imperative. The concept of unintended consequences needs to be addressed so everyone is on a level playing field. Data trending can be more valuable in determining the robustness of a quality system than direct comparisons. Finally, an open and honest quality culture will drive the data integrity of quality metrics.
Vol. 28, No. 5
About RCA’s Pharmaceutical Services
Regulatory Compliance Associates (RCA)® has helped thousands of pharmaceutical companies meet regulatory, compliance, quality assurance, and remediation challenges. With more than 20 years of experience with FDA, Health Canada, EU and global regulatory agencies worldwide, RCA offers leading pharmaceutical consultants that can help you navigate through the challenges associated with evolving industry regulations.
Our team of over 500 seasoned FDA, Health Canada and EU compliance consultants and regulatory affairs experts can understand the complexities surrounding the pharmaceutical industry and the unique inner workings of the regulatory process.
Whether you’re in the product planning, development or pharmaceutical lifecycle management stage or need a remediation strategy for a compliance crisis, RCA® Inc. will guide you through every step of the regulatory process and create a customized approach depending on your product and your pharma company’s individual needs. Our clients include:
- Companies new to FDA, Health Canada or EU regulations and the pharmaceutical industry
- Start-up organizations with novel submissions to 510(k) submissions from multi-national corporations
- Investment firms seeking private equity due diligence for pre-acquisition and post-deal research
- Law firms seeking expertise in the remediation of warning letters, consent decrees, 483’s or import bans
Regulatory affairs is Regulatory Compliance Associates® Inc.’s backbone and we fully understand the complexities of the pharmaceutical and biopharmaceutical industries. Our expertise spans all facets and levels of Regulatory Affairs, from Regulatory Support for New Products to Life Cycle Management, to other services like Outsourced Regulatory Affairs, Submissions, Training, and more.
As your partner, we can negotiate the potential assessment minefield of pharmaceuticals with insight, hindsight, and the clear advantage of our breadth and depth of knowledge and experience. We offer the following four regulatory affairs services for pharmaceutical companies.
- New Product Support
- Product Lifecycle
- Other Regulatory Services
The regulations process surrounding pharmaceutical companies can be tricky for even the most experienced industry veteran to understand, and just one misstep could mean significant and lasting consequences for your business. At RCA® Inc., we offer the experience and resources necessary to guide you in quality compliance.
- Regulatory Agency Response
- Preparation and Training
- Inspection Readiness
Regulatory Compliance Associates® Inc.’s Quality Assurance services include assessments, strategy, implementations, staff augmentations, and identification of quality metrics to ensure continuous improvement, aligning with your business needs and goals. Our consultants are quality experts with experience spanning major corporations and start-ups. We know firsthand how to achieve, maintain, and improve quality, and we excel in transferring this knowledge to your organization.
- 21 CFR Part 11
- Data Integrity
- Manufacturing Support
- Facility Support
Regulatory Compliance Associates® Inc. has significant experience and a proven approach to managing FDA Warning Letters, Consent Decrees, Remediation and other serious regulatory situations. We know how to partner with executive, legal, and communication teams, and will assist management with a response that will be accepted by the regulatory agency and be realistic to execute.
We can develop a comprehensive proof book of documented objective evidence demonstrating the corrective actions taken to remediate non-compliant issues. In addition, RCA can help prepare a comprehensive strategy to assist in your remediation efforts, drive continuous improvement, and maintain compliance with the regulations.
- Regulatory Action
- Warning Letter
- 483 Observation
- Oversight Services
Regulatory Compliance Associates® (RCA) provides healthcare consulting services to the following industries for resolution of compliance and regulatory challenges:
We understand the complexities of running a life science business and possess areas of expertise that include every facet of R&D, operations, regulatory affairs, quality, and manufacturing. We are used to working on the front lines and thriving in the scrutiny of FDA and globally-regulated companies.
As your partners, we can negotiate the potential minefield of regulatory compliance and regulatory due diligence with insight, hindsight, and the clear advantage of our unique expertise and experience.
- Founded in 2000
- Headquartered in Wisconsin (USA)
- Expertise backed by over 500 industry subject matter experts
- Acquired by Sotera Health in 2021
To begin the RCA® scoping process today, please enter your information in the blue form below and click the submit button at the bottom of the webpage.