WHO: Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) Checklist

World Health Organization REGIONAL OFFICE FOR Africa Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) Checklist Version 2:2015 For Clinical and Public Health Laboratories 1.0 INTRODUCTION Medical laboratories have always played an essential role in determining clinical decisions and providing clinicians with information that assists in the prevention, diagnosis, treatment, and management of diseases in the developed world. Presently, the laboratory infrastructure and test quality for all types of clinical laboratories remain in nascent stages in most countries of Africa. Consequently, there is an urgent need to strengthen laboratory systems and services. The establishment of a process by which laboratories can achieve accreditation to international standards is an invaluable tool for countries to improve the quality of laboratory services. In accordance with WHO core functions of setting standards and building institutional capacity, WHO/AFRO, in collaboration with the African Society for Laboratory Medicine (ASLM), U.S. Centers for Disease Control and Prevention (CDC) and host countries established the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) to strengthen the laboratory systems of its Member States. SLIPTA is a framework for improving quality of public health laboratories in developing countries to achieve the requirements of the ISO 15189 standard. It is a process that enables laboratories to develop and document their ability to detect, identify, and promptly report all diseases of public health significance that may be present in clinical specimens. This initiative was spearheaded by a number of critical resolutions, including Resolution AFR/RC58/R2 on Public Health Laboratory Strengthening, adopted by the Member States during the 58th session of the Regional Committee in September 2008 in Yaoundé, HILS1748 Page 1 of 48 Effective Date: 6/13/2017 Cameroon, and the Maputo Declaration to strengthen laboratory systems. This quality improvement process towards accreditation further provides a learning opportunity and pathway for continuous improvement, a mechanism for identifying resource and training needs, a measure of progress, and a link to the WHO/AFRO National Health Laboratory Service Networks. Clinical, public health, and reference laboratories participating in the SLIPTA are reviewed bi-annually. Recognition is given for the upcoming calendar year based on progress towards meeting requirements set by international standards and on laboratory performance during the 12 months preceding the SLIPTA audit, relying on complete and accurate data, usually from the past 1-13 months to 1 month prior to evaluation. This quality improvement process towards accreditation further provides a learning opportunity and pathway for continuous improvement, a mechanism for identifying resource and training needs, a measure of progress, and a link to the WHO/AFRO National Health Laboratory Service Networks. The current checklist was updated through a technical expert review process to align it with the ISO 15189:2012 version of the standard. 2.0 Scope This checklist specifies requirements for quality and competency aimed to develop and improve laboratory services to raise quality to established national standards. The elements of this checklist are based on ISO standard 15189:2012 (E) and, to a lesser extent, CLSI guideline QMS01-A4; Quality Management System: A Model for Laboratory Services; Approved Guideline – Fourth Edition. Recognition is provided using a five star tiered approach, based on a bi-annual on-site audit of laboratory operating procedures, practices, and performance. The audit checklist score will correspond to the number of stars awarded to a laboratory in the following manner: No Stars 1 Star 2 Stars 3 Stars 4 Stars 5 Stars (0 – 150 pts) (151 – 177 pts) (178 – 205 pts) (206 – 232 pts) (233 – 260 pts) (261 – 275 pts) < 55% 55 – 64% 65 – 74% 75 – 84% 85 – 94% ≥95%  3.0 Parts of the Audit This laboratory audit checklist consists of three parts: Part I: Laboratory Profile Part II: Laboratory Audits Evaluation of laboratory operating procedures, practices, and tables for reporting performance Part III: Summary of Audit Findings Summary of findings of the SLIPTA audit and action planning worksheet HILS1748 Page 2 of 48 Effective Date: 6/13/2017 PART I: LABORATORY PROFILE Date of Audit: Date of Last Audit: Prior Audit Status Not Audited 0 Stars 1 Star 2 Stars 3 Stars 4 Stars 5 Stars Name(s) and Affiliation(s) of Auditor(s) Laboratory Name: Laboratory Number Laboratory Address: Laboratory Telephone: Fax: Email: Head of Laboratory: Telephone (Head of Laboratory): Personal Work Laboratory Level (check only one) Type of Laboratory/Laboratory Affiliation (check only one) National Reference Provincial Public Hospital Private District Zonal Field Research Non-hospital Other – Please specify: Outpatient Clinic 0 0 ______________________ Laboratory Staffing Summary Profession Number of Full Time Adequate for facility operations? Employees Degree-holding Professional Staff Yes No Insufficient Data Diploma-holding Professional Staff Yes No Insufficient Data Certificate-holding Professional Staff Yes No Insufficient Data Data Clerk Yes No Insufficient Data Phlebotomist Yes No Insufficient Data Cleaner Yes No Insufficient Data Is the cleaner(s) dedicated to the laboratory only? Has the cleaner(s) been trained in safe waste handling? Yes No Yes No Driver Yes No Insufficient Data Is the driver(s) dedicated to the laboratory only? Has the driver(s) been trained in biosafety? Yes No Yes No Other Yes No Insufficient Data If the laboratory has IT specialists, accountants or non-laboratory-trained management staff, this should be indicated in the description of the organizational structure on the following page. HILS1748 Page 3 of 48 Effective Date: 6/13/2017 PART II: LABORATORY AUDITS Laboratory audits are an effective means to 1) determine if a laboratory is providing accurate and reliable results; 2) determine if the laboratory is well-managed and is adhering to good laboratory practices; and 3) identify areas for improvement. Auditors complete this audit using the methods below to evaluate laboratory operations per checklist items and to document findings in detail.  Review laboratory documents to verify that the laboratory quality manual, policies, Standard Operating Procedures (SOPs) and other manuals (e.g., safety manual) are complete, current, accurate, and annually reviewed.  Review Laboratory Records: Equipment maintenance records; audit trails, incident reports, logs, personnel files, IQC records, EQA records  Observe laboratory operations to ensure: o laboratory testing follows written policies and procedures in pre-analytic, analytic and post-analytic phases of laboratory testing; o laboratory procedures are appropriate for the testing performed; o Deficiencies and nonconformities identified are adequately investigated and resolved within the established timeframe.  Ask open-ended questions to clarify documentation seen and observations made. Ask questions like, “show me how…” or “tell me about…” It is often not necessary to ask all the checklist questions verbatim. An experienced auditor can often learn to answer multiple checklist questions through open-ended questions with the laboratory staff.  Follow a specimen through the laboratory from collection through registration, preparation, aliquoting, analysing, result verification, reporting, printing, and post-analytic handling and storing samples to determine the strength of laboratory systems and operations.  Confirm that each result or batch can be traced back to a corresponding internal quality control (IQC) run and that the IQC was passed. Confirm that IQC results are recorded for all IQC runs and reviewed for validation.  Confirm PT results and the results are reviewed and corrective action taken as required.  Evaluate the quality and efficiency of supporting work areas (e.g., phlebotomy, data registration and reception, messengers, drivers, cleaners, IT, ).  Talk to clinicians to learn the users’ perspective on the laboratory’s performance. Clinicians often are a good source of information regarding the quality and efficiency of the laboratory. Notable findings can be documented in the Summary and Recommendations section at the end of the checklist. HILS1748 Page 4 of 48 Effective Date: 6/13/2017 AUDIT SCORING This Stepwise Laboratory Quality Improvement Process Towards Accreditation Checklist contains 12 main sections (a total of 117 questions for a total of 275 points. Each item has been awarded a point value of 2, 3, or 5 points—based upon relative importance and/or complexity. Responses to all questions must be, “yes”, “partial”, or “no”.  Items marked “yes” receive the corresponding point value (2, 3, or 5 points). All elements of a question must be present in order to indicate “yes” for a given item and thus award the corresponding points. NOTE: items that include “tick lists” must receive all “yes” and/or “n/a” responses to be marked “yes” for the overarching item.  Items marked “partial” receive 1 point.  Items marked “no” receive 0 points. When marking “partial” or “no”, notes should be written in the comments field to explain why the laboratory did not fulfil this item to assist the laboratory with addressing these areas of identified need following the audit. Where the checklist question does not apply, indicate as NA. Subtract the sum of the scores of all questions marked NA and subtract that sum of NAs from the total of 275. Since denominator has changed, the star status is then determined using % score. Audit Score Sheet Section Total Points Section 1: Documents & Records 28 Section 2: Management Reviews 14 Section 3: Organization & Personnel 22 Section 4: Client Management & Customer Service 10 Section 5: Equipment 35 Section 6: Evaluation and Audits 15 Section 7: Purchasing & Inventory 24 Section 8: Process Control 32 Section 9: Information Management 21 Section 10: Identification of Non Conformities, Corrective and Preventive Actions 19 Section 11: Occurrence/Incident Management & Process Improvement 12 Section 12: Facilities and Biosafety 43 TOTAL SCORE 275 No Stars 1 Star 2 Stars 3 Stars 4 Stars 5 Stars (0 – 150 pts) (151 – 177 pts) (178 – 205 pts) (206 – 232 pts) (233 – 260 pts) (261 – 275 pts) < 55% 55 – 64% 65 – 74% 75 – 84% 85 – 94% ≥95%  HILS1748 Page 5 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. Section 1 : DOCUMENT AND RECORDS Requirement Y P N Comments Score 1.1 Legal Entity Y P N Does the laboratory have documentation stating 2 its legal identity? ISO15189:2012 Clause 4.1.1.2” The laboratory or the organization of which the laboratory is a part shall be an entity that can be held legally responsible for its activities. Note: Documentation could be in the form of a National Act, Company registration certificate, License number or Practice number. 1.2 Laboratory Quality Manual Is there a current laboratory quality manual, composed of the quality management system’s Y P N policies and has the manual content been 5 communicated to, understood and implemented by all staff? The quality manual includes the following Tick for each item as Yes (Y), No (N) or Partial (P) elements: Y P N a) Quality policy statement that includes scope of service, standard of service, measurable objectives of the quality management system, and management commitment to compliance. b) Documented policies for the quality management system that meet the requirements of ISO15189:2012 (Refer to Question 1.5 of this checklist for list of policies required) c) Description of the quality management system and the structure of its documentation d) Reference to supporting procedures (SOPs), including managerial and technical procedures e) Description of the roles and responsibilities of the laboratory director, or laboratory manager, quality manager, and other key personnel (laboratory to define its key personnel) responsible for ensuring compliance f) Records of review and approval of the quality manual by authorized personnel g) Records to show that the quality manual was communicated to and understood by the lab personnel ISO15189:2012 Clause 4.1.2.3 and 4.2.2.2 and 4.3 Note: A quality manual must be available that summarizes the laboratory’s quality management system, which includes policies that address all areas of the laboratory service, and identifies the goals and objectives of the quality management system. The quality manual must include policies and make reference to processes and procedures for all areas of the laboratory service and must address all the clauses of ISO15189:2012. 1.3 Document and Information Control System Does the laboratory have a system in place to 2 control all documents and information from Y P N internal and external sources? ISO15189:2012 Clause 4.3 Note: There must be a procedure on document control. A document control system must be in place to ensure that records and all documents (internal and external) are current, read and understood by personnel, approved by authorized persons, reviewed periodically and revised as required. Documents must be uniquely identified to include title, page numbers, and authority of issue, document number, versions, effective date, and author. Example of external documents includes regulations, standards, guidelines, equipment user manuals, package inserts, text books. HILS1748 Page 6 of 48 Effective Date: 6/13/2017 1.4 Document and Records 2 Is there a list that details all documents used in Y P N the quality management system indicating their editions and distribution? ISO15189:2012 Clause 4.3 Note: Documents to be included on the list include Manuals, Procedures, and Processes. Work instructions. Forms, external documents.. The list could be in the form of a document master index, document log or document register. “Edition” can be regarded as synonymous with “revision or version” number for the documents. 1.5 Laboratory Policies and Standard Operating 5 Procedures Y P N Are policies and/or standard operating procedures (SOPs) for laboratory functions, technical and managerial procedures current, available and approved by authorized personnel? ISO15189:2012 Clause 4.3 and 5.5 Note: The laboratory must define who is authorized to approve documents for its intended use. The approver should not be the author but can be the reviewer. Has the laboratory defined Policies and/or SOPs that Tick for each item as addresses the following: Yes (Y), Partial (P) or No (N) Ethical Conduct How the laboratory will: 1) minimize activities that Y P N would diminish confidence in the laboratory's competence, impartiality, and judgment; 2) perform work within relevant legal requirements; 3) ensure confidentiality; 4) handle human samples, tissues or their remains as per regulations; 5) identify and avoid potential conflicts of interest and commercial, financial, political or other pressures that may affect the quality and integrity of operations? ISO15189:2012 Clause 4.1.1.3 Note: Laboratories shall uphold the principle that the welfare and interest of the patient are paramount and patients should be treated fairly and without discrimination Document Control How the laboratory will: 1) control all internal and Y P N external documents; 2) create documents; 3) identify documents; 4) review documents; 5) approve documents; 6) capture current versions and their distribution by means of a list; 7) handle amendments; 8) identify changes; 9) handle obsolete documents; 10) retain documents; 11) prevent the unintended use of any obsolete document; 12) ensure safe disposal of documents? ISO15189:2012 Clause 4.3 and 4.13 Note: Documents that should be considered for document control are those that may vary based on changes in versions or time. Examples include policy statements, instructions for use, flow charts, procedures, specifications, forms, calibration tables, biological reference intervals and their origins, charts, posters, notices, memoranda, software documentation, drawings, plans, agreements, and documents of external origin such as regulations, standards and text books from which examination procedures are taken. Control of Records How the laboratory will: 1) identify; 2) collect; 3) index; 4) access; 5) store; 6) maintain; 7) amends; 8) Y P N dispose of safely; 9) define the retention period for the identified records? ISO15189 :2012 Clause 4.13 Note: Records can be in any form or type of medium providing they are readily accessible and protected from unauthorized alterations. Legal liability concerns regarding certain types of procedures (e.g. histology examinations, genetic examinations, pediatric examinations) may require the retention of certain records for much longer periods than for other records. For some records, especially those stored electronically, the safest storage may be on secure media and an offsite location. Type of records will include but not be limited to quality records, technical records, personnel records, test request and results records, HILS1748 Page 7 of 48 Effective Date: 6/13/2017 Communication (internal and external) How the laboratory will: 1) ensure effective communication with staff and users of the laboratory; Y P N 2) handle staff suggestions for improvement; 3) communicate with stakeholders on the effectiveness of the quality management system across all processes; 4) capture records of all communications; 5) retain and maintain all records of communication, requests, inquiries, verbal discussions and requests for additional examinations, meeting agendas, and meeting minutes)? ISO15189:2012 Clause 4.1.2.6 and 4.14 Note: Laboratory management must ensure that appropriate communication processes are established between the laboratory and its stakeholders and that communication takes place regarding the effectiveness of the laboratory’s pre-examination, examination and post-examination processes and quality management system. Service Agreements How the laboratory will: 1) establish service Y P N agreements; 2) review service agreements; 3) handle walk in patients (if applicable); 4) inform customers and users of any changes that affect the results of the requisition stated on the service agreement; 5) communicate to the requester of any work that has been referred; 6) retain records of communication? ISO15189:2012 Clause 4.4.1 and 5.4 Notes: By accepting a requisition form from an authorized requester, the laboratory is considered to have entered into a service agreement. Customers and users may include clinicians, health care organizations, third party payment organizations or agencies, pharmaceutical companies, and patients. Examination by Referral Laboratories and Consultants How the laboratory will: 1) select referral laboratories NA Y P N and consultants who provide opinions as well as interpretations; 2) evaluate and monitor the performance of referral laboratories and consultants who provide opinions as well as interpretations; 3) maintain a list of approved referral laboratories and consultants; 4) maintain a records of referred samples; 5) tracking of referred samples and their results; 6) report results from referral labs; 7) package and transport referred samples; 8) record communication of results from referral laboratories and consultants? ISO15189:2012 Clause 4.5 and 5.8 and 4.13 Note: The laboratory must have a documented procedure for selecting and evaluating referral laboratories and consultants who provide opinions as well as interpretation for complex testing in any discipline. External Services and Suppliers How the laboratory will: 1) select external purchases and services; 2) establish its selection criteria, Y P N including acceptance and rejection criteria; 3) approve and maintain its approved suppliers list; 4) define the requirements of its purchase supplies and services; 5) review and monitor the performance of its approved suppliers; 6) establish frequency of reviews? ISO15189:2012 Clause 4.6 and 5.3 Note: The laboratory must have a documented procedure for the selection and purchasing of external services, equipment, reagents and consumable supplies that affect the quality of its service. Purchasing and Inventory Control How the laboratory will: 1) request, order and receive supplies; 2) establish acceptance/rejection criteria for Y P N purchased items; 3) store purchased supplies; 4) control their inventory; 5) monitor and handle expired consumables? HILS1748 Page 8 of 48 Effective Date: 6/13/2017 ISO15189 :2012 Clause 4.6 and 5.3.2 Note: The laboratory shall have a documented procedure for the reception, storage, acceptance testing and inventory management of reagents and consumables. Advisory Services How the laboratory will: 1) advise on the choice of examinations it offers; 2) communicate its advisory Y P N services to its users; 3) advise on clinical indications and limitations of examination procedures; 4) advise on the frequency of examination; 5 ) provide individual clinical case advice; 6) advise on interpretation of results; 7) promote the effective utilization of laboratory services; 8) provide consultation on scientific and logistic matters; 9) advise on the required type of sample and volume for testing? ISO15189:2012 Clause 4.7 Note: The laboratory must have a system in place for providing advise to its users. Resolution of Complaints and Feedback How the laboratory will: 1) manage complaints received from clinicians, patients, laboratory staff or Y P N other parties; 2) collect, receive and handle feedback received from clinicians, patients, laboratory staff or other parties; 3) keep records of all complaints, the investigations and actions taken, 4) determine the timeframe for closure and feedback to the complainant; 5) monitor effectiveness of corrective and preventative actions taken on complaints and feedback? ISO15189:2012 Clause 4.8 and 4.10 Note: The laboratory must have a documented procedure for the management of complaints or other feedback received from clinicians, patients, laboratory staff or other parties. Records shall be maintained of all complaints and their investigation and the action taken Identification and Control of Nonconformities (NC) How the laboratory will: 1) identify types of nonconformities in any aspect of the quality Y P N management system from pre, analytic and post analytic; 2) record NCs (how and where); 3) assign who is responsible for resolving the NC; 4) determine time frame for resolving NCs; 5) halt examinations (by an authorized person); 6) ensure the recall of released results of nonconforming or potentially nonconforming examinations; 7) release results after corrective action has been taken? ISO15189:2012 Clause 4.9 Note: Nonconforming examinations or activities occur in many different areas and can be identified in many different ways, including clinician complaints, internal quality control indications, and instrument calibrations, checking of consumable materials, inter-laboratory comparisons, staff comments, reporting and certificate checking, laboratory management reviews, and internal and external audits. Corrective Action (CA) How the laboratory will: 1) determine the root cause; 2) evaluate the need for CA to ensure that NCs do not Y P N recur; 3) assign the person responsible for the CA; 4) determine and implement CA(including person responsible and timeframe); 4) record CA taken; 4) monitor and review the effectiveness of the CA taken? ISO15189:2012 Clause 4.10 Note: Action taken at the time of the nonconformity to mitigate effects is considered “immediate” action. Only action taken to remove the root cause of the problem that is causing the Non Conformities is considered “corrective” action. Any immediate action taken must also be documented. Corrective actions must be appropriate to the effects of the nonconformities encountered. Preventive Action (PA) How the laboratory will: 1) review laboratory data and information to determine potential nonconformities; 2) Y P N determine the root cause(s) of potential non HILS1748 Page 9 of 48 Effective Date: 6/13/2017 conformities; 3) evaluate the need for preventive action; 4) record the PA; 5) determine and implement PA (including person responsible and timeframe); 6) monitor and review the effectiveness of implementation of PA? ISO15189 :2012 Clause 4.11 Note: Preventive action is a proactive process for identifying opportunities for improvement rather than a reaction to the identification of problems or complaints (i.e. nonconformities). In addition to review of the operational procedures, preventive action might involve analysis of data, including trend and risk analyses and external quality assessment (proficiency testing). The laboratory shall determine action to eliminate the causes of potential nonconformities in order to prevent their occurrence. Preventive actions shall be appropriate to the effects of the potential problems. Continual Improvement How the laboratory will: 1) identify improvement Y P N activities within the Quality Management System; 2) develop improvement plans; 3) record improvement plans; 4) implement action plans; 5) communicate improvement plans and related goals to staff? ISO15189:2012 Clause 4.1.2.6; 4.12; 4.14 Note: Improvement activities must be identified within the pre-examination, examination and post-examination processes. Laboratory management shall ensure that the laboratory participates in continual improvement activities that encompass relevant areas and outcomes of patient care. Control of Records How the laboratory will: 1) identify; 2) collect; 3) index; 4) access; 5) store; 6) maintain; 7) amend; 8) Y P N dispose of safely; 9) define the retention period for the identified records? ISO15189 :2012 Clause 4.13 Note: Records can be in any form or type of medium providing they are readily accessible and protected from unauthorized alterations. .Legal liability concerns regarding certain types of procedures (e.g. histology examinations, genetic examinations, pediatric examinations) may require the retention of certain records for much longer periods than for other records. For some records, especially those stored electronically, the safest storage may be on secure media and an offsite location. Type of records will include but not be limited to quality records, technical records, personnel records, test request and results records, Internal Audits How the laboratory will: 1) determine an audit schedule; 2) determine the roles and responsibilities for Y P N planning and conducting audits; 3) select the auditors; 4) define the types of audits; 4) define the frequency of audits; 5) define the scope of the internal audit; 6) record audit findings (forms and reports); 7) ensure corrective action is taken for all nonconformities identified with in the allocated time frame; 8) closure of Non Conformities identified during audits? ISO15189:2012 Clause 4.14.5 Note: The cycle for internal auditing should normally be completed in one year. It is not necessary that internal audits cover each year, in depth, all elements of the quality management system. The laboratory may decide to focus on a particular activity without completely neglecting the others. The laboratory shall conduct internal audits at planned intervals to determine whether all activities in the quality management system, including pre-examination, examination, and post- examination. Risk Management How the laboratory will: 1) evaluate the impact of potential pitfalls on work processes and examination Y P N results that affect patient results? (Refer to Question 6.3 of this checklist) ISO15189:2012 Clause 4.14.6 Notes: Risk must be managed at the pre-examination processes, examination processes and post examination processes. The laboratory shall evaluate the impact of work processes and potential failures on examination results as they affect patient safety, and shall modify processes to reduce or eliminate the identified risks and document decisions and actions taken. Management Review How the laboratory will: 1) define frequency of having management reviews; 2) define the agenda (input); 3) Y P N determine the key attendees; 4) record decisions and actions to be taken (output); 5) assign a person responsible and due dates for actions arising; 6) communicate decisions and actions to be taken to the HILS1748 Page 10 of 48 Effective Date: 6/13/2017 relevant persons including laboratory staff; 7) ensure all actions arising are completed within the defined timeframe? (refer to Question 2.2 of this checklist for the agenda of the meeting) ISO15189:2012 Clause 4.15 Note: Laboratory management shall review the quality management system at planned intervals to ensure its continuing suitability, adequacy and effectiveness and support of patient care. Personnel Management How the laboratory will: 1) define the structure of the organization (organizational plan); 2) manage Y P N personnel (personnel policies); 3) maintain personnel records? (refer to Question 3.5 of the checklist for list of personnel records required) ISO15189:2012 Clause 5.1.1; 5.1.9; 4.13 Note: The laboratory must have a documented procedure for personnel management and maintain records for all personnel to indicate compliance with requirements. Personnel Training How the laboratory will: 1) perform staff orientation; 2) conduct initial and refresher training; 3) provide a Y P N continuous education program; 4) identify required training relevant to job title and responsibilities; 5) keep record of training; 6) evaluate the effectiveness of training? ISO15189:2012 Clause 4.1.1.4 and 5.1.5 Note: Training includes external and internal trainings. The effectiveness of the training programme must be periodically reviewed. Competency Assessment How the laboratory will: 1) assess the competence of personnel to perform assigned managerial or technical Y P N tasks; 2) assess ongoing competency; 3) establish competency criteria; 4) provide feedback to persons assessed; 5) schedule retraining based on the assessment outcome; 6) keep records of competency assessments and outcomes? ISO15189 :2012 Clause 4.1.1.4 and 4.4 and 5.1.6 Note: Competency could be assessed using a combination of some or all of the following methods: direct observation; monitoring and the recording of examination results; review of work records; problem solving skills; blinded samples, review of accumulative IQC and EQA. Competency assessment for professional judgment should be designed as specific and fit for purpose. Authorization How the laboratory will: 1) document authorization levels for the different tasks and roles; 2) appoint Y P N deputies for the key positions where appropriate? ISO15189:2012 Clause 4.1.2 Note: Authorization may be in the form of a Job description, letter of appointment, approved authority matrix etc. Review of Staff Performance How the laboratory will: 1) plan and perform staff appraisals; 2) establish frequency of monitoring and Y P N review of staff performance outcome; 3) keep records of staff performance; 4) train staff who perform staff appraisals? ISO15189:2012 Clause 4.1.2.1 and 5.1.7 Note: In addition to the assessment of technical competence, the laboratory management must ensure that reviews of staff performance consider the needs of the laboratory and of the individual in order to maintain or improve the quality of service given to the users and encourage productive working relationships. Staff performing reviews should receive appropriate training. Accommodation and Environmental Conditions How the laboratory will: 1) evaluate and determine the sufficiency and adequacy of the space allocated for the Y P N performance of and scope of work; 2) ensure the laboratory and office facilities are suitable for the tasks HILS1748 Page 11 of 48 Effective Date: 6/13/2017 to be undertaken; 3) ensure the storage and disposal facilities meet the applicable requirements; 4) ensure staff have space for staff activities (supply of drinking water, storage space for personal and protective equipment and clothing); 5) monitor, control and record any specific environmental and accommodation requirements? ISO15189:2012 Clause 4.1.1.4 and 5.2; 5.2.6 Note: The laboratory must have space allocated for the performance of its work that is designed to ensure the quality, safety and efficacy of the service provided to the users and the health and safety of laboratory personnel, patients and visitors. The laboratory shall evaluate and determine the sufficiency and adequacy of the space allocated for the performance of the work. Evaluating and determining the sufficiency and adequacy of space may be done during internal audits, risk assessments or at management review meeting, however it must be documented that it was evaluated and found to be adequate. Laboratory equipment How the laboratory will: 1) select equipment; 2) purchase equipment; 3) manage equipment; 4) Y P N maintain equipment records 5) capture the minimum information on equipment label; 6) manage defective equipment; 7) define the equipment maintenance frequency; 8) record the maintenance ; 9) prevent unauthorized use (access control) of equipment; 10) manage obsolete equipment; 11) manage safe handling, transportation, storage and use to avoid deterioration and contamination, 12) track and verify completion of repairs? ISO15189:2012 Clause 4.13; 5.3.1 NOTE: For the purposes of this checklist, laboratory equipment includes hardware and software of instruments, measuring systems, and laboratory information systems. The laboratory shall have a documented procedure for the selection, purchasing and management of equipment. Calibration of Equipment How the laboratory will: 1) define frequency of calibration; 2) handle in house calibrations (pipettes, Y P N thermometers, timers etc.); 3) record calibration status (use of stickers and calibration certificates); 4) handle failed calibrations? ISO15189:2012 Clause 5.3.1.4 Notes: The laboratory must have a documented procedure for the calibration of equipment that directly or indirectly affects examination results. Documentation of calibration traceability to a higher order reference material or reference procedure may be provided by an examination system manufacturer. Such documentation is acceptable as long as the manufacturer's examination system and calibration procedures are used without modification. Pre-examination Processes How the laboratory will provide information for patients and users on: 1) primary sample collection and Y P N handling; 2) instructions for pre-collection activities; 3) instructions for collection activities; 4) preparation and storage prior to dispatch to the laboratory; 5) sample and volume requirements; 6) Sample transportation; 7) time limits and special handling; 8) acceptance and rejection criteria; 9) confidentiality; 10) complaints procedure? ISO15189:2012 Clause 5.4; 5.4.1; 5.4.3; 5.4.4.1; 5.4.5; 5.4.6; 5.4.7 Note: The laboratory must have documented procedures and information for pre-examination activities to ensure the validity of the results of examinations. Validation and Verification of examination procedures / Equipment How the laboratory will: 1) select testing procedures; Y P N 2) perform equipment validation; 3) perform method validation; 4) perform equipment verification; 5) perform method verification; 6) define validation /verification protocol specific for each procedure at the time of validation or verification; 7) compare results from the different procedures, equipment, methods HILS1748 Page 12 of 48 Effective Date: 6/13/2017 being used for the same test either located at the same site or at different sites? ISO15189:2012 Clause 5.5.1.2; 5.6.4 and 5.5.1.3 Note: Validations should be done on a) non-standard methods; b) laboratory designed or developed methods; c) standard methods used outside their intended scope; d) validated methods subsequently modified. "Verification” is performed on methods that are being used without any modifications and is a process of evaluating of whether or not the procedure meets the performance characteristics stated by the manufacturer i.e. the manufacturer validation claims. The performance characteristics are obtained from the manufacture (validation reports) or from package inserts. Comparison of different methods used for same tests is ongoing verification. The frequency and characteristics to be checked in ongoing verification must be clearly defined. Note: All procedures or equipment used as backup must also be validated/verified as relevant. Measurement Uncertainty How the laboratory will: 1) determine Measurement of NA Y P N uncertainty on measured quantity values (quantitative tests); 2) define the performance requirements for the measurement uncertainty (e.g Standard Deviation; Clinical decision points)? Refer to Question 5.4 on this checklist ISO15189:2012 Clause 5.5.1.4 Note: Uncertainty of measurement is used to indicate the confidence we have that the reported figure is correct. Uncertainty of measurement may be calculated using the calculated CV of at least 30 sets of internal QC data: CV% x 2 = Uncertainty of measurement (UM). The laboratory shall calculate the UM for all quantitative tests. These shall only be reported to clinicians if they request for them. For well-established methods, it is recommended a minimum of six months internal QC data should be used to calculate UM, updated at least annually where possible. For new methods at least 30 data points for each level of QC across at least two different batches of calibrator and reagents should be used to provide an interim estimate of uncertainty of measurement. Biological Reference Intervals or Clinical Decision Values Y P N How the laboratory will: 1) define the biological reference intervals; 2) document the source of the reference intervals; 3) communicate changes to the users? ISO15189:2012 Clause 5.5.2 Note: The laboratory shall define the biological reference intervals or clinical decision values, document the basis for the reference intervals or decision values and communicate this information to users. Documentation of examination procedures How the laboratory will: 1) format general and technical Standard Operating Procedures; 2) define the Y P N minimum requirements for a SOP? ISO15189:2012 Clause 5.5.3; Note: Working instructions, card files or similar systems that summarize key information are acceptable for use as a quick reference at the workbench, provided that a fully documented procedure is available for reference. Information from product instructions for use may be incorporated into examination procedures by reference in the SOP. The minimum requirements for a technical SOP should be a) purpose of the examination; b) principle and method of the procedure used for examinations; c) type of sample; d) required equipment and reagents; e) environmental and safety controls; f) procedural steps; g) interferences (e.g. lipemia, hemolysis, bilirubinemia, drugs) and cross reactions; h) principle of procedure for calculating results; i) laboratory clinical interpretation; j) potential sources of variation; k) references. Laboratory Contingency Plan How the laboratory will ensure that there are no interruption to services in the event of: 1) staff Y P N shortage; 2) equipment breakdown; 3) prolonged power outages; 4) stock outs of reagents and consumables; 5) fire, natural disasters e.g. severe weather or floods, bomb threat or civil disturbances; 6) LIS failure? ISO15189:2012 Clause 4.1.1.4; 5.2; 5.3.1; 5.10 Notes: the laboratory should maintain sufficient replacement parts to minimize testing downtime (e.g. pipette components, microscope bulbs and fuses, safety caps or buckets for safety centrifuge). Contingency plans should be periodically tested. Where the laboratory uses another laboratory as a backup, the performance of the back-up laboratory shall be regularly reviewed to ensure quality results Quality Control and Quality Assurance How the laboratory will: 1) use IQC and EQA (Inter- laboratory comparison); 2) define the frequency of Y P N processing IQC; 3) define the acceptable ranges; 4) Evaluate and monitor laboratory performance using EQA and QC data; 5) troubleshoot unacceptable EQA HILS1748 Page 13 of 48 Effective Date: 6/13/2017 and QC; 6) compare results using different procedures, equipment and sites; 7) notify users of any differences in comparability of results? ISO15189:2012 Clause 4.10; 5.6; 5.6.2.1; 5.6.2.2; 5.6.2.3; 5.6.3.1 Note: The laboratory should choose concentrations of control materials, wherever possible, especially at or near clinical decision values, which ensure the validity of decisions made. Use of independent third party control materials should be considered, either instead of, or in addition to, any control materials supplied by the reagent or instrument manufacturer. EQA should cover the pre-examination process, examination process and post examination process. Where an EQA program is not available, the laboratory can use alternative methods with clearly defined acceptable results e.g. exchange of samples with other labs, testing certified materials, sample previously tested. All procedures or equipment used as backup must also be included in EQA programme. Reporting and Release of Results How the laboratory will : 1) issue standardized report (define the format and medium) ; 2) review patient Y P N results; 3) communicate patient results including alert, urgent and critical results; 4) ensure release of results to authorized persons; 5) amend reports; 6) issue of amended reports; 7) store patient results; 8) maintain patient results. (Refer to Question 9.3 of this checklist) ISO15189:2012 Clause 5.8; 5.9 Note: Reports may be issued as a hard copy or electronically, all results issued verbally must be followed by a final report. The results of each examination must be reported accurately, clearly, unambiguously and in accordance with any specific instructions in the examination procedures. The laboratory must define the format and medium of the report (i.e. electronic or paper) and the manner in which it is to be communicated from the laboratory. Laboratory Information System (LIS) (Computerized or non-computerized) How the laboratory will : 1) select a LIS; 2) verify Y P N /validate the LIS; 3) define authorities and responsibilities for the management and use of the information system; 4) ensure patient confidentiality is maintained at all times; 5) maintain the system; 6) back-up data; 7) safeguard against tampering by un- authorized users? ISO15189:2012 Clause 5.10 Note: “information systems” includes the management of data and information contained in both computer and non-computerized systems. Some of the requirements may be more applicable to computer systems than to non-computerized systems. Computerized systems can include those integral to the functioning of laboratory equipment and stand-alone systems using generic software, such as word processing, spreadsheet and database applications that generate, collate, report and archive patient information and reports. Laboratory Safety Manual How the laboratory will: 1) ensure all safety measures are implemented at the laboratory as applicable to Y P N national and international guidelines and regulations? (Refer to section 12.9 of this checklist for the contents of a safety manual) ISO15190:2013 Clause 4.1.1.4; 5.2 Note: Laboratory management must implement a safe laboratory environment in compliance with good practice and applicable requirements. 1.6 Policy and SOPs Accessibility Are policies and SOPs easily accessible/available to all 2 Y P N staff and written in a language commonly understood by respective staff? ISO15189:2012 Clause 4.2.2.1; 4.3; 5.5 Note: All documentation must be current and approved by an authorized person. The documentation can be in any form or type of medium, providing it is readily accessible and protected from unauthorized changes and undue deterioration 1.7 Policies and SOPs Communication Is there documented evidence that all relevant policies 2 and SOPs have been communicated to and are Y P N understood and implemented by all staff as related to their responsibilities? ISO15189:2012 Clause 4.2.2.2; 5.1.5(b) Note: The lab must have a system in place to ensure all staff are aware of the contents of all documents. All laboratory staff shall have access to and be instructed on the use and application of the quality manual and the referenced documents. 1.8 Document Control Log Are policies and procedures dated to reflect when it 2 HILS1748 Page 14 of 48 Effective Date: 6/13/2017 was put into effect, its location, when it was reviewed Y P N and when it was discontinued? ISO15189:2012 Clause 4.3 Note: Current authorized editions and their distribution are identified by means of a list (e.g. document register, log or master index). 1.9 Discontinued Policies and SOPs Are invalid or discontinued policies and procedures 2 clearly marked / identified and removed from use and Y P N one copy retained for reference purposes? ISO15189:2012 Clause 4.3 Note: Obsolete controlled documents are dated and marked as obsolete. At least one copy of an obsolete controlled document is retained for a specified time period or in accordance with applicable specified requirements. 1.10 Data Files Are test results, technical and quality records, invalid 2 or discontinued policies and procedures archived for a Y P N specified time period in accordance with national/international guidelines? ISO15189:2012 Clause 4.3; 4.13 Note: Copies or files of results should be archived. The retention period may vary; however, the reported results shall be retrievable for as long as medically relevant or as required by national, regional or local authorities. 1.11 Archived Results Accessibility Is there an archiving system that allows for easy and 2 timely retrieval of archived records and results? Y P N ISO15189:2012 Clause 4.13 Note: Records can be in any form or type of medium providing they are readily accessible and protected from unauthorized alterations. Archived patient results must be easily, readily and completely retrievable within a timeframe consistent with patient care needs. Section 1: Document and Records Subtotal 28 HILS1748 Page 15 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 2: MANAGEMENT REVIEW AND MANAGEMENT RESPONSIBILITIES Requirement Comments Score 2.1 Routine Review of Quality and Technical 5 Records Y P N Does the laboratory routinely perform a documented review of all quality and technical records? Does the laboratory review include the following? Tick for each item as Yes (Y), Partial (P) or No(N) Y P N a) Follow-up of action items from previous reviews b) Status of corrective actions taken and required preventive actions c) Reports from personnel d) Environmental monitoring log sheets e) Specimen rejection records f) Equipment calibration and maintenance records g) IQC records across all test areas h) Outcomes of PTs and other forms of Inter- laboratory comparisons i) Quality indicators j) Customer complaints and feedback k) Results of improvement projects l) Documentation of this routine review and action planning with staff for resolution and follow-up review ISO15189:2012 Clause 4.1.1.4; 4.2.1 Note: There must be documentation that the laboratory manager/supervisor or a designee reviews and monitors the quality programme regularly. This routine review must ensure that recurrent problems have been addressed, and that new or redesigned activities have been evaluated. 2.2 Management Review Does the laboratory management perform a review of 5 Y P N the quality system at a management review meeting at least annually? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N Review Input Does the management review meeting include the following inputs? a) The periodic review of requests, and suitability of procedures and sample requirements b) Assessment of user feedback c) Staff suggestions d) Internal audits e) Risk management f) Use of quality indicators g) Assessments by external organizations h) Results of participation in inter-laboratory comparison programmes (PT/EQA) HILS1748 Page 16 of 48 Effective Date: 6/13/2017 i) Monitoring and resolution of complaints j) Performance of suppliers k) Identification and control of nonconformities l) Results of continual improvement including, current status of corrective actions and preventive actions m) Follow-up actions from previous management reviews n) Changes in the volume and scope of work, personnel, and premises that could affect the quality management system o) Recommendations for improvement, including technical requirements p) Review of quality objectives and the quality policy for appropriateness and continuous improvement Review Output Does the management review meeting include the following outputs? a) Are management review outputs recorded? b) Does the output records of the MR meeting capture decisions made, persons responsible for actions to be taken and timeframes? c) Does the report address resources required (human, financial, material)? d) Does it refer to improvement for the users? e) Does it refer to improvement of the effectiveness of the quality system? f) Were the quality objectives and the quality policy reviewed for appropriateness and continuous improvement? ISO15189:2012 Clause 4.1.1.4; 4.15.2; 4.15.4 Note: The interval between management reviews should be no greater than 12 months; however, shorter intervals should be adopted when a quality management system is being established. 2.3 Are findings and actions from MR 2 communicated to the relevant staff? Y P N ISO15189:2012 Clause 4.1.1.4; 4.15.4 Note: Findings and actions arising from management reviews shall be recorded and reported to laboratory staff. 2.4 Does lab management ensure actions from MR Y P N 2 are completed within defined timeframes? ISO15189:2012 Clause 4.1.1.4; 4.15.4 Note: Laboratory management shall ensure that actions arising from management review are completed within a defined timeframe. Section 2: Management Review and Management Responsibilities 14 Subtotal HILS1748 Page 17 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 3 : ORGANIZATION AND PERSONNEL Requirement Y P N Comments Score 3.1 Duty Roster And Daily Routine Does the laboratory have a duty roster that covers 2 Y P N normal and after hours? ISO15189:2012 Clause 4.1.1.4(c); 4.1.2.1(i) Note: A duty roster designates specific laboratory personnel to specific workstations. Daily routines should be prioritized, organized and coordinated to achieve optimal service delivery for patients. 3.2 Organizational Chart and External/Internal Reporting Systems 2 Y P N Is an organizational chart available that indicates the relationship between the laboratory and its parent organization? ISO15189:2012 Clause 4.1.2.5 Note: An up-to-date organizational chart and/or narrative description should be available detailing the external and internal reporting relationships for laboratory personnel. The organizational chart or narrative should clearly show how the laboratory is linked to the rest of the hospital and laboratory services where applicable. 3.3 Laboratory Director Is the laboratory directed by a person(s) with the 3 Y P N competency, delegated responsibility to perform the following; Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Provide effective leadership, budgeting and planning b) Communicate with stakeholders c) Ensure adequate competent staff d) Ensure the implementation of the QMS e) Selection and monitoring of lab supplies f) Selection and monitoring of referral labs N/A g) Ensure a safe lab environment h) Advisory services i) Provide professional development programs for laboratory staff j) Address complaints, requests or suggestions from staff and/or lab users k) Design and implement a contingency plan ISO15189:2012 Clause 4.1.1.4 Note: a director may be a person(s) with responsibility for, and authority over, a laboratory. The person or persons referred to may be designated collectively as laboratory director. Other settings may not use the term “Lab Director” but in this question, it refers to person/persons that are running the laboratory, however they decide to name them 3.4 Quality Management System Oversight Is there a quality officer/manager with delegated 3 Y P N responsibility to oversee compliance with the quality management system? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is there an appointment letter, job description HILS1748 Page 18 of 48 Effective Date: 6/13/2017 available or terms of reference? b) Does the quality manager ensure that processes needed for the quality management system are established, implemented, and maintained? c) Does the QM report to management at which decisions relating to quality are made? d) Does the QM promote awareness of users’ needs and requirements throughout the organization? e) Does the QM participate in management reviews? ISO15189:2012 Clause 4.1.2.7 Note: There should be a quality manager (however named) with delegated authority to oversee compliance with the requirements of the quality management system. The quality manager must report directly to the level of laboratory management at which decisions are made on laboratory policy and resources. 3.5 Personnel Filing System Are records of personnel maintained and do they 3 Y P N include the following? Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) NA Y P N a) Educational and professional qualifications b) Copy of certification or license to practice, when applicable c) Previous work experience e.g. CV d) Job descriptions e) Introduction of new staff to the laboratory environment f) Training in current job tasks including vendor training received on-site g) Competency assessments h) Records of continuing education i) Reviews of staff performance j) Reports of accidents and exposure to occupational hazards k) Immunization status, as applicable relevant to assigned duties l) Letter of employment or appointment m) Employee medical surveillance records ISO15189:2012 Clause 5.1.9 Note: Personnel files must be maintained for all current staff. Wherever (offsite or onsite) and however the records are kept, the records must be easily accessible when required. In some laboratories, not all records may be kept in a single file in one place e.g. training and competency records should be kept in the laboratory, medically related information with the administration. 3.6 Laboratory Staff Training Is there a system for training that covers the 3 Y P N following? Tick for each item as Yes(Y), Partial (P) or No(N) Y P N a) The quality management system b) Assigned work processes, procedures and tasks c) The applicable laboratory information system N/A d) Health and safety, including the prevention or containment of the effects of adverse incidents e) Laboratory Ethics f) Confidentiality of patient information g) Is there supervision for persons undergoing training HILS1748 Page 19 of 48 Effective Date: 6/13/2017 h) Continuous medical education i) Review of effectiveness of the training program ISO15189:2012 Clause 4.1.1.4(c); 5.1.5 Note: The effectiveness of the training program shall be reviewed regularly. Personnel that are undergoing training shall be supervised at all times. 3.7 Staff Competency Assessment and retraining 3 Y P N Is there a system for competency assessment that covers the following? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Are competency assessments performed according defined criteria b) New hires c) Existing staff d) Retraining and re-assessment where needed ISO15189:2012 Clause 4.1.2.1(h); 5.1.6 Note: Newly hired lab staff must be assessed for competency before performing independent duties. All lab staff must undergo ongoing competency at a frequency defined by the laboratory. Staff assigned to a new section should be assessed before fully assuming independent duties. When deficiencies are noted, retraining and reassessment must be planned and documented. If the employee’s competency remains below standard, further action might include supervisory review of work, re-assignment of duties, or other appropriate actions. Records of competency assessments and resulting actions should be retained in personnel files and/or quality records. Records should show which skills were assessed, how those skills were measured, and who performed the assessment. 3.8 Staff meetings Are staff meetings held regularly and do the 3 Y P N meetings address the following items? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Follow-up of action items from previous staff meetings b) Systemic and or recurrent problems and issues addressed, including actions to prevent recurrence c) Complaints d) Communication on reviewed/revised/redundant SOPs e) Review of results from prior corrective actions f) Discussion and evaluation of improvement topics/projects g) Feedback given by staff that have attended hospital meetings, external meetings, training, conferences, workshops, etc. h) Relay of reports and updates from lab attendance at meetings with clinicians (the use of lab services and/or attendance at clinical rounds) i) Recording and monitoring of meeting notes for progress on issues. ISO15189:2012 Clause 4.1.2.1(a); (e); 4.1.2.2; 4.1.2.6; 4.4; 4.14.3 Note: The laboratory should hold regular staff meetings to ensure communication within the laboratory. Meetings should have recorded notes to facilitate review of progress over time. Section 3 : Organization & Personnel Subtotal 22 HILS1748 Page 20 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N).All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. Section 4 :CLIENT MANAGEMENT & CUSTOMER SERVICE Requirement Y P N Comments Score 4.1 Advice and Training by Qualified Staff Do staff members with appropriate professional 2 Y P N qualifications provide clients with advice and/or training regarding required types of samples, choice of examinations, repeat frequency, and interpretation of results? ISO15189:2012 Clause 4.1.1.4(g); 4.7 Note: Authorized staff should provide advice on sample type, examination choice, frequency and results interpretation. 4.2 Resolution of Complaints Does the laboratory investigate (review) and resolve 2 Y P N customer complaints? ISO15189:2012 Clause 4.1.1.4(m); 4.8; 4.15.2(i) Note: The laboratory must have a documented procedure for the management of complaints or other feedback received from clinicians, patients, laboratory staff or other parties. Feedback must be given to the complainant. 4.3 Laboratory Handbook for Clients – 2 information to users Y P N Is there a laboratory handbook for laboratory users that includes information on location of the lab, services offered, laboratory operating times, instructions on completion of request forms, instruction for preparation of the patient; sample collection including patient collected samples, transport, agreed turnaround times, acceptance and rejection criteria, availability of advice on examination and interpretation of results; lab policy on protection of personal information, laboratory complaints procedure. ISO15189:2012 Clause 4.1.1.4(g); 4.5; 5.4.2 Note: The laboratory should provide its clients with a handbook that outlines the laboratory’s hours of operation, available tests, specimen collection instructions, packaging and shipping directions, and expected turnaround times. 4.4 Communication Policy on Delays in Service Is timely, documented notification provided to 2 Y P N customers when the laboratory experiences delays or interruptions in testing (due to equipment failure, stock outs, staff levels, etc.) or finds it necessary to change examination procedures and when testing resumes? ISO15189:2012 Clause 4.1.2.6; 4.4; 5.8.1 Note: There must be a policy for notifying the requester when an examination is delayed. Such notification must be documented for both service interruption and resumption as well as related feedback from clinicians. Clinical personnel must be notified of all delays of examinations. 4.5 Evaluation Tool and Follow up Is there a tool for regularly evaluating client 2 Y P N satisfaction, staff suggestions and is the feedback received effectively utilized to improve services? ISO15189:2012 Clause 4.1.1.4(m); 4.8; 4.14.3; 4.14.4 Note: The laboratory should measure the satisfaction of clients, clinicians and patients regarding its services, either on an ongoing basis or through episodic solicitations. Section 4 :Client Management & Customer Service Subtotal 10 HILS1748 Page 21 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 5:EQUIPMENT Requirement Y P N Comments Score 5.1 Adherence to Proper Equipment Protocol Is equipment installed and placed as specified in 2 Y P N the operator’s manuals and uniquely labelled or marked? ISO15189:2012 Clause 5.3.1.2 Note: Equipment should be properly placed as specified in user manual away from the following but not limited to water, direct sunlight, vibrations, in traffic and with more than 75% of the base of the equipment sitting on the bench top to avoid tip-over. 5.2 Are equipment operated by trained, competent and authorized personnel? 2 Y P N ISO15189:2012 Clause 5.3.1.3 Note: The staff must be trained, and deemed competent to operate equipment 5.3 Equipment and Method 5 Validation/Verification and Documentation Y P N Are all equipment and methods validated/verified on-site upon installation and before use and is documented evidence available? Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) NA Y P N a) Are specific verification/validation protocols in place for each equipment and examination procedure? b) Is validation performed for all laboratory designed or developed methods, standard methods used outside their intended scope and validated methods that are subsequently modified? c) Has validation information been obtained from the manufacturer/method developer as part of the verification? d) Have performance characteristics been appropriately selected and evaluated as per intended use? e) Were the verification/validation studies appropriate and adequate? f) Was the analysis of data appropriate for the selected performance characteristics? g) Have the verification/validation results/reports been reviewed and approved by an authorised person? ISO15189:2012 Clause 5.3.1.2; 5.5.1 Note: Newly introduced methods or equipment must be verified onsite to ensure that their introduction yields performance equal to or better than the previous method or equipment. Manufacturers’ validation may be used. Back up equipment must also be included in verification procedures. 5.4 Measurement uncertainty of measured quantity 2 tests NA Y P N Does the laboratory have documented estimates of measurement of uncertainty (UM)? Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) NA Y P N a) Has the laboratory calculated the measurement HILS1748 Page 22 of 48 Effective Date: 6/13/2017 uncertainty for each quantitative measurement procedure? b) Has the laboratory defined the performance requirements (factors that affect the UM) for the measurement uncertainty of each measurement procedure and regularly review estimates of measurement uncertainty? c) Does the lab make its calculated measurement of uncertainty available to its users upon request? ISO15189:2012 Clause 5.5.1.4 Note: Measurement of uncertainty should be calculated at different clinical decision levels. Cumulative IQC (minimum 6 months data) may be used to calculate measurement of uncertainty. 5.5 Equipment Record Maintenance Is current equipment inventory data available 2 Y P N for all equipment in the laboratory? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Name of equipment b) Manufacturer’s or authorized supplier contact details c) Condition received (new, used, reconditioned) d) Serial number e) Date of receiving f) Where equipment is obsolete, date when put “out of service” g) Date of entry into service after validation / verification) h) Location ISO15189:2012 Clause 4.13; 5.3.1.7 Note: Records must be maintained for each item of equipment used in the performance of examinations. Such equipment list must include major analysers as well as ancillary equipment like centrifuges, water baths, rotators, fridges, pipettes, timers, printers, and computers. 5.6 Equipment Maintenance Records Is relevant equipment service information 2 Y P N readily available in the laboratory? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Service contract information or service schedule that has been adhered to b) Contact details for service provider c) Decontamination records before service , repair or decommissioning d) Engineer or service provider preventative maintenance records e) Last date of service f) Next date of service ISO15189:2012 Clause 4.13; 5.3.1.5; 5.3.1.7 Note: Maintenance records must be maintained for each item of equipment used in the performance of examinations. These records shall be maintained and shall be readily available for the lifespan of the equipment or for any time period required by national, regional and local authorities. 5.7 Defective Equipment Waiting for Repair Is defective equipment, waiting for repair not 2 Y P N used and clearly labelled? ISO15189:2012 Clause 4.13; 5.3.1.5 Note: label should include the date of malfunction and “not in use” and a signature of approval. 5.8 Obsolete Equipment Procedures Is non-functioning equipment appropriately 2 Y P N HILS1748 Page 23 of 48 Effective Date: 6/13/2017 labelled and removed from the laboratory or path of workflow following the equipment management policies and procedures? ISO15189:2012 Clause 4.13; 5.3.1.5 Note: Label should include the date made obsolete and “obsolete” and a signature of approval. 5.9 Equipment Calibration and Metrological traceability Protocol 2 Y P N Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is routine calibration of laboratory ancillary equipment (including pipettes, centrifuges, balances, and thermometers) scheduled, at minimum following manufacturer recommendations and verified? b) Is the calibration traceable (e.g. use of reference materials and equipment like certified thermometers, tachometer? c) Is there evidence of review of calibration certificates/results by the laboratory before acceptance back into use? d) Are certified reference materials, examination and calibration by another procedure, and/or use of mutual consent standards or methods used for in house calibrations? ISO15189:2012 Clause 5.3.1.4 Note: Documentation of calibration traceability to a higher order reference material or reference procedure may be provided by an examination system manufacturer. Such documentation is acceptable as long as the manufacturer's examination system and calibration procedures are used without modification. 5.10 Equipment Preventive Maintenance Is routine user preventive maintenance performed 2 Y P N on all equipment and recorded according to manufacturer’s minimum requirements? ISO15189:2012 Clause 4.13; 5.3.1.5 Note: Preventative maintenance by operators must be done on all equipment used in examinations including centrifuges, autoclaves, microscopes, and safety cabinets. 5.11Equipment Service Maintenance Is equipment routinely serviced according to 2 Y P N schedule as per the minimum manufacturer recommendations by qualified and competent personnel and is this information documented in appropriate logs? ISO15189:2012 Clause 4.13; 5.3.1.5 Note: All equipment must be serviced at specified intervals by a qualified service engineer either through service contracts or otherwise. Service schedule must at minimum meet manufacturer’s requirements. 5.12 Equipment Malfunction - Response and 2 Documentation Y P N Is equipment malfunction resolved by the effectiveness of the corrective action program and the associated root cause analysis? ISO15189:2012 Clause 4.9; 4.10, 4.13; 5.3.1.5 Note: All equipment malfunctions must be investigated and documented as per the non-conforming procedure. In the event that the user cannot resolve the problem, a repair order must be initiated. 5.13 Equipment Repair Monitoring and 2 Documentation Y P N a) Are repair orders monitored to determine if the service is completed? b) Does the laboratory verify and document the equipment is in proper working order before being HILS1748 Page 24 of 48 Effective Date: 6/13/2017 put it back into service? ISO15189:2012 Clause 4.13; 5.3.1.5; 5.6 Note: After a repair all levels of QC must or other performance checks must be processed to verify that the equipment is in proper working condition. Copies of the QC or performance checks results should be attached to the repair records as evidence. 5.14Equipment Failure - Contingency Plan Is there a functional back-up system that prevents 2 Y P N interruption of lab services? ISO15189:2012 Clause 4.1.1.4 (n); 5.3.1 Note: Interruption to services is considered when a laboratory cannot release results to their users. Testing services should not be subject to interruption due to equipment malfunctions. Contingency plans must be in place, in the event of equipment failure, for the completion of testing. In the event of a testing disruption, planning may include the use of a back-up instrument, the use of a different testing method, the referral of samples to another laboratory. 5.15 Manufacturer’s Operator Manual Are the manufacturer’s operator manuals readily 2 Y P N available to testing staff and, available in the language understood by staff? ISO15189:2012 Clause 5.3.1.3 Note: Operator manuals must be readily available for reference by testing staff and must be document controlled. 5.16 Laboratory Testing Services Has the laboratory provided uninterrupted testing 2 Y P N services, with no disruptions due to equipment failure in the last year (or since the last audit)? ISO15189:2012 Clause 4.1.1.4(a);(n); 4.1.2.1(i); Note: Interruption to services is considered when a laboratory cannot release results to their users. Testing services should not be subject to interruption due to equipment malfunctions. Contingency plans must be in place, in the event of equipment failure, for the completion of testing. In the event of a testing disruption, planning may include the use of a back-up instrument, the use of a different testing method, the referral of samples to another laboratory Section 5: Equipment subtotal 35 HILS1748 Page 25 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N).All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 6: EVALUATION AND AUDITS Y P N Comments Score 6.1 Internal Audits 5 Are internal audits conducted at intervals as Y P N defined in the quality manual and do these audits address areas important to patient care? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is there an audit plan/schedule that ensures all activities of the QMS are audited? b) Are audits being carried with minimal conflict of interest e.g. where possible, carried out by persons who are not involved in lab activities in the section being audited? c) Are the personnel conducting the internal audits trained with proven competency in auditing managerial and/or technical requirements? d) Is cause analysis performed for nonconformities/noted deficiencies? e) Are internal audit findings documented and presented to the laboratory management and relevant staff for review? ISO15189:2012 Clause 4.13; 4.14.5 Note: The cycle for internal auditing should normally be completed in one year. The laboratory must conduct internal audits at planned intervals to determine whether all activities in the quality management system, including pre-examination, examination, and post-examination. 6.2 Audit Recommendations and Action Plan & Follow up 5 Y P N Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Are internal audit reports generated? b) Are recommendations for corrective/preventive actions made based on audit findings? c) Is an action plan developed with clear timelines, assigned personnel & documented follow-up within the timeframe defined by the laboratory? ISO15189:2012 Clause 4.10; 4.13; 4.14.5: Note: For actions that are not implemented as per the due dates there should be a motivation and an approval of extension. 6.3 Risk Management Are assessment of potential pitfalls performed for all 5 Y P N laboratory processes including pre examination, examination and post examination? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Documented assessment of potential pitfalls for all processes b) Documented actions taken to reduce or eliminate identified potential pitfalls HILS1748 Page 26 of 48 Effective Date: 6/13/2017 ISO15189:2012 Clause 4.13; 4.14.6 The Laboratory shall assess all steps in for all its processes (pre-analytical, analytical and post analytical) for areas of potential pitfalls e.g. pre-analytical step of sample collection, potential pitfalls could be; wrong sample collected, sample collected in wrong container, sample collected at wrong time. Post analytical could be; result sent to wrong patient, results sent outside of TAT. The Lab must assess all steps, list potential pitfalls and document action taken to prevent these from occurring. Note: Risks should be graded and acted upon as per their grading. Section 6:Evaluations and Audits Subtotal 15 HILS1748 Page 27 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 7: PURCHASING AND INVENTORY Requirement Y P N Comments Score 7.1 Inventory and Budgeting System Is there a system for accurately forecasting needs 2 Y P N for supplies and reagents? ISO15189:2012 Clause 4.1.2.1(i); 5.3.2.1; 5.3.2.4 Note: The laboratory must have a systematic way of determining its supply and testing needs through inventory control and budgeting systems that take into consideration past patterns, present trends and future plans. 7.2 Does the laboratory provide specification for their supplies and consumables that are 2 Y P N required when placing a requisition? ISO15189:2012 Clause 4.6 Note: Specification could be in the form of catalogue number; item number, manufacturer name etc. 7.3 Service Supplier Performance Review Does the lab monitor the performance of the 2 Y P N suppliers to ensure that the stated criteria are met? ISO15189:2012 Clause 4.6 Note: All suppliers of services used by the laboratory must be reviewed and monitored for their performance. 7.4 Inventory Control Does the lab maintain records for each reagent and 2 Y P N consumable that contributes to the performance of examinations. These records shall include but not be limited to the following: Tick for each item as Yes (Y) or No (N) Y P N a) Identity of the reagent or consumable? b) Batch code or lot number? c) Manufacturer or supplier name and contact information? d) Date of receiving, the expiry date, date of entering into service and, where applicable, the date the material was taken out of service? e) Manufacturer's instruction/package insert? f) Records of inspection of reagents and consumables when received (e.g. acceptable or damaged)? ISO15189:2012 Clause 4.13; 5.3.2.7; 5.3.2.4 Note: All incoming orders should be inspected for condition and completeness of the original requests, receipted and documented appropriately; the date received in the laboratory and the expiry date for the product should be clearly indicated. 7.5 Budgetary Projections Are budgetary projections based on personnel, 2 Y P N test, facility and equipment needs, and quality assurance procedures and materials? ISO15189:2012 Clause 4.1.1.4(a) Note: Budgetary projections will ensure that there are no disruptions to services provided 7.6 Management Review of Supply Requests Does management review/approve the finalized 2 Y P N supply requests? ISO15189:2012 Clause 5.3.2.3; 5.3.2.7 Note: Due to the fact that labs have different purchasing approval systems, there should be a system in place that the lab reviews final approval of their original request. 7.7 Laboratory Inventory System 2 Y P N HILS1748 Page 28 of 48 Effective Date: 6/13/2017 Tick for each item as Yes (Y), Partial (P) or No (N) NA Y N a) Are inventory records complete and accurate, with minimum and maximum stock levels denoted and monitored? b) Is the consumption rate of all reagents and consumables monitored? c) Are stock counts routinely performed? ISO15189:2012 Clause 5.3.2 Note: The laboratory inventory system should reliably inform staff of the minimum amount of stock to be kept in order to avoid interruption of service due to stock-outs and the maximum amount to be kept by the laboratory to prevent expiry of reagents. 7.8 Storage Area Are storage areas set up and monitored 2 Y P N appropriately? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is the storage area well-organized and free of clutter? b) Are there designated places for all inventory items for easy access? c) Is adequate cold storage available? d) Are storage areas monitored as per prescribed storage conditions? e) Is the ambient temperature monitored routinely? f) Is storage in direct sunlight avoided? g) Is the storage area adequately ventilated? h) Is the storage area clean and free of dust and pests? i) Are storage areas access-controlled? ISO15189:2012 Clause 5.3.2.2 Note: Storage of supplies and consumables must be as per the manufacturer’s specifications. 7.9 Inventory Organization and Wastage 2 Minimization Y P N Is First-Expiration-First-Out (FEFO) practiced? ISO15189:2012 Clause 5.3.2.2 and USAID Deliver Project, Logistics Handbook, Task Order 1 Note: To minimize wastage from product expiry, inventory should be organized in line with the First-Expiry-First-Out (FEFO) principle. Place products that will expire first in front of products with a later expiry date and issue stock accordingly to ensure products in use are not past their expiry date. Remember that the order in which products are received is not necessarily the order in which they will expire. 7.10 Product Expiration Are all reagents/test kits in use (and in stock) 2 Y P N currently within the manufacturer-assigned expiration or within stability? ISO15189:2012 Clause 5.3.2.3 Note: All reagents and test kits in use, as well as those in stock, should be within the manufacturer-assigned expiry dates. If and when expired stock is entered into use, there must be evidence of stability studies and enhanced control (increased frequency of QC) of the stock. Expired control and calibrators must not be used. 7.11 Disposal of Expired Products Are expired products labelled and disposed 2 Y P N properly? ISO15189:2012 Clause 5.3.2.7 Note: Expired products should be disposed of properly and records maintained. If safe disposal is not available at the laboratory, the manufacturer/supplier should take back the expired stock at the time of their next delivery. HILS1748 Page 29 of 48 Effective Date: 6/13/2017 7.12 Laboratory Testing Services Has the laboratory provided uninterrupted testing 2 Y P N services, with no disruptions due to stock outs in the last year or since last audit? ISO15189:2012 Clause 4.1.1.4(a);(n); 4.1.2.1(i); 5.5 Note: Interruption to services is considered when a laboratory cannot release results to their users. Testing services should not be subject to interruption due to stock-outs. Laboratories should pursue all options for borrowing stock from another laboratory or referring samples to another testing facility while the stock-out is being addressed. Section 7: Purchasing and Inventory Subtotal 24 HILS1748 Page 30 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 8: PROCESS CONTROL Requirement Y P N Comments Score 8.1 Information for patients and users Are guidelines for patient identification, specimen 2 Y P N collection (including client safety), labelling, and transport readily available to persons responsible for primary sample collection? ISO15189:2012 Clause 5.4.1 Note: The laboratory shall have documented procedures and information for pre-examination activities to ensure the validity of the results of examinations and must make these available to those who collect samples. 8.2 Does the laboratory adequately collect 3 information needed for examination Y P N performance? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Are all test requests accompanied by an acceptable and approved test requisition form (and a transmittal sheet/checklist/manifest where applicable)? b) Does the request form has patient ID including gender, date of birth, location of patient and unique identifier? c) Name, signature or initials of authorized requester d) Type of sample and examination requested e) Clinically relevant information f) Date of sample collection (And time of collection where relevant – where time has an impact on the result) g) Date and time of sample receipt h) Written consent for invasive procedures with N/A increased risk of complications ISO15189:2012 Clause 4.4; 5.4.3 Note: Each request accepted by the laboratory for examination(s) shall be considered an agreement. The request may be in the form of a hard copy or electronically. 8.3 Are adequate sample receiving procedures in place? 2 Y P N Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Patient Unique Identifier b) Are received specimens evaluated according to acceptance/rejection criteria? c) Are specimens logged appropriately upon receipt in the laboratory (including date, time, and name of receiving officer)? d) Are procedures in place to process “urgent” specimens and verbal requests? e) When samples are split, can the portions be traced back to the primary sample? f) If not a 24 hour lab, is there a documented method HILS1748 Page 31 of 48 Effective Date: 6/13/2017 for handling of specimens received after hours? g) Are specimens delivered to the correct workstations in a timely manner? ISO15189:2012 Clause 4.4; 5.4.6 Note: The review of service agreements occurs on sample reception. All portions of the primary sample must be unequivocally traceable to the original primary sample. 8.4 Pre-examination Handling, Preparation and Storage 2 Y P N Where testing does not occur immediately upon arrival in the laboratory, are specimens stored appropriately prior to testing? ISO15189:2012 Clause 5.4.7 Note: Specimens should be stored under the appropriate conditions to maintain the stability of the specimen. 8.5 Sample Transportation Are specimens either received or referred packaged 2 Y P N appropriately according to local and or international regulations and transported within acceptable timeframes and temperature intervals? ISO15189:2012 Clause 5.4.4.3; 5.4.5 Note: All samples should be transported to the laboratory in a manner that is safe to the patients, the public and the environment. The laboratory must ensure that the samples were received within a temperature interval specified for sample collection. 8.6 Does the laboratory select and evaluate 2 referral Labs and Consultants? Y P N NA Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) Y P N NA a) Are there documented reviews and evaluations of referral laboratories and consultants as defined by the laboratory? b) Is there a register of referral Laboratories and consultants? c) Are referred specimens tracked properly using a logbook, tracking form or electronically? ISO15189:2012 Clause 4.13; 4.5 Note: The laboratory must have system in place to ensure that the referral laboratories are competent to perform the services required. Evaluations in the form of checking their accreditation status, using a questionnaire, performing audits, use of blinded samples etc. 8.7 Documentation of Examination Procedures Are examination procedures documented in a 2 Y P N language commonly understood by all staff and available in appropriate locations? ISO15189:2012 Clause 5.5.3 Note: examination procedures are for the laboratory staff to use therefore it should be in the language that is commonly understood by the staff; the lab may translate the documents into other languages which must be document controlled. 8.8 Reagents Acceptance Testing Is each new reagent preparation, new lot number, 2 Y P N new shipment of reagents or consumables verified before use and documented? ISO15189:2012 Clause 5.3.2.3 Note: This may be accomplished by a comparison study or examining quality control samples and verifying that results are acceptable. 8.9 Quality Control Is internal quality control performed, 3 Y P N documented, and verified for all tests/procedures before releasing patient results? ISO15189:2012 Clause 5.6.2 Note: QC must be verified as being within the acceptable limits before releasing results. 8.10 Quality Control Data Are QC results monitored and reviewed 3 Y P N HILS1748 Page 32 of 48 Effective Date: 6/13/2017 (including biases and Levy-Jennings charts for quantitative tests)? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is there documentation of corrective action taken when quality control results exceed the acceptable range or reviews identify non conformities in a timely manner? b) Does the Lab evaluate the results from the patient samples that were examined after the last successful quality control event ISO15189:2012 Clause 5.6.2.3 Note: The lab must document and implement a system it would use to evaluate patient results since the last successful quality control; the evaluation could be done by re-examining selected samples of various batches, re-examining samples as per the stability of the Quality Control etc. 8.11Comparability of Examination Results Does the laboratory compare results of the same 2 Y P N NA test performed with different procedures and equipment? Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) Y P N NA a) Where there is more than one procedure for the same measure, does the laboratory compare results from the different procedures, equipment or methods? b) Does the lab discuss, document and act upon (including notifying users) problems or deficiencies from these comparison studies? ISO15189:2012 Clause 5.6.4 Note: The lab should document and implement a system to ensure there is comparability of results, this could be done by the use of EQA performance; using blinded samples, parallel testing. 8.12 Are environmental conditions checked and reviewed accurately? 2 Y P N Are the following environmental conditions checked and recorded daily? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N NA a) Room temperature b) Freezers c) Refrigerator d) Incubators e) Water Bath ISO15189:2012 Clause 5.2.6 Note: The laboratory shall monitor, control and record environmental conditions, as required by relevant specifications or where they may influence the quality of the sample, results, and/or the health of staff. 8.13. Have acceptable ranges been defined for all temperature- dependent equipment with 2 Y P N procedures and documentation of action taken in response to out of range temperatures? ISO15189:2012 Clause 5.2.2(c) Note: Acceptable ranges should take into consideration manufacturers’ recommendations and requirements. 8.14.Does the laboratory participate in inter- laboratory comparison program or alternative 3 Y P N HILS1748 Page 33 of 48 Effective Date: 6/13/2017 assessment systems for all tests? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Do samples come from providers who are accredited or approved? b) Are specimens handled and tested the same way as patient specimens? c) Is the performance of the laboratory in the PT program reviewed and discussed with relevant staff? d) Is cause analysis performed for unacceptable results? e) Is corrective action documented for unacceptable results? ISO15189:2012 Clause 5.6.3 Note: The laboratory should handle, analyze, review and report results for proficiency testing in a manner similar to regular patient testing. Investigation and correction of problems identified by unacceptable proficiency testing should be documented. Acceptable results showing bias or trends suggest that a problem should also be investigated. Section 8: Process Control Subtotal 32 HILS1748 Page 34 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 9: INFORMATION MANAGEMENT Requirement NA Y N Comments Score 9.1 Test Result Reporting System Are test results legible, technically verified by an 2 Y P N authorized person, and confirmed against patient identity? ISO15189:2012 Clause5.8.1 Note: Results must be written in ink and written clearly with no mistakes in transcription. The persons performing the test must indicate verification of the results. There must be a signature or identification of the person authorizing the release of the report. 9.2 Testing Personnel Are testing personnel identified on the result report 2 Y P N or other records (manual or electronic)? ISO15189:2012 Clause 4.13 ; 5.5.1.1; 5.8.1 Note: The person who performed the procedure must be identified on the report (hard copy or electronic) for purposes of traceability. traceability. 9.3 Report Content Does the laboratory report contain at least the following: 3 Y P N Tick for each item as Yes (Y), Partial (P) , No (N) or Not Applicable (NA) Y P N NA a) Test requested b) Identification of the laboratory c) Identification of all examinations performed by a referral laboratory c) Patient identification and location d) Name of the requester e) Date of primary sample collection (and time, relevant to patient care) f) type of primary sample g) Is the result reported in SI units where applicable? h) Biological reference intervals where applicable i) Is there space for interpretation or comments of results, when applicable? j) Identification of the person(s) reviewing and authorizing the report k) Date and time of the report l) Page number to total number of pages (e.g. "Page 1 of 5", "Page 2 of 5", etc.) m) When issuing revised reports, is it clearly identified as a revision and includes reference to the date and patient's identity in the original report and the user made aware of the revision? n) Does the revised record show the time and date of the change and the name of the person responsible for the change? o) Does the original report entry remain in the record HILS1748 Page 35 of 48 Effective Date: 6/13/2017 when revisions are made? ISO15189:2012 Clause 5.8.2; 5.8.3; 5.9.3 Note: When the reporting system cannot capture amendments, changes or alterations, a record of such shall be kept. 9.4 Analytic System/Method Tracing 2 When more than one instrument is in use for the Y P N NA same test, are test results traceable to the equipment used for testing? ISO15189:2012 Clause 4.13(g) Note: There must be traceability of specimen results to a specific analytical system or method. Proficiency testing specimens would also fall under specimen results. 9.5 Archived Data Labelling and Storage Are archived results (paper or data-storage media) 2 Y P N properly labelled and stored in a secure location accessible only to authorized personnel? ISO15189:2012 Clause 4.13; 5.10.3 Note: All patient data, paper, tapes, disks must be retained as per the lab’s retention policy and should be stored in a safe and access controlled environment. 9.6 Authorities and Responsibilities Has the laboratory defined and implemented 2 Y P N authorities and responsibilities for the management and use of the laboratory information system– paper based and electronic, including maintenance and modifications that may affect patient care? Is the following in place and implemented? Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) Y P N NA a) Controlled access to patient data and information b) Controlled access to enter patient data and examination results c) Controlled access to changing patient data or examination results d) Controlled access to the release of examination results and reports e) Verify that results that have been transmitted electronically or reproduced external to the laboratory (computers, fax machines, email and websites and personal web devices) are correct. ISO15189:2012 Clause 5.9; 5.10.2; 5.10.3 Note:"information systems" includes the management of data and information contained in both computer and non-computerized systems. Some of the requirements may be more applicable to computer systems than to non-computerized systems. Computerized systems can include those integral to the functioning of laboratory equipment and standalone systems using generic software, such as word processing, spreadsheet and database applications that generate, collate, report and archive patient information and reports. 9.7 Information Management System Does the laboratory have evidence of how the LIMS 2 NA Y P N was selected? ISO15189:2012 Clause 5.3.1.1 Note: The laboratory must have a documented procedure and records for the selection, purchasing and management of equipment. 9.8 Test Result Are test results validated, interpreted and released 2 NA Y P N by appropriately-authorized personnel? ISO15189:2012 Clause 5.1; 5.8; 5.10.3; 5.9.1 Note: There must be a signature or identification of the person authorizing the release of the report. 9.9 Verification of Electronic Laboratory Information System 2 NA Y P N Tick for each item as Yes (Y), Partial (P) or No (N) NA Y P N a) Has the system been verified before implementation HILS1748 Page 36 of 48 Effective Date: 6/13/2017 (ensure verification reports to check functioning & inter- phasing by the laboratory are included in documentation)? b) Records of the validation by the supplier available and approved for use? c) Ongoing system checks available for correct transmissions, calculations and storage of results and records. ISO15189:2012 Clause 4.13; 5.10.3 Note: The lab must perform verification of system after upgrades and to ensure previously stored patient results have not been affected. 9.10 Is the Laboratory Information System properly maintained to ensure continued functioning: 2 NA Y P N Tick for each item as Yes (Y), Partial (P), No (N) or Not Applicable (NA) NA Y P N a) Documented regular service by authorized and trained personnel b) Documented system failures with documented appropriate root cause analysis, corrective actions and preventative actions c) System operated in an environment recommended by the supplier for optimal functioning ISO15189:2012 Clause 5.10.3 Note: If the LIS is maintained offsite, records of maintenance must be readily available .The lab should include the LIS as part of their internal audit. Section 9: Information Management Subtotal 21 HILS1748 Page 37 of 48 Effective Date: 6/13/2017 For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 10: IDENTIFICATION OF NON CONFORMITIES, CORRECTIVE AND PREVENTIVE ACTION Requirement Y P N Comments Score 10.1 Are all identified nonconforming activities/ work identified and documented adequately 5 Y P N Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Indicating details of what happened, when, person responsible. b) Immediate actions being taken c) Determination of the extent of the non- conformity? d) Are examinations halted and results withheld or recalled where the non-conformity compromises patient results? e) Informing the requester where the non-conformity has an effect on the management of the patient f) Authorization of resumption of testing documented (where testing has been halted) ISO15189:2012 Clause 4.9 Note: nonconformities should be identified and managed in any aspect of the quality management system, including pre-examination, examination or post-examination processes. Nonconforming examinations or activities occur in many different areas and can be identified in many different ways, including clinician complaints, internal quality control indications, and instrument calibrations, checking of consumable materials, inter-laboratory comparisons, staff comments, reporting and certificate checking, laboratory management reviews, and internal and external audits. 10.2 Root Cause Analysis Is documented root cause analysis performed for 3 Y P N non-conforming work before corrective actions are implemented? ISO15189:2012 Clause 4.10(b) Note: Root cause analysis is a process of identifying and removing the underlying factor of the non-conformance. 10.3 Is corrective action performed and documented for non-conforming work? 3 Y P N ISO15189:2012 Clause 4.10; 4.13; 4.14.5 Note: Documenting corrective action allows the lab to review its effectiveness and to perform trend analysis for continual improvement. 10.4 Are implemented corrective actions monitored 3 and reviewed for their effectiveness before Y P N closure/clearance? ISO15189:2012 Clause 4.10(f) Note: Implemented corrective action does not imply effectiveness; therefore the lab has to monitor to ensure that the NC has not recurred. 10.5 Preventive Actions Are documented preventive actions implemented 5 Y P N and monitored for their effectiveness? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Reviewing of laboratory data and information to determine potential non conformities b) Determining root causes for potential non conformities HILS1748 Page 38 of 48 Effective Date: 6/13/2017 c) Implementing and documenting preventive actions d) Reviewing and documenting effectiveness of preventive actions ISO15189:2012 Clause 4.11; 4.12; Note: Preventive action should be an ongoing process involving analysis of laboratory data, including trend and risk analyses and e xternal quality assessment (proficiency testing). Section 10: Identification of Non Conformities, 19 Corrective and Preventive Action Subtotal For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 11: OCCURRENCE MANAGEMENT AND PROCESS IMPROVEMENT Requirement Y P N Comments Score 11.1 Are graphical tools (charts, graphs, tables) used to communicate quality findings and identify 2 Y P N trends? ISO15189:2012 Clause 4.12; 4.13; 4.14 Note: Use of graphical displays of quality data communicates more effectively than tables of numbers. Examples of graphical tools commonly used for this purpose include LJ charts; Pareto charts, cause-and-effect diagrams, frequency histograms, trend graphs, and flow charts. 11.2 Quality Management System Improvement 2 Measures Y P N Does the laboratory identify and undertake continual quality improvement projects? ISO15189:2012 Clause 4.12; 4.15 Note: The lab should use its management review activities to continually improve its quality management system by comparing its actual performance to its intentions stated in the quality policy and objectives. 11.3 Communication System on Laboratory Operations 2 Y P N Does the laboratory communicate with upper management regularly regarding needs for continual improvement? ISO15189:2012 Clause 4.15.2 (o) Note: The laboratory staff should give input for management meetings. 11.4 Are quality indicators (TAT, rejected specimens, stock-outs, etc.) selected and tracked? 2 Y P N ISO15189:2012 Clause4.12; 4.14.7 Note: The lab should select QI in line with meeting its objectives from pre-analytic, analytic and post-analytic phases critical to patient outcomes. 11.5 Is the outcome of the review of quality indicators used to improve lab performance? 2 Y P N ISO15189:2012 Clause 4.14.7; 4.15.2(f) Note: The lab should review the QI to ensure its continued appropriateness. 11.6 Are the actions taken checked and monitored to determine the effectiveness of improved quality 2 Y P N of lab performance? ISO15189:2012 Clause 4.14.7 Note: the lab should create an action plan to monitor the QI stating the objectives, methodology, interpretation, limits, action plan and duration of measurement for each QI. HILS1748 Page 39 of 48 Effective Date: 6/13/2017 Section 11: Occurrence Management And Process 12 Improvement Subtotal For each item, please circle as relevant Not Applicable (NA), Yes (Y), Partial (P) or No (N). All elements of the item must be satisfactorily present to indicate “yes”. Provide explanation or further comments for each “partial” or “no” response. SECTION 12:FACILITIES AND BIOSAFETY Requirement Y P N Comments Score 12.1 Is there documented evidence that the laboratory has evaluated the adequacy of the 2 Y P N size and overall layout of the laboratory and organized the space so that workstations are positioned for optimal workflow? ISO15189:2012 Clause 5.2.1 Note: Documentation could be in the form of a floor plan, results from internal audits, etc. 12.2 Are the patient care and testing areas of the laboratory distinctly separate from one 2 Y P N another? ISO15189:2012 Clause 5.2.1 Note: Client service areas (i.e. waiting room, phlebotomy room) should be distinctly separate from the testing areas of the laboratory. Client access should not compromise “clean” areas of the laboratory. For biosafety reasons, microbiology and TB testing should be segregated in a separate room(s) from the general laboratory testing. 12.3 Is each individual workstation maintained free of clutter and set up for efficient 2 Y P N operation? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Do the equipment placement / layout facilitate optimum workflow? b) Are all needed supplies present and easily accessible? c) Are the chairs/stools at the workstations appropriate for bench height and the testing operations being performed? ISO15190 Clause 6.3.5 12.4 Is the physical work environment appropriate for testing? 2 Y P N Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Free of clutter? ISO 15190: 13.0 b) Adequately ventilated? ISO 15190: 6.3.3 c) Adequately lit? ISO 15190: 6.3.1 HILS1748 Page 40 of 48 Effective Date: 6/13/2017 d) Climate-controlled for optimum equipment function? ISO 15190: 6.3.2 e) Are filters checked, cleaned and/or replaced at regular intervals, where air-conditioning is installed? f) Are wires and cables properly located and protected from traffic? g) Is there a functioning back-up power supply (generator)? h) Is critical equipment supported by uninterrupted power source (UPS) systems? i) Is equipment placed appropriately (away from water hazards, out of traffic areas)? j) Are appropriate provisions made for adequate water supply, including deionized water (DI) or distilled water, if needed? k) Is clerical work completed outside the testing area? l) Is major safety signage posted and enforced, including NO EATING, SMOKING, DRINKING? ISO15189:2012 Clause 5.2 Note: The laboratory space should be sufficient to ensure the quality of work, safety of personnel and the ability of staff to carry out their tasks without compromising the quality of the examinations. The laboratory should be clean and well organized, free of clutter, well ventilated, adequately lit and within acceptable temperature ranges. 12.5 Laboratory Access Is the laboratory properly secured from unauthorized 2 Y P N access with appropriate signage? ISO15189:2012 Clause 5.2.2 Note: Access control should take into consideration safety, confidentiality, and quality. 12.6 Laboratory Storage Areas Is laboratory-dedicated cold and room temperature 2 Y P N storage free of staff food items, and are patient samples stored separately from reagents and blood products in the laboratory refrigerators and freezers? ISO15189:2012 Clause 5.2; 5.2.4 Note: there should be effective separation to prevent contamination. 12.7 Is the work area clean and free of leakage & spills, and are disinfection procedures 2 Y P N conducted and documented? ISO15189:2012 Clause 5.2.6 Note: The work area should be cleaned regularly. An appropriate disinfectant should be used. At a minimum, all bench tops and working surfaces should be disinfected at the beginning and end of every shift. All spills should be contained immediately and the work surfaces disinfected. 12.8 Biosafety Cabinet Where a Biosafety cabinet is required to perform 2 Y P N work, is it certified and appropriate? ISO 15189:2012 Clause 5.2.1.; 5.2.2 Note: A biosafety cabinet should be used to prevent aerosol exposure to contagious specimens or organisms. For proper functioning and full protection, biosafety cabinets require periodic maintenance and should be serviced accordingly. Biosafety cabinet should be recertified according to national protocol or manufacturer requirements. 12.9 Laboratory Safety Manual Is a laboratory safety manual available, accessible, and 2 Y P N up-to-date? Does the safety manual include guidelines on the following topics? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Blood and body fluid precautions b) Hazardous waste disposal c) Hazardous chemicals/materials HILS1748 Page 41 of 48 Effective Date: 6/13/2017 d) MSDS sheets e) Personal protective equipment f) Vaccination g) Post-exposure prophylaxis h) Fire safety i) Electrical safety ISO15190 Clause 7.4 Note: A safety manual should be readily available to all employees. The manual should be specific to the laboratory's needs; it must be document controlled. 12.10Waste Disposal Is sufficient waste disposal available and adequate? Is 2 Y P N waste separated into infectious and non-infectious waste, with infectious waste autoclaved/incinerated? ISO15190 Clause 23 Note: Waste should be separated according to biohazard risk, with infectious and non-infectious waste disposed of in separate containers. Infectious waste should be discarded into containers that do not leak and are clearly marked with a biohazard symbol. Sharp instruments and needles should be discarded in puncture resistant containers. Both infectious waste and sharps containers should be autoclaved before being discarded to decontaminate potentially infectious material. To prevent injury from exposed waste, infectious waste should be incinerated, burnt in a pit or buried. 12.11Hazardous Chemicals Are hazardous chemicals / materials properly 2 Y P N handled? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Are hazardous chemicals properly labelled? b) Are hazardous chemicals properly stored to ensure safety and prevent theft? c) Are hazardous chemicals properly utilized according to MSDS? d) Are hazardous chemicals properly disposed according to national guidelines or MSDS? ISO15190 Clause 17.1; 17.3 Note: All hazardous chemicals must be labelled with the chemical’s name and with hazard markings. Flammable chemicals must be stored out of sunlight and below their flashpoint, preferably in a steel cabinet in a well-ventilated area. Flammable and corrosive agents should be separated from one another. Distinct care should always be taken when handling hazardous chemicals. 12.12 Handling of Sharps Are ‘sharps’ handled and disposed of properly in 2 Y P N ‘sharps’ containers that are appropriately utilized? ISO15189:2012 Clause 5.2.3 Note: All syringes, needles, lancets or other bloodletting devices capable of transmitting infection must be used only once and discarded in puncture resistant containers that are not overfilled. Sharps containers should be clearly marked to warn handlers of the potential hazard and should be located in areas where sharps are commonly used. 12.13Fire Safety Is fire safety included as part of the laboratory’s 2 Y P N overall safety program? Tick for each item as Yes(Y), Partial (P) or No (N) Y P N a) Are all electrical cords, plugs, and receptacles used appropriately and in good repair? b) Is an appropriate fire extinguisher available, properly placed, in working condition, and routinely inspected? c) Is an operational fire warning system in place? d) Are periodic fire drills conducted at defined period of time? ISO15190 Clause 19.3; 19.7; 20; 21 HILS1748 Page 42 of 48 Effective Date: 6/13/2017 Note: Electrical cords and plugs, power-strips and receptacles should be maintained in good condition and utilized appropriately. Overloading should be avoided and cords should be kept out of walkway areas. An approved fire extinguisher should be easily accessible within the laboratory and be routinely inspected and documented for readiness. Fire extinguishers should be kept in their assigned place and not hidden or blocked; the pin and seal should be intact, nozzles should be free of blockage, pressure gauges should show adequate pressure, and there should be no visible signs of damage. A fire alarm should be installed in the laboratory and tested regularly for readiness; all staff should participate in periodic fire drills. 12.14Safety Audits Are safety inspections or audits conducted regularly 3 Y P N and documented? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Is there an audit plan/schedule that ensures all activities of the lab are checked for safety compliance? b) Are inspections/audits being carried out by authorized persons? c) Are the personnel conducting the internal audits trained in safety? d) Is cause analysis and action taken for nonconformities/noted deficiencies? e) Are safety findings documented and presented to the laboratory management and relevant staff for review? ISO15190 Clause 7.3.1 and 7.3.2 Note: The safety programme shall be audited and reviewed at least annually (by appropriately trained personnel. 12.15 Safety Equipment Is standard safety equipment available and in use in 2 Y P N the laboratory? Tick for each item as Yes (Y), Partial (P) or No (N) Y P N a) Biosafety cabinet(s) ISO 15190: 16 b) Covers, safety caps, safety buckets on centrifuge(s) c) Hand-washing station ISO 15190: 12.7 d) Eyewash station/bottle(s) and emergency showers where applicable ISO 15190: 12.10 e) Spill kit(s) f) First aid kit(s) ISO 15190: 12.9 ISO15190 Clause 5.1 Note: It is the responsibility of laboratory management to ensure that the laboratory is equipped with standard safety equipment. The list above is a partial list of necessary items. Biosafety cabinets should be in place and in use as required. All centrifuges should have covers. Hand-washing stations should be designated and equipped and eyewash stations (or an acceptable alternative method of eye cleansing) should be available and operable. Spill kits and first aid kits should be kept in a designated place and checked regularly for readiness. 12.16 Personnel Protective Equipment Is personal protective equipment (PPE) easily 2 Y P N accessible at the workstation and utilized appropriately and consistently? ISO15190 Clause 12 Note: Management is responsible for providing appropriate personal protective equipment (gloves, lab coats, eye protection, etc.) in useable condition. Laboratory staff must utilize PPE at all times while in the laboratory. Protective clothing should not be worn outside the laboratory. Gloves should be replaced immediately when torn or contaminated and not washed for reuse. 12.17 Staff Vaccinations Are laboratory personnel offered appropriate 2 Y P N vaccination and employee medical surveillance? ISO15190 Clause 11.3 HILS1748 Page 43 of 48 Effective Date: 6/13/2017 Note: Laboratory staff should be offered appropriate vaccinations—particularly Hepatitis B. Staff may decline to receive the vaccination, but they must then sign a declination form to be held in the staff member’s personnel file. 12.18 Post Exposure Prophylaxis Are post-exposure prophylaxis policies and procedures 2 Y P N posted and implemented after possible and known exposures? ISO15190 Clause 9 Note: The laboratory must have a procedure for follow-up of possible and known percutaneous, mucus membrane or abraded skin exposure to HIV, HBV or HCV. The procedure should include clinical and serological evaluation and appropriate prophylaxis. 12.19 Are adverse incidents or injuries from equipment, reagents, occupational injuries, 2 Y P N medical screening or illnesses, documented and investigated? ISO15189:2012 Clause 5.3.1.6; 5.3.2.6; ISO15190 Clause 9 Note: All occupational injuries or illnesses should be thoroughly investigated and documented in the safety log or occurrence log, depending on the laboratory. Corrective actions taken by the laboratory in response to an accident or injury must also be documented. 12.20Biosafety Training Are drivers/couriers and cleaners working with the 2 Y P N laboratory trained in Biosafety practices relevant to their job tasks? ISO15189:2012 Clause 10 Note: all staff must be trained in prevention or control of the effects of adverse incidents. 12.21Laboratory Safety Officer Is a trained safety officer designated to implement and 2 Y P N monitor the safety program in the laboratory, including the training of other staff? ISO15190 Clause 7.1 Note: A safety officer should be appointed, implement and monitor the safety program, coordinate safety training, and handle all safety issues. This officer should receive safety training. Section 12: Facilities and Biosafety Subtotal 43 HILS1748 Page 44 of 48 Effective Date: 6/13/2017 SUMMARY Noted Commendations Noted Challenges RECOMMENDATIONS See attached table of non-conformities HILS1748 Page 45 of 48 Effective Date: 6/13/2017 ACTION PLAN (if applicable) Follow-up Actions Responsible PersonsTimeline Signature HILS1748 Page 46 of 48 Effective Date: 6/13/2017 Criteria for SLIPTA 5-star certification and readiness for accreditation to international standards 1. Test results are reported by the laboratory on at least 80% of specimens within the turnaround time specified (and documented) by the laboratory in consultation with its clients. Turnaround time to be interpreted as time from receipt of specimen in laboratory until results reported. 2. Validation or verification of test methods used by the laboratory. 3. Internal quality control (IQC) procedures are practiced for all testing methods used by the laboratory. Ordinarily, each test kit has a set of positive and negative controls that are to be included in each test run. These controls included with the test kit are considered internal controls, while any other controls included in the run are referred to as external controls. QC data sheets and summaries of corrective action are retained for documentation and discussion with auditor. 4. The scores on the two most recent approved proficiency tests are 80% or better. Proficiency test (PT) results must be reported within 15 days of panel receipt. Laboratories that receive less than 80% on two consecutive PT challenges will lose their certification until such time that they are able to successfully demonstrate achievement of 80% or greater on two consecutive PT challenges. Unacceptable PT results must be addressed and corrective action taken. No Stars 1 Star 2 Stars 3 Stars 4 Stars 5 Stars (0 – 150 pts) (151 – 177 pts) (178 – 205 pts) (206 – 232 pts) (233 – 260 pts) (261 – 275 pts) < 55% 55 – 64% 65 – 74% 75 – 84% 85 – 94% ≥95% HILS1748 Page 47 of 48 Effective Date: 6/13/2017 RESOURCES CONSULTED 1. AS 4633 (ISO 15189) Field Application Document: 2009 2. Centers for Disease Control - Atlanta - Global AIDS Program. (2008). Laboratory Management Framework and Guidelines. Atlanta, GA: Katy Yao, PhD. 3. CLSI/NCCLS. Application of a Quality Management System Model for Laboratory Services; Approved Guideline—Third Edition. CLSI/NCCLS document GP26-A3. Wayne, PA: NCCLS; 2004. www.clsi.org 4. CLSI/NCCLS. A Quality Management System Model for Health Care; Approved Guideline—Second Edition. CLSI/NCCLS document HS01-A2. Wayne, PA: NCCLS; 2004. www.clsi.org 5. College of American Pathologists, USA. (2010). Laboratory General and Chemistry and Toxicology Checklists. 6. World Health Organization / Pan American Health Organization – US Centers for Disease Control and Prevention/Department of Health and Human Services Joint Initiative, Caribbean Guidance on the Stepwise Improvement Process for Strengthening Laboratory Quality Management Systems towards Accreditation, October 2012 7. International Standards Organization, Geneva (2007) Medical Laboratories – ISO 15189: Particular Requirements for Quality and Competence, 2nd Edition 8. International Standards Organization, Geneva (2012) Medical laboratories – ISO 15189:2012, Requirements for quality and competence, (3rd edition) 9. Ministry of Public Health, Thailand. (2008). Thailand Medical Technology Council Quality System Checklist. 10.National Institutes of Health, (2007, Feb 05). DAIDS Laboratory Assessment Visit Report. Retrieved July 8, 2008, from National Institutes of Health Web site: http://www3.niaid.nih.gov/research/resources/DAIDSClinRsrch/Laboratories.htm 11.National Institutes of Health, (2007, Feb 05). Chemical, Laboratory: Quality Assurance and Quality Improvement Monitors. Retrieved July 8, 2008, from http://www3.niaid.nih.gov/research/resources/DAIDSClinRsrch/Laboratories.htm 12.National Institutes of Health, (2007, Feb 05). Laboratory: Chemical, Biohazard and Occupational Safety, Containment and Disposal. Retrieved July 8, 2008, from http://www3.niaid.nih.gov/research/resources/DAIDSClinRsrch/Laboratories.htm 13.Pharmaceutical Product Development (PPD), Wilmington, North Carolina, Laboratory Report (2007). http://www.ppdi.com/. 14.South African National Accreditation System (SANAS). (2005). Audit Checklist, SANAS 10378:2005. 15.USAID Deliver Project. The Logistics Handbook. (2007). 16.WHO, WHO Guide for the Stepwise Laboratory Improvement Process Towards Accreditation in the African Region (with checklist), http://www.afro.who.int/en/clusters-a-programmes/hss/blood-safety-laboratories-a-health-technology/blt- highlights/3859-who-guide-for-the-stepwise-laboratory-improvement-process-towards-accreditation-in-the-african-region- with-checklist.html. HILS1748 Page 48 of 48 Effective Date: 6/13/2017