+ All Categories
Home > Documents > Breakout_-_NCR_writing_and_closure.pdf

Breakout_-_NCR_writing_and_closure.pdf

Date post: 07-Aug-2018
Category:
Upload: santosh-kumar-buyya
View: 213 times
Download: 0 times
Share this document with a friend

of 13

Transcript
  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    1/29

    1

    Writing Clear and Concise

    Non-conformances (NCs)

    Presented By

    Larry Henderson

    BSI Americas, Inc

    Mike GallagherLockheed Martin Space Systems

    Company

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    2/29

    2

    RMC

    Aerospace Auditor Workshop

    AGENDA

    • Writing Non-conformances (NC)

     Analysis.

    • Parts of a Non Conformance.• Making it clear.

    • What is the Process Approach?

    •  Accepting NC Responses.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    3/29

    3

    Non-conformance Report Writing

     AND THE CLIENT SAYS:

    • I DON’T HAVE A CLUE WHAT YOU ARE

    SAYING OR WHAT YOU ARE TALKING ABOUT……??? 

    OR PRIME INDUSTRY OVERSIGHT

     AUDITOR

    • WHY IS THIS AN NC?

    • WHAT REQUIREMENT IS VIOLATED?

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    4/29

    4

    NC Writing Analysis

    From analysis of data collected from witness audits, office auditsaerospace oversight and other feedback, NC writing has beenidentified as one of the more significant concerns.

    Identified weaknesses were:

    • The NC as written was “incident specific” and did not addressthe systematic issue (s).

    • The NC as written could not be understood by the organizationafter the audit was completed; and not understandable at laterdate.

    • The NC did not identify the actual requirement being offended.

    • The NC did not identify the supporting objective evidence.

    • Poor CA and root cause analysis accepted by the auditor.

    • No indication corrective actions were verified at NC closure.

    NOTE: POORLY WRITTEN NCs SUPPORTS “SOFTGRADING” CUSTOMER, OEM, AND IAQG AND AAQGCONCERNS.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    5/29

    5

    Writing Process

    Non-conformances

    • NCs must be clearly written.

    • Should address the process/system which is

    deficient.

    • Objective evidence gathered should identify

    which process is deficient.

    • What is the process?

     – You must understand the process to verify

    conformance or non-conformance.

    • Is the non-conformance identified, systemic to

    the process?

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    6/29

    6

    Process Approach

    The process approach emphasizes theimportance of:

    • Understanding and meeting requirements.

    • Looking at processes in terms of added value.

    • Obtaining results of process performance.

    • Continual improvement of processes via the

    documenting of NCs.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    7/29

    7

    Process Approach

    The process app roach  systematically

    identifies and manages the linkage,

    combination, and interaction of a system of

    processes within an organization

    AS9100  is based on a process approach

    to quality management

     A process  is a set of interrelated orinteracting activities that uses resources

    to transform inputs into outputs

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    8/29

    8

    Process Approach

    Input Output

    Resources Product

    Monitoring & Measurement Opportunities(Before, During, and After the Process)

    Process Approach

    PROCESS(set of interrelated orinteracting activities)

    PROCEDURE(Specified way to carry out an activityor process – may be documented or

    not) 

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    9/29

    9

     YourProcess

    Process Approach

    PLAN DO

    CHECKACT

    • Activities

    • Controls

    • Documentation

    • Resources

    • Objectives 

    • Deploy &conformwith plan

    • Measure &monitor forconformity &

    effectiveness

    • Analyze/review

    • Decide/change

    • Improve

    effectiveness

    ContinualImprovement

    The Plan - Do - Check - Act  (PDCA) methodo logy

    appl ies to al l processes

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    10/29

    10

    Process Audit Scope

    •Specific to the function, area,requirement, system or process being

    audited.

    •Processes audited should remainconstant.

    •Follow audit trails to the end to obtain

    good objective evidence.

    •Document objective evidence to support

    NC identified.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    11/29

    11

    HOW DEEP SHOULD YOU

    GO!----INTO THE PROCESS

    •Evaluate the process thoroughly.

    •Avoid “tunnel vision”. 

    •Ensure objective evidence supports conformance

    or non-conformance of the process.

    •Gather enough objective evidence to support

    your final decision.

    •Adequate “sampling” of objective evidence. 

     – Repeatability of objective evidence which

    indicates the process is not working.

     – indication of consistent process failure.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    12/29

    12

    Three Distinct Parts of An NC

     An audit NC should have three distinct parts:

    •  A clear statement of the non-conformance.

    • The requirement, or specific reference to the

    requirement.

     – If you cannot identify a requirement, then

    you cannot raise a non-conformance.

    •  And finally, objective evidence that supports the

    statement of non-conformance; based on the

    requirement.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    13/29

    13

    Statement of the NC

    • Should be self-explanatory and related to theprocess.

    • Be unambiguous and concise.

    • Not be a restatement of the audit evidence.

    • Record the requirement against which the NCwas detected. – If possible, write out the exact text of the

    requirement.

    • The audit evidence must support the auditfinding.

     – The evidence must be specific to theviolated requirement.

     – Evidence must be traceable to the NC.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    14/29

    14

    Examples of POOR NC Statements

    • Example: Two pieces of calibrated equipment was pastdue calibration.

    (THIS GIVES ONLY A BRIEF INDICATION OF THEPROBLEM)

     AND ALSO

    • The statement does not give the auditee any indicationthat there is a system/process failure.

    • It appears as a single instance.

    • It does not identify the actual requirement beingoffended-actually, it incorrectly states the requirement.

    •  As written, the auditee could easily assume the NC was asingle incident and take action ONLY related to the twopieces of calibrated equipment.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    15/29

    15

    Making it Clear

    • Changing the structure and the way the NC iswritten can assist in getting the auditee to

    address the “root cause” of why the calibrated

    equipment is past due calibration.

    • The NC must highlight the issue that there is asystem/process failure vs a single incident

    failure.

    • Thus, the corrective action and root cause

    should be focused towards system/processfailure, not the observed incident.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    16/29

    16

    NC Statement “TIPS” 

    TIPS:• The statement of NC should be as

    generic as possible to help direct theauditee to the system’s issue… instead

    of the specific incident.• Keep the “specific details” in the

    objective evidence area, if at all possible.

    • The NC statement should includeenough details so that the auditee canrespond to exactly what the auditorfound…….even years later.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    17/29

    17

    Examples of Poorly Written NCs

    Non-conformance states:•  A required block torque test was not being

    performed. (Classified as “Minor” yet a test notperformed would be detrimental to the integrityof the product.) 

    Non-conformance states:

    •   No preventative action records exist. (Thiswould equate to an absence of a qualitymanagement system element.)

    Neither NC statement tells the client what wentwrong...what process is broken?

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    18/29

    18

    Writing of NC Statements

    • Non-confo rmance: (Clear ly def ine and doc ument thesystemic fai lure wi th in the non -confo rmance. Youwant ensu re the cl ient understands the exact natureof the non-conformance. Too many words could mis- lead the c lient.)  

     –  The system for the control of the process for product

    design failed to ensure authorization or approval wasgiven prior to proceeding from Stage 2 to Stage 3 ofthe product design.

    • Object ive Evidence: (Quote appropriate aerospacestandard clause, work instruction, procedure orprocess requirement) 

     –  The Design/Engineering review record did notindicate authorization was given to proceed to Stage3 of the product design.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    19/29

    19

    Writing of NC Statements

    • Stated Requirement: (What objectiveevidence is/was used to indicate a non-

    conformance existed? What record,

    document, procedure was used to verify

    existence of a non-conformance)  –  AS9100, Clause 7.3.4c, at suitable stages,

    systematic reviews of design and

    development shall be performed in

    accordance with planned arrangement;authorization is required for progression to

    the next design stage.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    20/29

    20

    Accepting Closure of CAR

    Responses

    The auditee’s corrective action response shouldcover three areas, as a minimum:

    • Containment of the current situation and

    identified systemic failure.

     –  Action to control or mitigate a problem; couldincludes correction, corrective action.

    • Root cause analysis as to why the system

    failed.

    • Finally, a systemic corrective action to preventa recurrence of a failure in the system/process

    (could be preventive action may apply here.)

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    21/29

    21

    Corrective Action

    Acceptance/Closure

    • Does CA response address systemprocess NC?

    • Is Root Cause adequate?

    • You must know and understand theprocess to accept the CA and root

    cause.

    • Does client’s response ensure no re-

    occurrence?

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    22/29

    22

    Scenario One

    -Auditor John Hancock is reviewing control of non-conforming material at The Great Widget Company.The Great Widget Company has a separate lockedroom where all non-conforming material is storeduntil the material is dispositioned.

    -During John’s review of the room he notices that

    material dispositioned as scrap is placed in largemetal containers and the containers are then alsostored in the locked room. When John asks whathappens with the containers, he is told that thelocal scrap dealer takes them away.

    Should John:

    • Show that The Great Widget Company isconforming?

    • Ask to see the customer approval of the currentscrap procedure?

    • Write an NC?

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    23/29

    23

    Scenario One

    The Correct answer is C: Write an NC.

    • John should write an NC because

     AS9100 Section 8.3 requires that scrapmaterial be segregated until physically

    rendered unusable.

    • Currently The Great Widget Company

    segregates their scrap but when it leavestheir facility it has not been rendered

    unusable.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    24/29

    24

    Scenario Two

    • During an audit, you read the Management Reviewprocedure. It states they have defined measurableobjectives for productivity, Customer satisfaction, andquality. When you ask to see the measures looked atduring a management review meeting, the Plant Manager

    hands you a 3 inch pile of papers. As you go through theinformation, you notice there are plenty of charts, graphs,and pivot tables. Seems like this place measureseverything they possible can, but there are no goals listedor explanations for trends going in the wrong direction.

    • The Plant Manager understands each chart and is clearlyinvolved, but when asked how he uses them to driveimprovement, or how he knows if he is meeting his goals,he has no answer.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    25/29

    25

    Scenario Two

     You Should:A. Do nothing, the thoroughness of the

    management review is evidence that it is

    acceptable. Improvement, although

    desirable, is not required.B. Write an NCR because there has been no

    improvement and therefore the management

    review is ineffective. 

    C. Write an NCR, as there is no evidence ofdefined measurable quality objectives as

    stated in the procedure.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    26/29

    26

    Scenario Two

    The Correct answer is C: Write an NC.

    •  AS9100 Section 5.6.1 states, in part

    “that top management shall includeassessing opportunities for improvement

    of its effectiveness of it’s QMS.”

    • The plant’s procedure stated they will

    have defined measurable objectives forquality and none were found during this

    review.

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    27/29

    27

    Scenario Three

    While auditing the purchasing department of Hector AircraftComponents, you note that the purchasing procedure, HAC 123,does not address positive recall per AS9100 section 7.4.3 paragraphtwo, and the company’s process does not address periodicallyvalidating test reports for raw material in accordance with section7.4.3 paragraph three.

    The QM, Hector, immediately corrects the master purchasingprocedure and saves the revised form in the company’s electronicmedia. He demonstrates that the master purchasing document,HAC Admin Form 01 now shows the requirement to validate testreports, and that the procedure shows the positive recallrequirement.

    You should:

     A. Write an NC and accept it on siteB. Write an NC and leave it open

    C. Do not write an NC because the issue has been resolved

    D. Follow up to see if the company actually uses the new procedure

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    28/29

    28

    Scenario Three

    You should:

     A. Write an NC and accept it on site

    B. Write an NC and leave it open

    C. Do not write an NC because the issuehas been resolved

    D. Follow up to see if the company

    actually uses the new procedure

  • 8/20/2019 Breakout_-_NCR_writing_and_closure.pdf

    29/29

    29

    Scenario Three

    The Correct answer is B: Write an NC.

    • When a major component of the quality

    system is missing, it requires an NC.•  Base on severity of NC, some NCs

    cannot be closed on site