A Manufacturing Technology Maturity Impact Assessment Framework: An Application within the Aerospace
Manufacturing Industry
1
Introduction
• Mark Jones: Second Year PhD student working in collaboration withCranfield University and Airbus in the UK
• Based within Airbus, Filton
• Project must fulfil industrial and academic deliverables; a challengingrequirement
• Framework at the conceptual stage
• Keen to discuss work with anyone involved in similar topics, pleasedon’t hesitate to discuss further after the presentation
2
Introduction
• Technology Readiness Levels (TRLs) have beenavailable for more than 25 years, first developed by(NASA) to ensure appropriate technology was reliableenough to be integrated into space systems
• This TRL scale has now been developed and adapted tosuit Airbus and consists of 9 Technology ReadinessLevels, as with the original NASA TRL system
• These range from ‘Basic Technology Research’ (TRL1)through to ‘Actual system flight proven throughsuccessful mission operations’ (TRL9)
• Due to Airbus confidentiality the basis of thispresentation will be geared around the generic, readilyavailable NASA TRL system
3
Airbus Pre-TRL Ha rmonisa tion
• Pre- and early 2009 TRL reviews were not harmonised throughout thebusiness and with Airbus being global, the TRL panel would have differentcriteria
• This would lead to a TRL panel discussion based around the TRL structurequestion, NOT the Technology under assessment
TRL Panel
Criteria Airbus France
Criteria Airbus
UK
Criteria Airbus
Germany Technology Under Review: Snake Arm Robot
4
TRL4 Review
• Furthermore, research was conductedwithout assigning a direct customer for thetechnology and could typically consist ofmultiple internal customers
Airbus Pre-TRL Harmonisation
Technology Under Review: Snake Arm Robot
A400M
A320
A350
No Technology Customer
Investment
5
TRL Harmonisation within Airbus
• Since 2009 the TRL process has been successfully rolledout within Airbus in the form of a generic standardisedstructure
• The researcher has helped assist the successfulimplementation of this TRL structure, consulting whenrequired
6
Problem Definition
• However, since implementation of this standardised process, the researchercarried out a Delphi survey and concluded; when driving technologies fromTRL1 through to TRL9, the estimated costs and perceived tangible andintangible benefits involved when moving the technology forward are notcoherently quantified and qualified
• In an attempt to respond to this, a unique framework is under development tovalidate technology investment at each incremental TRL gate; TRLs 3-9
• The secondary output of the research involves the development of aknowledge based preliminary TRL and early TRL (TRL1-3) impactassessment framework using an expert system in the form of Fuzzy Logic
7
Problem DefinitionTotal Technology Investment
Total R&T Development
Cost
Manufacturing Implementation
Cost
Benefits to Manufacturing
System
8
Research Initial Approach-Cost Estimation
• While use for technical readiness is well understood, their application to costestimating still consists of a fragmented collection of factors and approaches
• External literature and industrial best practice benchmarking investigation wascarried out and concluded that the best approach to model the cost of each TRLlevel was the Parametric Cost Estimation Technique
• Data from various internal TRL reviews was then captured in order to try andgenerate the required Cost Estimation Relationships (CERs)
• However, on further analysis, when estimating for innovative technologies, historicaldata was not available and estimates became irrelevant and unreliable, generatingthe requirement for a more suitable process
10
New Research Approach-Cost Estimation
• In order to meet the business objectives, the conducted researchconcluded to use the Delphi Group Meeting Technique to estimate theinvestment costs at each TRL maturity gate
• This method is suited to each TRL review as the panel members willbe asked to estimate the cost to proceed to the next TRL level basedon the information given at the review itself (work breakdownstructure)
• The median estimate is then computed from the individual estimatesgiving the estimate output
12
Research Solution
• Development of a unique framework to assist manufacturing organisations in the technologyinvestment validation through manufacturing impact assessment at each of the laterincremental TRL gates, from TRLs 3-9
• At each post TRL3 incremental maturity gate the development costs are estimated
• The impact/benefit of the advanced manufacturing technology are quantified for application tothe applied manufacturing system (manufacturing customer application)
• Quantification at each TRL gate reduces investment, technological and performance risk;ensuring customer satisfaction, a crucial TRL factor
• The secondary output of the research intends to develop a knowledge-based preliminary TRLand early TRL (TRL1-3) impact assessment framework validating investment when costs andbenefits can’t typically be quantified
13
Framework Solution
Decision Making Development Advice from Impact Assessment Framework output compared to delta baseline- Manufacturing System Earned Readiness Management (when aligned to previous Case Base)
Technology Development Cost Estimate (Delphi
Wideband Technique)
Economic PerformanceTechnology Schedule
Available Funding Voice of Customer (QFD)- trade offs Risk
Manufacturing System Impact Matrix-
trade offs
TRL Review
Continue Development?
Decision Making Development Advice from Impact Assessment Framework output compared to Delta baseline- Manufacturing
System Earned Readiness Management (when aligned to previous Case Base)
Technology Development Cost
EstimateEconomic
PerformanceTechnology Schedule
Available Funding Voice of Customer (QFD)- trade offs Risk
Manufacturing System Impact Matrix-
trade offs
TRL Review
Stop Development?
14
Delphi Group Meeting Technique
Framework Breakdown
Technology Development Cost Estimate
Technology ScheduleRisk
•Each estimator independently creates an estimate, in this case eachmember of the TRL panel
•The median estimate is computed from the individual estimates giving theestimate output
15
Available Funding
Manufacturing System Impact
Matrix- trade offs
Voice of Customer (QFD)- trade offs
Framework Breakdown
16
• In order to look at the suitability of an economic impactof a selected technology a cash flow based evaluationmethod is carried out capable of comparing theeconomic effects of a technology compared to the deltabaseline reference within a common metric
• Net Present Value (NPV)• The Net Present Value measures the present
value of a sum of discounted cash flows in thefuture
• Break Even Point (BEP)• The point when the technology pays back its
investment cost by providing the required returnon investment
• Internal Rate of Return (IRR)• The Internal Rate of Return is equivalent to the
discount rate for which the NPV is equal to zero
Framework BreakdownEconomic
Performance
17
Knowledge Base &
Data Base
CONTINUE Development
DON’T Develop
Pre TRL Value Advice (Fuzzy Linguistic)
Preliminary and Early TRL Impact Assessment Knowledge Based Advisory System
Knowledge Refinement (Rule Induction)
Continue Development
Decision Making Development Advice from Impact Assessment Framework output compared to Delta baseline- Manufacturing System Earned Readiness Management (when aligned to previous Case Base)
Previous TRL Data Base Retrieval (Case Based
Reasoning)
NO Similar Cases
Similar Case (Validation of Technology Investment Value)
DON’T Develop
CONTINUE Development
Stop Development
Similar Cases
Initial Technology Selection
Technology Development Cost
EstimateEconomic
PerformanceTechnology Schedule
Available Funding Voice of Customer (QFD)- trade offs Risk
Manufacturing System Impact
Matrix- trade offs
TRL Review
18
Framework Solution
Preliminary and Early TRL Impact Assessment (Fuzzy Inference Forecasting System)
19
Conclusions
• The research initially focused heavily on literature byunderstanding the whole cost estimation domain andaligning with the TRL process
• This originally concluded that the most suitable techniquewas Parametric Cost Estimation
• However, since the discussed Delphi survey was carriedout, it became clear that this technique was not suited dueto technology diversity and lack of data
21
Conclusions
• Furthermore, technology managers require more than justthe cost of development and stated that clarifying thetangible and non tangible benefits coherently wouldsignificantly enhance the current TRL process
• To fulfil this requirement a technology impact assessmentframework is currently under development
• The data base and knowledge based advisory system willfurther the use of the toolset within the business bycapturing all technologies run through the TRL process
22
Future W ork
• Future work will initially focus on the developmentand validation of the TRL Review DevelopmentAdvice Framework
• The secondary research focus will concentrate on thedevelopment of the preliminary and early TRL fuzzyinference system
• Keen to discuss work further post conference
23