National Academies Press: OpenBook
« Previous: References
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Appendices

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
This page in the original is blank.
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Appendix A Assessment Model

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
This page in the original is blank.
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

TABLE A-1 Customer Focus Category

Characteristics

Performance Level

Descriptions

Customer

Stage 1

The concept is not understood.

 

Stage 2

The focus is on the internal customer; attempts are made to align R&D with the needs of the internal customer.

 

Stage 3

The focus is on the external customer; the external customers' needs are determined by direct contact with scientists; the objective is to ''give them what they want''; Quality Functional Deployment is used to identify customer needs.

 

Stage 4

The focus extends to the soldier; R&D people spend time in the field to learn about the soldier's business; the objective is to "give them what they need."

Customer Satisfaction

Stage 1

Customer is dissatisfied with the strategy used to develop the product or service; appropriateness of the technological solutions; fulfillment of the operational capability requirements; technical capability, quality, and performance of the service or product; product cycle time and delivery time of the first equipped unit; technical support for fielded products developed at the RD&E organization; technical capabilities of the product or the service of the organization.

 

Stage 2

Customer is satisfied with the items listed in Stage 1.

 

Stage 3

Customer is very satisfied with the items listed in Stage 1.

 

Stage 4

Customer is delighted with the items listed in Stage 1.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Customer Involvement

Stage 1

Neither internal nor external customers are involved in program planning, evaluation, or early "results" (prototype) testing.

 

Stage 2

Internal or external customers are sometimes consulted on various aspects of the research program or are involved primarily in program reviews.

 

Stage 3

Internal customers are involved from time to time in setting program objectives and following progress; there are opportunities for customer feedback.

 

Stage 4

Customers feel completely involved, almost like partners; customers feel they can and do have a major impact in the life-cycle development of the product or service.

Market Diversification

Stage 1

Although diversification is an aspect of strategic and business plans, senior management has not effectively broadened the customer-base for products that are developed only for the Army; few joint service RD&E programs are in place.

 

Stage 2

RD&E programs provide products for the Army and the other uniformed services; the organization provides products to other federal agencies; some of the budget is devoted to developing partnerships with industry and academia.

 

Stage 3

The organization is assigned DoD lead on joint programs; a significant amount of the budget is devoted to developing partnerships with industry and academia; research partnerships yield products that fulfill military needs and fill a void in the needs of other federal agencies.

 

Stage 4

The organization's products serve a wide range of customers, including DoD, other U.S. government organizations, and global allies of the United States; much technology is transferred between the organization and the private sector; industry and academic partnerships result in the rapid transfer of technology between the organization and its partners; high quality products are developed, manufactured, and distributed to global customers.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

TABLE A-2 Resources and Capabilities Category

Characteristics

Performance Level

Descriptions

Organizational Culture

Stage 1

People are considered as statistics; there is a clear hierarchy depending on grade level; there is a need-to-know attitude.

 

Stage 2

People are valued but are perceived to be interchangeable; management makes some effort to be seen by the workers; high level information is shared with employees.

 

Stage 3

People are valued for their unique skills; grade level is no barrier to communication; all information except the most confidential information is available to the whole staff.

 

Stage 4

People are viewed as valued assets and are managed strategically; managers are trained in behavior modification to optimize their dealings with employees; management performance rewards includes rewards for developing people and communicating with employees.

Employee Attitude

Stage 1

The prevailing attitude is "all for one, me."

 

Stage 2

Employees are, willing to work hard for 40 hours/week; focus is on entitlements; some attempts are made to assess employee satisfaction.

 

Stage 3

Employees are anxious for the organization to succeed; employees are willing to make extra efforts to get work done; employees are willing to work on committees, represent the organization at professional societies, and travel on their own time; a formalized employee satisfaction process is in place but actions for improvement do not appear to be linked to the findings.

 

Stage 4

The concept of "technical vitality" is operative; individuals take responsibility for their own personal and professional growth; focus is on job satisfaction; a formalized employee satisfaction process is in place and is acted upon; a 360-degree feedback is used; developing subordinates is an accepted responsibility.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

People Development

Stage 1

No training or development programs are available; there is little encouragement for employees to improve their skills.

 

Stage 2

Training programs are left to the individual to pursue; training is secondary to service and is not fully budgeted.

 

Stage 3

Career development programs are in place; training is available at all levels and is given priority; cross-functional development opportunities are encouraged.

 

Stage 4

Interfunctional and international career opportunities are available; learning by teaching others is encouraged; training time is fully budgeted to avoid service conflicts; the faculty and students at internal training sessions are drawn from all levels of the organization; time off without pay is an option to get further training; off-site collaborations are used to expand knowledge.

Budget/Funding

Stage 1

Budgets are last year's plus inflation, at best; budgets are severely constrained; mid-year cuts in budgets are made common.

 

Stage 2

Major projects are constantly in jeopardy because of uncertainty in year-to-year funding; the number of new programs is limited; no new construction programs are funded.

 

Stage 3

Budgets are linked to strategy; budget levels are determined by customers in negotiation with R&D personnel; one-year time horizons with some following year expectations are typical; resources are leveraged through creative approaches, such as collaborations with industry and academia; management is knowledgeable about funding sources.

 

Stage 4

Budgets are strongly tied to the organization's strategy; budget levels are determined during strategy setting exercises; time horizons are three years; adjustments are made at the end of each year; a backlog of high-quality unfunded projects is maintained to take advantage of any funding that becomes available.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

RD&E Capabilities Skills, Talents

Stage 1

Technical skills, capabilities, and talents are inadequate to support current and future customer requirements; few new techniques and skills are acquired via new hire, continuing education or retraining of personnel; personnel cannot fully operate or maintain available equipment; continuing education is not promoted, encouraged, or funded.

 

Stage 2

Plans are developed and funding is provided for maintaining the present core capabilities; personnel are trained to operate and maintain equipment and use equipment as specified by the manufacturer; personnel skills are current and competent for their technical specialties.

 

Stage 3

The organization possesses the skills and talents to fulfill customer requirements for the foreseeable future; new and innovative techniques, skills, and processes are incorporated into RD&E processes; newly acquired skills result in improved product engineering, manufacturing, or performance; new personnel are recruited to bring state-of-the-art techniques into the organization; personnel are encouraged to participate in formal continuing education programs; members of the research staff are encouraged to participate in professional societies, serve on external committees, etc.; program managers recognize new skills that will benefit their programs and plan for the acquisition of these skills and talents.

 

Stage 4

The research and support staffs are recognized as possessing superb technical and administrative skills and talents; many members of the support staff are recognized as artisans of their trade; research personnel incorporate state-of-the-art techniques into their work and develop pioneering methods of their own; a clearly articulated plan describes how needs and voids in core capabilities are identified and filled; new capabilities that must be developed are also addressed and acted upon; a growing inventory of skills is maintained.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Intellectual Property

Stage 1

Intellectual property is considered the responsibility of the legal department.

 

Stage 2

Intellectual property is considered the responsibility of the technology people; modest recognition is given for patents regardless of value.

 

Stage 3

Issues become a shared concern for the organization and technology unit; selective patenting is facilitated by patent liaisons or people who have a good understanding of selection criteria.

 

Stage 4

Issues are addressed as part of the strategic planning process and are reviewed periodically; licensing is used to speed progress and learning.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Technology Sourcing

Stage 1

The organization relies on internally-developed technology; work is contracted out on an ad hoc basis with little or no planning; contract managers do not ensure that statements of work are fulfilled on time or on budget; no formalized processes are used to determine what work should be outsourced.

 

Stage 2

Working relationships with universities and other groups have been established; outside participation in professional associations is encouraged; there is no external technology sourcing process but there is a fit with the organization's plans; products and services are obtained from external sources to fulfill the statement of work.

 

Stage 3

Ongoing relationships with universities, other government labs, and private companies are viewed strategically; the organization is recognized as a "smart buyer" of services and work of other parties; clear make-vs.-buy decisions and criteria are established; outside work is managed in detail; the contribution of external work is clearly demonstrated and adds value and reduces cycle time to the organization.

 

Stage 4

Partnerships and contracts with organizations that are recognized as the best in their field complement RD&E programs and result in leap-ahead (and occasional breakthrough) technological advances; the organization takes a leadership role in professional societies; outsourcing is considered strategically; establishing alliances and collaborations is considered to be a critical competence; buy-manage-do decisions are based on an established process with clearly identified criteria.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Information Technology

Stage 1

Computer hardware and software are not available at every work station; software and hardware are two generations or more out of date; modes of communication are determined locally; access to hardware is determined by rank; training in a computer skill is left to the employee; employees are not linked electronically.

 

Stage 2

Information technology is used as a tool by research and support personnel, and it increases productivity and ultimately decreases the organization's overhead; acquisition of new hardware and software is adequately funded; training and technical support are available; employees are linked electronically internally and externally; universal systems are agreed upon; in-house training in computer skills is available.

 

Stage 3

An information technology strategy guides program direction; systems are more standardized and are up-to-date; computers are widely used by management; routine activities, such as keeping time records and expense accounts, are dealt with on line; networking is encouraged; employees are expected to have good information technology skills; technical support is abundant; the staff is educated in the use and application of the technology.

 

Stage 4

Information technology enables rethinking how RD&E is done; standard tools are used organization-wide; these tools are tailored to specific business applications; systems are used to share best practices, team charters, financial information, and project tracking.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Facilities and Infrastructure

Stage 1

Equipment and facilities are not well maintained and tend to be out-of-date; preventive maintenance is seldom performed; equipment is operated only in the daytime.

 

Stage 2

Facilities and equipment are satisfactory to meet current needs; there is a program for the routine maintenance and upgrading of equipment; some consideration is given to safety; shifts are adjusted to extend the time equipment can be used.

 

Stage 3

Safety is critically important in operating equipment, and the work environment is free of hazards; facilities are environmentally controlled year-round; equipment is modern and well maintained; budgets allow for preventive maintenance, upgrading, and replacement of equipment; the use of the equipment is extended by electronic monitoring.

 

Stage 4

Facilities and equipment are state of the art; inspection and training opportunities are considered important; there is pride in the appearance and safety/regulatory records; safety/regulatory capability is recognized externally; equipment is in use most of the day, and much of it is operated around the clock by electronic monitors.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

TABLE A-3 Strategic Vision Category

Characteristics

Performance Level

Descriptions

Mission and Vision

Stage 1

Mission and vision statements are not well articulated or linked; senior management has trouble communicating the mission and vision.

 

Stage 2

There is a discontinuity between function in (the mission and vision are clear to some but not to others); the mission statement is a wish list but does not address how the technical expertise is to be acquired; an attempt is made to develop a technology mission and vision statement.

 

Stage 3

The mission and vision are consistent, and the message is clear to most employees; there is a tendency to want to be all things to all people; the mission and vision provide a "guide to action" for technical programs.

 

Stage 4

There is a shared understanding of the mission and vision throughout the organization; technology is understood to contribute to shaping long-term strategy; core technologies are characterized and are consistent with mission and vision; resources are aligned with the research strategy.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Strategic Plan

Stage 1

There is no plan, only a portfolio of projects.

 

Stage 2

A strategic planning process identifying the organization's role within the Army's strategic plan and within the organization is in place; senior management enlists the support of research and support staff to draft and implement the strategic plan through the business and annual plans; information on long-term customer needs is inadequate; a technology plan has been added after the fact.

 

Stage 3

The fit of projects with the Army and organization's strategic plans is clear and operational; guides are used for prioritizing project within the function; the strategic plan is driven by organization's strategy; the plan details how the organization will achieve its objectives; technology management is invited to provide input to the strategic plan.

 

Stage 4

The plans for all functions are fully integrated; plans include manpower, information technology, and budget and timing; plans specify the development path for product, process, and support technologies; the planning horizon for the strategic plan is sufficient to anticipate the major needs of the Army and joint services; technology management is an integral aspect of the business strategy.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Stakeholder Buy-In

Stage 1

The strategic vision and research plan either have not been communicated to the RD&E stakeholders or have not been articulated well and are misunderstood; stakeholder response to the vision and research plan is either negative or indifferent.

 

Stage 2

A strategic vision is spelled out and understood by most stakeholders; the vision makes all major initiatives readily understandable.

 

Stage 3

The strategic vision ''speaks'' to all stakeholders, even if they have not been involved in creating it; customers and disinterested parties understand the research plan and advocate providing adequate resources to implement the plan.

 

Stage 4

The strategic vision is so clearly articulated that stakeholders lobby Army and DoD planners to implement the research plan fully; stakeholder support for the organization's vision and the research plan is so strong that resources are reprogrammed from other accounts to implement the vision.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Leadership

Stage 1

The commitment of the senior leadership to the strategic vision or research plan is poorly communicated to the staff; administrative and product development managers are not involved in planning the direction of future research or developing the business plan; personnel are suspicious or do not trust the organization's leadership; stakeholders view the senior leadership as ineffectual and reactive.

 

Stage 2

The strategic vision and research plan are understood by the staff; resources (i.e., time, personnel, and dollars) are aligned to meet these plans; the staff trusts senior leadership and is receptive to new ideas and reengineering opportunities.

 

Stage 3

Management and staff co-develop plans that are understood and embraced by staff and stakeholders alike; ideas flow freely and in both directions between management and staff.

 

Stage 4

The leadership has created an air of excitement and commitment throughout the entire organization; bold and creative ideas are encouraged and funded; RD&E successes are rapidly exploited, and ideas are rewarded; failure is considered an opportunity to learn.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

TABLE A-4 Value Creation Category

Characteristics

Performance Level

Descriptions

Portfolio Selection

Stage 1

There is no project planning or monitoring and little interfunctional participation in project teams; products are developed that do not meet customer needs because of little customer input.

 

Stage 2

An analytical process to examine the product portfolio is used to design and field products that have greater value and customer acceptance; a major focus is the expansion of successful business areas; the organization is risk averse so new research approaches are not encouraged and major changes are made to products after they have been introduced.

 

Stage 3

Portfolio analyses of programs are an integral part of the strategic planning process; there is broad and active customer involvement in the portfolio analysis; risk analysis is incorporated at key phases; projects are schedule driven; criteria are in place for go/no go decisions; there are regular milestone reviews of projects; probability of success is built into the portfolio process, identifying clear values and trade-offs, as is a prioritization process.

 

Stage 4

Project analysis involves framing the project, identifying alternatives, and making a commitment to action; decision and risk methodologies are used frequently; linkage between criteria and business strategy and line strategy is clear; portfolio analyses result in RD&E processes that yield products and services with excellent value, performance, and customer acceptance.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Cycle Time and Responsiveness

Stage 1

The cycle time for project completion is longer than anticipated, milestones are routinely missed, and program delays result in increased end-item cost; research programs do not anticipate customer needs; management and staff are not flexible to modifications of product requirements.

 

Stage 2

The elapsed time from project initiation to project completion is measured and can be reliably forecasted; research programs are on time and on budget.

 

Stage 3

RD&E programs are initiated and completed significantly faster than similar government or commercial programs; research staff is responsive to "quick fixes," and numerous examples of quick fixes to major products are readily available; senior management ensures that adequate resources are reprogrammed to fulfill requests for quick fixes.

 

Stage 4

RD&E programs are initiated and completed quicker than similar government or commercial programs; innovative processes and technical solutions reduce typical quick-fix response times by nearly half; staff monitors foreign and domestic industrial and academic research for solutions to new and unanticipated technical problems; customers directly and indirectly express gratitude for responsive quick fixes.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Value of Work in Progress

Stage 1

No evaluations of historical RD&E programs are available for comparison to current programs; no methodology is in place to assess current RD&E programs; customer perception of prior RD&E programs is predominantly critical and negative; little or no value is placed upon the current programs by the customers.

 

Stage 2

A database on select historical RD&E programs and all current programs is available; current RD&E programs are vividly described, and these descriptions are used during peer-review discussions to justify programs and prioritize personnel and budget requests; customer perception of prior and current RD&E programs is generally positive (i.e., the products and services generally meet user requirements and are delivered on time and on budget).

 

Stage 3

A database is maintained on all past major projects (e.g., for the last decade) and their primary and secondary impacts; the database is used for comparison with current RD&E programs; leadership creates a scale to compare the potential value of current programs to previous programs and show improvements; customers rate RD&E programs as very good (i.e., products are expected to fully meet or exceed customer requirements; products are perceived as likely to be better than the ones they replace).

 

Stage 4

A complete historical database and evaluation methodology are used to demonstrate the value of the organization's products and services; data are used to justify and defend program expenditures; customers rate products and services as excellent (e.g., product performance exceeds customer expectations); product performance exceeds anything projected to be available from domestic and foreign sources for at least several years.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

TABLE A-5 Quality Focus Category

Characteristics

Performance Level

Descriptions

Capacity for Breakthroughs

Stage 1

RD&E programs are routine and unimaginative; there is no evidence of imaginative or innovative solutions being applied to RD&E tasks; resources are directed to meeting specific customer requirements only.

 

Stage 2

RD&E programs are characterized by steady but incremental improvement; several innovative solutions can be pointed out; minimal funding is available for programs that anticipate future military requirements.

 

Stage 3

Although most programs are characterized by incremental improvements in technology, the organization has demonstrated several leap-ahead improvements; the organization encourages and funds opportunities to seek truly innovative, moderate-risk solutions.

 

Stage 4

Unexpected innovations based on breakthroughs in technology occur fairly regularly among internal and external (cooperative) RD&E programs; moderate-and high-risk research that offers high return receives stable funding; numerous examples of breakthrough research are cited from the previous five to ten years.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Continuous Improvement

Stage 1

No apparent effort is made by management to improve processes; solutions from industry and academia are discounted as "not invented here."

 

Stage 2

A quality model has been adopted but is not universal; innovative solutions are encouraged, and staff members frequently make suggestions for improvement; some training is offered; ideas for improvement are solicited and acted upon.

 

Stage 3

Learning from others is encouraged; quality audits are performed periodically by internal and external review groups; report cards are issued annually by senior leadership; external surveys are conducted; ISO 9000 certification is widely sought; internal quality assessments are used.

 

Stage 4

Greater productivity, enhanced research and product quality, improved customer involvement and satisfaction, and continuing education of the workforce are areas of primary interest to senior management; there is a systematic analysis of research and support processes to eliminate non-value-added activities; benchmarking is used proactively; best practices are shared; focus is on the external customer; the Baldrige National Quality Award criteria are used to drive improvements in performance.

Teams

Stage 1

There is frequent turnover of team staffing; project leaders are not trained and their roles are not defined; charters for teams are not clear.

 

Stage 2

There is some interfunctional participation; teams are mostly stable but run into conflicts with functional priorities; project leaders are given some guidance; teams have formal charters.

 

Stage 3

Interfunctional teams are used when needed; responsibility are delegated to teams; training for project leaders is provided; charters are published widely; a process is in place to facilitate interteam communications.

 

Stage 4

Teams are critical to success; there are rewards for team performance; teams are often self-managed.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Evaluation and Rewards

Stage 1

The process is a mystery.

 

Stage 2

There are no meaningful rewards except for salary increases; there is no correlation between rewards and performance level.

 

Stage 3

Written evaluations and periodic reviews are utilized; focus is on improvements in performance; rewards and recognition relate to performance; recognition is given for suggestions and ideas.

 

Stage 4

Multilevel feedback is used to focus on improvement; team and individual awards are given; a single committee makes decisions on salaries, rewards, and promotions for all business functions.

Project Management

Stage 1

Each project is treated as a new experience; the management process is ad hoc.

 

Stage 2

Several stage-gate models1 are used on most projects; the process itself is not reviewed.

 

Stage 3

A uniform approach to project management is used; a strong focus is on up-front planning; reducing cycle time is an important factor; some projects are reviewed, but there is no ongoing use of reviews to improve the process.

 

Stage 4

A standard methodology is used for all projects and is widely accepted; the methodology is applied to widely different projects; the inclusion of new technology is encouraged; each project is considered to be a learning opportunity, and there are formal ways to modify the process.

1 A stage-gate model divides a process (like a product development model) into several subprocesses. At the end of each subprocess is a "gate." Before passing through the gate, certain requirements must be met. Once those have been met, the organization can move to the next subprocess, which has its own gate. An efficient organization has a single stage-gate model, the benefit of which is that each team can learn from the prior team's experience.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Regulatory Compliance

Stage 1

Management shows no interest in complying with regulations; the prevailing attitude is "do what you can get away with."

 

Stage 2

Formal policies are in place; internal audits are used to enforce compliance.

 

Stage 3

A strong effort is made to comply; an organizational policy is in place that is supported by management's actions.

 

Stage 4

Well publicized organizational ethics provide overall guidance; proactive efforts are made to protect the environment; management takes the lead in regulatory compliance.

Commitment to Quality

Stage 1

Management espouses a commitment to quality, but no formal process to review and evaluate quality is in place; some quality-related results are managed by exception; the quality of products and services varies between RD&E units in the organization.

 

Stage 2

Management invests resources for total quality training and implementation; the variability of products and services is measured and tracked; personnel are aware of the importance of quality.

 

Stage 3

Total quality implementation is a major goal in the organization's strategic plan; a framework and methodology for measuring and assessing quality is in place; measurable objectives for work-process improvement are established; there are methods (e.g., statistical process controls) to improve effectiveness and product quality with existing resources.

 

Stage 4

The commitment to total quality is inherent and pervasive throughout the organization; the focus of all measurements is on optimizing the RD&E processes to deliver value; frameworks, such as ISO 9000/2 (international quality standards), the Baldrige National Quality Award criteria, or locally developed systems, are used for assessment; recommendations to improve quality are immediately funded and implemented.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Process Management

Stage 1

The focus is not on core processes; activities are thought to be unrelated processes with no clear priorities.

 

Stage 2

Some important processes emerge from the profusion of activities; some processes are managed systematically; processes are monitored against budgets and milestones.

 

Stage 3

There is a high-level overview of the key processes; processes are prioritized; process performance is judged against external standards and internal milestones; senior leadership and staff are receptive to innovative ideas for improving work processes and procedures.

 

Stage 4

Process management is well established and accepted; processes are recognized at the organizational level, the process level, and the job level; links between levels unify the strategy throughout the organization; the senior leadership strives to identify and incorporate best business practices into the organization.

Metrics

Stage 1

Focus is on the short term.

 

Stage 2

Measures include customer satisfaction; the goal is to ensure that customer requirements are met; the search is for "the few key measures" of progress toward that goal.

 

Stage 3

A variety of measures linked to the corporate goals are used; the organization recognizes that different measures are needed for different purposes; measures related to cost, time, and quality are used.

 

Stage 4

A balanced list of measures is used to ensure that all key aspects of the organization are considered including financial, external and internal customers, innovation and learning and societal perspectives; the emphasis is on measuring customer value.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Safety

Stage 1

Safety is not fully addressed; employees are chastised for accidents.

 

Stage 2

Safety is said to be important, but management does not ''walk the talk,'' and little thought is given to safety training.

 

Stage 3

Managers "walk the talk"; safety awards are given for group successes; organizational standards are posted and compared to industry standards.

 

Stage 4

Safety issues are addressed as part of strategic planning; employees receive behavioral modification training; safety is addressed at every management meeting; employees take pride in their safety records.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×

Characteristics

Performance Level

Descriptions

Knowledge and Learning

Stage 1

Senior leadership is characterized as reactive; knowledge as an asset is not recognized; knowledge tends to be associated with degree level.

 

Stage 2

Senior leadership recognizes and communicates the importance of organizational learning; personnel are well networked both inside and outside the organization; best practices are shared within functions but not beyond; knowledge tends to be associated with level in the company; new skills and techniques are acquired through new hires and continuing professional education.

 

Stage 3

Organizational learning is characterized as adaptive; the need for sharing best practices is recognized; personnel are rewarded and encouraged for taking risks and entrepreneurial initiatives despite occasional mistakes; systems are in place to promote information-sharing; there are rewards for proactive information-sharing; employees are encouraged to take risks and are not chastised for failures.

 

Stage 4

The concept of a "Learning Organization" is understood and valued by management; organizational learning is adaptive and anticipatory; the organization works to differentiate itself on the basis of the tacit and specific knowledge of its people; attempts are made to quantify the value of intangible assets.

Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
This page in the original is blank.
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 57
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 58
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 59
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 60
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 61
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 62
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 63
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 64
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 65
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 66
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 67
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 68
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 69
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 70
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 71
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 72
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 73
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 74
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 75
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 76
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 77
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 78
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 79
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 80
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 81
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 82
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 83
Suggested Citation:"Appendix A: Assessment Model." National Research Council. 1998. Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center. Washington, DC: The National Academies Press. doi: 10.17226/6316.
×
Page 84
Next: Appendix B: Biographical Sketches of Committee Members »
Review of Mass Spectrometry and Bioremediation Programs of the Edgewood Research, Development and Engineering Center Get This Book
×
Buy Paperback | $38.00
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF
  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!