(3) Establish an FAA national air carrier training program office that provides training program oversight at the national level (Air Carrier Training Branch, AFS-210, Voluntary Safety Programs Branch, AFS-230).
(4) Require seconds-in-command (SIC) to satisfactorily perform their duties under the supervision of check airmen during operating experience (part 121, section 121.434(c)(2)).
(5) Require all training to be accomplished through a certificate holder’s training program.
(6) Provide for approval of training programs based on course content and training aids rather than specified programmed hours (SFAR 58).
(7) Require Cockpit Resource Management (section 121.404)(SFAR 58) training and encourage greater use of LOFT (section 121.409) (SFAR 58).
c. National Transportation Safety Board (NTSB). In June of 1988, the NTSB issued a Safety Recommendation (A-88-71) on the subject of CRM training. The recommendation was that all part 121 carriers review initial and recurrent flightcrew training programs. The purpose of this review was to ensure that the training programs include simulator or aircraft training exercises that involve cockpit resource management and active coordination of all crewmember trainees, and which permits evaluation of crew performance and adherence to those crew coordination procedures.
d. Part 121 subpart Y. In response to the recommendations from the joint task force and from the NTSB, the FAA, on October 2, 1990, published SFAR 58, which addresses the majority of the above recommendations. Part 121 subpart Y was released on October 1, 2005. AQP was also established to permit a greater degree of regulatory flexibility in the approval of innovative pilot training programs. Based on a documented analysis of operational requirements, a certificate-holder under AQP may propose to depart from traditional practices with respect to what, how, when, and where training and testing is conducted. This is subject to FAA approval of the specific content of each proposed program. Part 121 subpart Y requires that all departures from traditional regulatory requirements be documented and based upon an approved continuing data collection process sufficient to establish at least an equivalent level of safety. AQP provides a systematic basis for matching technology to training requirements and for approving a training program with content based on relevance to operational performance. An applicant may propose to replace certain requirements of 14 CFR parts 61, 63, 65, 121, or 135, with an AQP curriculum, subject to FAA approval. An AQP may also employ substitutes for the practical test requirements. Each requirement of parts 61, 63, 65, 121, 135 or the practical test standards (PTS) that is not specifically addressed in an approved AQP curriculum continues to apply to the certificate holder.
5. BENEFITS OF AQP. Although AQP is a voluntary program, the FAA Flight Standards Service encourages air carriers to participate. AQP provides for enhanced curriculum development and a data-driven approach to quality assurance along with the flexibility to target critical tasks during aircrew training. The AQP methodology directly supports the FAA’s goals for safety enhancement. The primary goal of AQP is to achieve the highest possible standard of
individual and crew performance. In order to achieve this goal, AQP seeks to reduce the probability of crew-related errors by aligning training and evaluation requirements more closely with the known causes of human error. For example:
a. Crew Performance. Most accidents are attributed to crew error. Traditional training programs focus on individual training and evaluation. Under AQP, the focus is on crew and individual performance in both training and evaluation.
b. CRM. Most accidents are caused by errors of judgment, communication, and crew coordination. Traditional training programs focus primarily on flying skills and systems knowledge. Under AQP, competence in flying skills and systems knowledge are integrated with CRM skills in training and evaluation throughout the curriculum.
c. Scenario-Based Training and Evaluation. Most accidents are caused by a chain of errors that build up over the course of a flight and which, if undetected or unresolved, result in a final, fatal error. Traditional training programs, with their maneuver-based training and evaluation, artificially segment simulation events in such a way as to prevent the realistic buildup of the error chain. Under AQP, both training and evaluation are scenario-based, simulating more closely the actual flight conditions known to cause most fatal carrier accidents.
d. Additional Benefits. Added benefits that are expected for individual applicants will vary, but may include:
(1) The ability to modify training curricula, media, and intervals.
(2) Crew evaluation as well as individual assessment.
(3) Improved standardization across fleets and flight personnel.
(4) Shift from programmed hours to proficiency-based training.
(5) Access to innovative training ideas and research.
(6) Opportunity to achieve more efficient training.
ORIGINAL SIGNED BY JOHN M. ALLEN
James J. Ballough Director, Flight Standards Service
CONTENTS
Page CHAPTER 1. AQP OVERVIEW
1-1. General1
1-2. AQP Objectives1
1-3. AQP Characteristics2
1-4. Equivalent Level of Safety and AQP Requirements2
1-5. Developmental Assistance and Support4
Figure 1-1. Other Resources6
CHAPTER 2. AQP DEVELOPMENT PHASES
SECTION 1. INTRODUCTION
2-1. Phases9
2-2. Instructional Systems Development (ISD)9
2-3. Training Systems10
Figure 2-1. AQP Phase Development Process10
SECTION 2. PHASE I: APPLICATION
2-4. Joint Meeting10
2-5. The AQP Application11
2-6. Approval13
SECTION 3. PHASE II: CURRICULUM DEVELOPMENT
2-7. Overview13
2-8. Job Task Analysis (JTA)14
Figure 2-2. Sample Pilot Job Task Listing16
2-9. Qualification Standards17
Figure 2-3. AQP Continuing Qualification Critical/Currency Chart19
Figure 2-4. Rating Scale for Procedures Validation, First-Look, Maneuvers Validation,
LOE, or Line Check23
2-10. Instructional Systems Development Methodology Document25
Figure 2-5. Curriculum Development26
2-11. Curriculum Outline Document27
Figure 2-6. Performance Difference Rating Scale28
Figure 2-7. Sample AQP Curriculum Outline29
2-12. Implementation and Operations Plan (I&O Plan) Document30
2-13. Approval32
SECTION 4. PHASE III: SMALL GROUP TRYOUT (IMPLEMENTATION)
2-14. Overview32
2-15. Approval33
SECTION 5. PHASE IV: INITIAL OPERATIONS
2-16. Overview33
2-17. Phase IV Activities33
2-18. Revisions34
2-19. Approval34
SECTION 6. PHASE V: CONTINUING OPERATIONS
Page
2-20. Overview34
2-21. Data’s Impact on Continuing Operations34
2-22. Quality Assurance34
SECTION 7. DOCUMENT AND REPORTING REQUIREMENTS
2-23. Overview34
Figure 2-8. Document Structures Chart38
CHAPTER 3. AQP CURRICULUMS AND CERTIFICATION
SECTION 1. CURRICULUMS
3-1. Background39
3-2. Indoctrination Curriculum39
3-3. Qualification Curriculum39
Figure 3-1. AQP Training, Validation & Evaluation43
Figure 3-2. AQP Validation/Evaluation Table44
Figure 3-3. Example of Qualification Curriculum Footprint45
3-4. Continuing Qualification Curriculum46
Figure 3-4. Example of an AQP Four-Day Continuing Qualification Curriculum
Footprint49
Figure 3-5. Continuing Qualification Cycle50
3-5. Secondary Curriculums52
Figure 3-6. AQP Secondary Curriculums52
SECTION 2. AIRMAN CERTIFICATION
3-6. General53
3-7. AQP Training and Evaluation for Certification54
3-8. Completion of the Qualification Curriculum54
CHAPTER 4. AQP APPROVAL AND DOCUMENTATION
SECTION 1. DOCUMENTATION REVIEW AND APPROVAL.
4-1. Overview55
4-2. Review Process55
4-3. Approval Process55
Figure 4-1. Five Phases of AQP Review and Approval56
4-4. Phase Approvals56
4-5. Method of Granting Approval59
4-6. Revision Control Process60
SECTION 2. WITHDRAWAL OF APPROVAL
4-7. General61
4-8. Initial or Provisional61
4-9. Final Approval61
4-10. Appeal Withdrawal of Final Approval61
Page CHAPTER 5. INSTRUCTORS AND EVALUATORS
SECTION 1. INSTRUCTOR/EVALUATOR PROGRAMS
5-1. General63
5-2. Instructor/Evaluator Curriculums63
5-3. Authorized Evaluation Personnel by AQP Event67
Figure 5-1. Authorized Evaluation Personnel by AQP Curriculum68
SECTION 2. CERTIFICATION PERSONNEL
5-4. Training68
5-5. Authorized Certification Personnel68
SECTION 3. QUALITY ASSURANCE AND STANDARDIZATION
5-6. Quality Assurance69
5-7. Standardization69
CHAPTER 6. TRAINING CENTERS
SECTION 1. INTRODUCTION
6-1. Background71
6-2. Training Centers Offering an AQP71
SECTION 2. PROVISIONAL APPROVAL: APPLICATION AND DEVELOPMENT
6-3. Provisional AQP71
SECTION 3. REQUEST AND APPROVAL FOR USE OF TRAINING CENTERS
6-4. Request72
6-5. Development72
SECTION 4. TRAINING CENTER’S INSTRUCTORS AND EVALUATORS
6-6. Qualification73
6-7. Instructor/Evaluator Curriculum Approval73
SECTION 5. DATA COLLECTION AND RECORDKEEPING
6-8. Data Collection73
6-9. Data Submission73
6-10. Recordkeeping73
CHAPTER 7. TRANSITION TO AQP
SECTION 1. OVERVIEW
7-1. General75
7-2. Entering AQP From an Established Training Program75
7-3. Transitioning to AQP Using the SVE75
SECTION 2. THE PETITION FOR EXEMPTION
7-4. General81
Figure 7-1. Single Visit Exemption Process (SVE)81
7-5. The Petition Process81
7-6. The Petition82
7-7. Granting of the Petition82
7-8. Renewal Requirements for the SVE83
Page SECTION 3. SVTP
7-9. Overview83
7-10. Contents83
7-11. SVTP Proficiency Check83
7-12. Approval of the SVTP84
7-13. Revisions84
7-14. Implementation of the SVTP85
7-15. Data Submission and Reporting Requirements85
7-16. SVTP Review Meeting85
Figure 7-2. Sample of Proficiency Check Fixed and Variable Maneuvers87
CHAPTER 8. AQP DATA MANAGEMENT
SECTION 1. INTRODUCTION
8-1. Overview89
8-2. Definitions89
SECTION 2. DATA MANAGEMENT
8-3. Overview90
8-4. Data Collection – SVTP & AQP90
8-5. Data Entry90
8-6. Data Submission91
SECTION 3. DATA ANALYSIS AND REPORTS
8-7. Overview92
Figure 8-1. Data Submission Requirements93
Figure 8-2. Performance Data Report Table (PDRT)95
Figure 8-3. Skill/Reason Table (SklRsn)98
Figure 8-4. Training Objectives Report Table (TORT)99
CHAPTER 9. CREW RESOURCE MANAGEMENT
SECTION 1. INTRODUCTION
9-1. Overview101
SECTION 2. INTEGRATING CRM INTO AN AQP
9-2. Scope of Integration101
9-3. CR/AQP Task List102
9-4. CRM Knowledge and Skills102
9-5. CRM and Proficiency Objectives102
9-6. Training Events103
9-7. Event Sets103
9-8. Source103
9-9. Curriculum Design104
9-10. Indoctrination Curriculum104
9-11. Qualification Curriculum104
9-12. Continuing Qualification Curriculum104
9-13. Line Operations and Proceduralized CRM105
Page ix (and x) Page SECTION 3. EVALUATING CRM
9-14. Overview105
9-15. Observable Behaviors105
Figure 9-1. Sample CRM Skills106
Figure 9-2. Sample Event Set Worksheet108
APPENDIX 1. DEFINITIONS (6 pages)1
APPENDIX 2. GENERIC AIRLINES ADVANCED QUALIFICATION PROGRAM
APPLICATION (2 pages)1
APPENDIX 3. REGULATORY COMPARISON CHART/PART OF THE
QUALIFICATION STANDARDS DOCUMENT (5 pages)1
APPENDIX 4. ADVANCED QUALIFICATION PROGRAM DOCUMENTATION
CHECKLIST AND REVIEW JOB AID (21 pages)1
APPENDIX 5. ADVANCED QUALIFICATION PROGRAM QUALIFICATION
STANDARDS DOCUMENTATION (6 pages)1
Par 1-1 Page 1 CHAPTER 1. AQP OVERVIEW
1-1. GENERAL. The Advanced Qualification program (AQP) integrates a number of training and evaluation features aimed at improving performance. AQPs are systematically developed, continuously maintained, and empirically validated proficiency-based training systems. They allow for the systematic analysis, design, development, implementation, evaluation, and maintenance of self-correcting training programs.
a. Phases of Development. There are five phases for developing, implementing, and maintaining an AQP. A description of each phase is located in Chapter 2. Each phase must be Federal Aviation Administration (FAA)-approved before the applicant may proceed to the next phase. Each phase consists of specific activities, including the documentation of those activities.
These documents must also be FAA-approved.
b. AQP Documentation. In addition to the supporting documents and manuals provided to the FAA in traditional training programs, there are six documents and an annual report requirement that is unique to AQP. The documents are instrumental in managing the AQP and must be maintained throughout the life of the program. The documents can be categorized in two groups, by their function and interrelationship: management and database. The documents, along with the annual report, comprise the Program Audit Database (PADB).
(1) Management Documents. These documents include the Application, Instructional Systems Development Methodology, and Implementation and Operations Plan. These documents are stand-alone in that a change in one will not necessitate a change in another.
(2) Database Documents. These documents include the Task Analysis, Qualification Standards, and Curriculum Outlines. Because a change to one often means a change to the others, it is recommended that they be maintained in an interactive database.
(3) Annual Report. The purpose of the report is to identify changes to the curriculums, training equipment upgrades, and the AQP Maintenance Strategy resulting from feedback and analysis of the information in the Performance/Proficiency Database (PPDB). Details of the report are found in Chapter 2, section 6, phase V: Continuing Operations.
1-2. AQP OBJECTIVES.
a. Support safe operations by continuously improving training and evaluation.
b. Remain responsive to continuing changes in the industry, including new aircraft technology, changing operational environments, and new training methods and equipment.
c. Remain responsive to continuing changes and best practices relative to training and evaluation.
Page 2 Par 1-3
1-3. AQP CHARACTERISTICS.
a. Participation is voluntary.
b. Employs innovative training and qualification concepts with the regulatory flexibility to tailor training to individual company circumstances.
c. Uses performance data to drive curriculum changes.
d. Qualification is based on individual and team performance, using progressive evaluations of proficiency objectives, and the structure and maintenance of all elements (curriculum, facilities, training equipment, instructors, evaluators, courseware, and quality assurance) of the program.
e. Data collection and analysis to empirically validate individual and team proficiency, and the AQP itself.
f. Training is systematically developed with an audit trail for all training and data requirements.
1-4. EQUIVALENT LEVEL OF SAFETY AND AQP REQUIREMENTS.
NOTE: AQP is a voluntary program that entails a strong commitment from the air carrier to exceed minimum trai ning standards in the greater interest of safety. To determine an equivalent le vel of safety of an airline’s AQP, the entire training system must be exam ined as a comprehensive whole rather than considering any one component in isolation. To ensure that the AQP does establish an initial justification and a continuing process to show an equivalent level of safety, mandatory requirements have been established.
Under an AQP, the FAA monitors the process as well as the product. Instead of basing curriculums on prescribed generic maneuvers, procedures and knowledge items, AQP curriculums are based on a detailed analysis of the specific job tasks, knowledge, and ski ll requirements of each duty position for the individual airline. Compared to traditional training programs, the AQP process provides a systematic basi s for establishing an audit trail between training requirements and training methodologies.
AQPs are systematically develope d, continuously maintained, and empirically validated, proficiency-based training systems. They allow for the systematic analysis, design, develo pment, implementation, progressive evaluation, and maintenance of self -correcting training programs that include integrated CRM, improved inst ructor/evaluator standardization, scenario-based evaluation, and a comprehensive data-driven quality assurance system.
Par 1-4 Page 3
a. Comply with all aspects of the approved AQP.
b. The processes used for development, implementation and maintenance of program operations will be continued throughout the life of the program.
c. Accommodate make, model, and series aircraft (or variant).
d. May build upon an existing training program or be completely new.
e. Provide three basic types of curriculums for every duty position; indoctrination (for new hires, new instructors, and new evaluators); qualification; and continuing qualification (see Figure 3-6). Specialty curriculums (transition, upgrade, requalification, refresher, etc.) will be derivatives from these basic types.
f. Duty positions to be covered must include all flight crewmember positions, instructors, and evaluators, and may include other positions, such as flight attendants, aircraft dispatchers, and other operations personnel.
g. Provide satisfactory justification to the FAA that the proficiency-based qualification of personnel under AQP meets or exceeds existing part 121 and/or part 135 standards.
h. Each applicable requirement of the PTS and part 61, 63, 65, 121, or 135 that is not specifically addressed in the AQP continues to apply to the certificate holder.
i. Document the requirements of the PTS and part 61, 63, 65, 121, or 135, as applicable, which would be replaced by an AQP curriculum.
j. The certificate holder must establish an initial justification and a continuing process to show how the AQP curriculum provides an equivalent level of safety for each requirement to be replaced.
k. Any training or evaluation that is satisfactorily completed in the calendar-month before or the calendar-month after the calendar-month in which it is due is considered to have been completed in the calendar-month it was due.
l. Curriculums must be based on an instructional systems development methodology. This methodology must incorporate a thorough analysis of the certificate holder’s operations, aircraft, line environment and job functions.
m. A list of, and text describing, the knowledge requirements, subject materials, job skills, and qualification standards of each task to be trained and evaluated.
n. A list of, and text describing, supervised operating experience, evaluation/remediation strategies, provisions for special tracking, and how recency of experience requirements will be accomplished.
Page 4 Par 1-4
o. All curriculums will include planned (not programmed) hours for ground training, flight training, evaluation, and operating experience.
p. Qualification and continuing qualification curriculums must integrate the training and evaluation of CRM/DRM and technical skills and knowledge.
q. Include line operational training (e.g., full crew LOS).
r. Use LOE or an equivalent evaluation under an AQP acceptable to the FAA for proficiency evaluations.
NOTE: Regardless of number of events sets, a crash (i.e., unsafe individual or crew performance that would result in significant damage, hull loss, or loss of life) during an LOE constitutes a failure of the LOE.
s. Integrate appropriate advanced flight training equipment. Flight-training devices and simulators will be used to support scenario-based training as appropriate.
t. Develop data collection and analysis processes in order to obtain performance information on crewmembers, dispatchers, instructors, evaluators, and other operations personnel that will enable the certificate holder and the FAA to determine whether the form and content of training and evaluation activities are satisfactorily accomplishing the overall objectives of the curriculum.
NOTE: The Voluntary Safety Program s (VSP) Branch, AFS-230, uses deidentified data for program moni toring not to monitor individual crewmember, dispatcher or other operations personnel.
u. Provide a Master AQP Transition Schedule (MATS) that provides a plan to transition from a traditional program to an AQP. In addition, the MATS should include a plan on how the applicant would return to a traditional program if that becomes necessary or desirable at some later date. This is not to imply that the traditional program must be kept current once AQP is entered, but only how the applicant would update the program and the timeframe needed for implementation.
1-5. DEVELOPMENTAL ASSISTANCE AND SUPPORT. Applicants may avail themselves of a wide range of support organizations, documents and services in the development of their AQPs. There is considerable support available from government and non-government sources. The total inventory of such support is constantly increasing, and the latest versions of all such support resources are always available by contacting AFS-230. The following is available directly from the FAA:
a. Flight Standards. AFS-230 is the primary support available to all AQP applicants and participants. This office includes a manager, aviation safety inspectors (ASI), instructional systems development specialists, and data management specialists dedicated to the support of AQP programs. This office works in conjunction with the principal operations inspector (POI)