Par 5-2 Page 64
(d) Overview of AQP program development, implementation, and operation policy.
(e) Lesson preparation and application.
(f) Classroom instructing techniques.
(g) Techniques for instructing in the cockpit environment.
(h) Standardization and rater/referent reliability.
(i) Resource management (Crew Resource Management (CRM)/dispatch resource management (DRM)) and human factors training.
(j) How to conduct training modules for students with varying backgrounds and varying levels of experience and ability.
(k) Instructor responsibilities.
(2) Instructor Qualification Curriculum.
(a) Effective use of, and qualification in, specific Flight Training Devices (FTD), flight simulators, and aircraft.
(b) Limitations on use of training equipment.
(c) Evaluation of performance against objective standards.
(d) Effective preflight and postflight instruction.
(e) Effective analysis and correction of common errors.
(f) Teaching/facilitation of CRM/DRM skills.
(g) Performance and analysis of standard flight events and procedures.
(h) Safety considerations in the training environment.
(i) Data-gathering procedures.
(j) Standardization and rater/referent reliability.
(3) Differences Between Traditional and AQP for Existing Instructors.
(a) Overview of AQP program development, implementation, and operation policy.
(b) CRM/DRM and human factors training.
Par 5-2 Page 65
(c) Standardization and rater/reverent reliability.
(d) Data-gathering procedures.
(e) Effective use of, and qualification in, specific FTDs, flight simulators, and aircraft used in the AQP.
(f) Limitations on use of training equipment used in the AQP.
(g) Evaluation of performance against objective standards.
(4) Evaluator Indoctrination Curriculum.
(a) Evaluation policies and techniques.
(b) The role of the evaluator.
(c) Administrative procedures.
(d) General safety considerations.
(e) Evaluating human factors and CRM/DRM skills.
(f) Standardization and rater reliability.
(5) Evaluator Qualification Curriculum.
(a) For each crewmember position requiring a particular evaluation the method of conducting:
1. Line check.
2. In-flight proficiency evaluations if required.
3. Proficiency evaluations in flight simulators and/or flight training devices.
4. Special purpose evaluations (e.g., long-range navigation).
(b) The standards for the evaluations in the previous paragraph.
(c) The methods and standards associated with airman certification evaluation.
(d) How to conduct evaluations while simultaneously serving as pilot in command (PIC), second in command (SIC), or safety pilot.
(e) Safety considerations for the various types of evaluations.
(f) Safety considerations particular to the make, model, and series aircraft (or variant).
Par 5-2 Page 66
(g) How to evaluate instructors/evaluators.
(h) Company/FAA policies with regard to the conduct of evaluations.
(i) Administrative requirements particular to evaluations.
(j) Evaluating CRM/DRM skills.
(k) Briefing and debriefing techniques.
(l) Data-gathering procedures.
(6) Differences Between Traditional and AQP for Existing Evaluators.
(a) Overview of AQP program development, implementation, and operation policy.
(b) CRM/DRM and human factors training/evaluating.
(c) Standardization and rater reliability.
(d) Data-gathering procedures.
(e) Effective use of, and qualification in, specific flight training devices, flight simulators, and aircraft used in the AQP.
(f) Limitations on use of training equipment used in the AQP.
(g) Evaluation of performance against objective standards.
(h) Briefing and debriefing techniques.
(i) How to evaluate instructors/evaluators.
(j) Company/FAA policies with regard to the conduct of evaluations.
(k) Administrative requirements particular to evaluations.
c. Qualification—Evaluation and Observation. Every instructor/evaluator must receive a validation/evaluation at the end of each curriculum. These methodologies must be described in the test and evaluation strategy within the instructor/evaluator qualification standards. The required FAA observation of new instructors/evaluators (check airman) is delineated in Order 8900.1.
d. Continuing Qualification. Instructors/evaluators should be given an opportunity to operate in all positions in which they are authorized to perform duties. Flight instructors/evaluators should demonstrate the ability to brief and debrief, fly and instruct in both pilot seats and operate the simulator, if appropriate. If possible, instructors/evaluators should focus on the training, validations and evaluations that are under development for the next evaluation period. This will allow the instructors/evaluators to become familiar with all aspects
Par 5-2 Page 67 of the periods they will be expected to teach/evaluate the following year, help ensure the development of a polished continuing qualification program and give the instructors/evaluators an opportunity to maintain their own proficiency using scenarios they have not seen. Each training period should be conducted by one of a small core of the most experienced instructors/evaluators. Each instructor/evaluator continuing qualification curriculum segment should include the requirements listed below. Requirements (subparagraphs (3) and (4) below) should be defined in the test and evaluation strategy in the instructor/evaluator qualification standards:
(1) Basic crew position and or specialized flight instructor/evaluator continuing qualification.
(2) Ground and flight training to enhance, upgrade, and maintain each instructor/evaluator’s knowledge, skills, and abilities.
(3) A schedule for recency of instructor/evaluator’s experience.
NOTE: The program must define the minimum requirements each category of instructor/evaluator will accomplish to stay current in their position.
Instructors must maintain a high level of competency, so the minimum standard must be sufficient to maintain their proficiency. Evaluators will perform an established minimum number of each validation/evaluation that they are qualified to administer.
(4) A schedule for critical examination of each instructor/evaluator’s abilities and adherence to prescribed standards.
e. Instructor and Evaluator CRM Training and Evaluation. All instructors and evaluators will receive instruction and evaluation in CRM/DRM objectives and training methods, as appropriate.
5-3. AUTHORIZED EVALUATION PERSONNEL BY AQP EVENT. The table in Figure 5-1 illustrates the level of authorization needed for an individual to either train, validate, or evaluate an AQP event.
Par 5-3 Page 68 FIGURE 5-1.
AUTHORIZED EVALUATION PERSONNEL BY AQP CURRICULUM
FLIGHTCREW QUALIFICATION CURRICULUM Event Instructor Evaluator Designee FAA Inspector Knowledge validation Yes Yes Yes Yes Procedures validation Yes Yes Yes Yes Maneuvers validation No Yes Yes Yes LOE For Qualification No Yes Yes Yes LOE For Certification No No Yes Yes Operational Experience No Yes Yes No Line Check No Yes Yes If qualified* * Title 14 CFR part 135 operations only
FLIGHTCREW CONTINUING QUALIFICATION CURRICULUM Event Instructor Evaluator Designee FAA Inspector LOFT/Maneuvers Training Yes Yes Yes No Maneuvers Validation No Yes Yes Yes LOE No Yes Yes Yes Line Check No Yes Yes If qualified* * Title 14 CFR part 135 operations only SECTION 2. CERTIFICATION PERSONNEL
5-4. TRAINING. Historically, aviation safety inspectors (ASI) and APDs certified airmen using a maneuver-based evaluation scenario derived from the practical test standards (PTS).
AQP replaces the traditional maneuver-based certification check ride with a scenario-based Line Operational Evaluation (LOE). Due to the unique characteristics and detailed scripting of LOEs, all personnel approved to conduct certification are required to complete AQP evaluator training.
This training may consist of the indoctrination and qualification curriculums for new personnel, or a differences module for ASIs and APDs who are already qualified under the operator’s traditional program.
Par 5-5 Page 69
5-5. AUTHORIZED CERTIFICATION PERSONNEL. Principal Operations Inspectors (POI) will only authorize ASIs, APMs, or TCPMs, Air Carrier Designated Examiners (ADE), APDs, Airline Transport Pilot Examiners (ATPE), or qualified Training Center Evaluators (TCE) who have completed the prerequisite AQP evaluator training to conduct pilot examination activities. Only the following personnel may be authorized signatory authority on side two of FAA Form 8710-1, Airman Certificate and/or Rating Application, Supplemental Information and Instructions:
a. APM or TCPM. Must be current and qualified on the make, model, and series of aircraft and have attended the particular operator’s AQP evaluator qualification or differences training program, as appropriate. Any APM and TCPM who conducts an AQP evaluation must complete the same proficiency, currency, and continuing qualification training requirements as the operator’s evaluators (check airmen), with the exception of line checks. An APM/TCPM’s responsibilities under an AQP remain as specified in Order 8900.1.
b. ASI. Must be current and qualified on the make, model, and series of aircraft, and have attended the particular operator’s AQP evaluator qualification or differences training program, as appropriate.
c. APD and Training Center Evaluator. Must be current and qualified on the make, model, and series of aircraft and have completed the particular operator’s AQP evaluator qualification or differences training, as appropriate, and maintain continuing evaluator qualification. The FAA will designate APDs and TCEs, and their special training will be noted on FAA Form 8710-6, Examiner Designation and Qualification Record, Block 10. Each APD must comply with the requirements outlined in Order 8900.1. Each TCE must comply with the requirements specified by the Administrator for such personnel.
d. ATPE. Must be current and qualified on the make, model and series of aircraft and have completed the particular operator’s AQP evaluator qualification or differences training, as appropriate, and maintain continuing evaluator qualification under the particular operator’s AQP.
ATPEs must be authorized by the FAA to conduct such evaluations.
SECTION 3. QUALITY ASSURANCE AND STANDARDIZATION
5-6. QUALITY ASSURANCE. To continuously improve the quality of AQP training, an AQP applicant should develop a quality assurance program to continually evaluate training programs, instructors, and evaluators. The most experienced personnel should staff the program. Their duties would include observing training, validation, and evaluation events in order to:
a. Critique performance.
b. Recommend change.
c. Provide feedback to the entire training organization at regular intervals.
5-7. STANDARDIZATION. A standardization program is necessary to establish uniform grading criteria, address reliability between instructors/evaluators, and develop remediation
Par 5-7 Page 70 procedures. The AQP data collection and analysis is incumbent upon reliable and valid instructor/evaluator grading judgments. The program must provide rater reliability training during the qualification, continuing qualification and differences curriculums. There are numerous techniques currently used to address rater reliability. The FAA is involved in research to define acceptable methodologies. Examples are available on the Flight Operational Quality Assurance (FOQA)/AQP website.
Par 6-1 Page 71 CHAPTER 6. TRAINING CENTERS SECTION 1. INTRODUCTION
6-1. BACKGROUND. This chapter provides guidance to any certificated Title 14 of the Code of Federal Regulations (14 CFR) part 142 training center or 14 CFR part 119 certificate holder that intends to provide training, qualification, or evaluation for a part 121 or part 135 certificate holder’s Advanced Qualification Program (AQP). For the purposes of this chapter, a training center is any entity that offers training to a certificate holder by contract or other arrangement.
14 CFR part 121 subpart Y, Advanced Qualification Program, allows certificated air carriers seeking to accomplish training under the AQP to employ the services of a training center for that purpose.
6-2. TRAINING CENTERS OFFERING AN AQP. A training center that applies to offer an AQP curriculum for a specific part 121 or 135 air carrier may be approved under AQP regulatory guidance to provide such training to that specific carrier. There are two types of training centers that may offer AQP.
a. Certificated Part 142 Training Centers. An entity other than a part 121 or 135 certificate holder may offer an AQP program to air carrier certificate holders. In this case, they are offering an approved, generic AQP with operator specific training to be incorporated into the final product. Any entity serving in this capacity must have been certificated under part 142 after August 2, 1998. Any training program for pilots, instructors, or evaluators approved under AQP is automatically approved under part 142, regardless of whether that approval occurs before or after August 2, 1998.
b. Certificated Air Carrier. A part 121 or 135 certificate holder may offer a previously approved AQP to other certificate holders. In this case, they are offering their approved AQP with operator-specific training to be incorporated into the final product.
SECTION 2. PROVISIONAL APPROVAL: APPLICATION AND DEVELOPMENT
6-3. PROVISIONAL AQP. The major difference between the development of an AQP by a training center and by an air carrier is that the training center can develop generic AQP documentation and individual curriculum segments through Phase II. This documentation is given a provisional approval. A provisional AQP allows a training center to accomplish front-end AQP development through Phase II and to offer its services as an approved AQP provider before establishing a contract or other arrangements with a specific certificate holder.
a. Additional Development. A provisional AQP cannot be employed for use with a specific certificate holder without additional development to tailor the program to the needs of a specific air carrier.
Par 6-3 Page 72
b. Multiple Provisional AQPs. Training centers should consider developing multiple provisional AQPs to shorten the time required to adapt the AQP to the needs of an air carrier. For example:
(1) Types – different makes, models, series.
(2) Trainee demographics – low-time versus high-time pilots.
(3) Flight operations – short haul regional airlines versus long haul major airlines or supplemental air carriers.
SECTION 3. REQUEST AND APPROVAL FOR USE OF TRAINING CENTERS
6-4. REQUEST. A certificate holder that wishes to use a training center for AQP training must submit a Letter of Request directly to the manager of the appropriate Safety Standards office, with a copy to the Principal Operations Inspector (POI) and Training Center Program Manager (TCPM). The letter of request should specify the training center, identify the AQP curriculum, and cite the time frame for which such AQP services would be conducted.
6-5. DEVELOPMENT. The AQP analysis and documentation required for a training center to obtain approval to conduct an AQP for a specific certificate holder is similar to that which would be required of an air carrier.
a. Documentation. All documentation must be consistent with the multi-phased development process outlined in this guidance, and must be specific to the certificate holder for whom such training will be conducted.
b. Extended Review Team (ERT). AQP documentation developed by a training center for a specific certificate holder will be submitted directly by the training center to the manager of the appropriate Safety Standards office for review and approval. The manager of the appropriate Safety Standards office will form an AQP ERT, to include the certificate holder’s POI, the TCPM, and such other personnel as may be appropriate.
c. Notification of Approval. The manager of the appropriate Safety Standards office and the POI/TCPM will notify the certificate holder by a joint letter of approval for the training center to conduct AQP training.
(1) For an air carrier, approval for use of the AQP, to include reference to any FAA-specified conditions and limitations, is entered by the POI into the certificate holder’s operations specifications (OpSpecs).
(2) Following receipt of notification of approval, the TCPM will notify the training center that it has FAA approval to conduct an AQP program for a specific certificate holder.
Par 6-6 Page 73 (and 74) SECTION 4. TRAINING CENTER’S INSTRUCTORS AND EVALUATORS
6-6. QUALIFICATION. Training center instructors and evaluators are subject to the same training requirements as discussed in Chapter 5.
6-7. INSTRUCTOR/EVALUATOR CURRICULUM APPROVAL. Training centers seeking to offer an AQP curriculum to certificate holders must obtain approval of their AQP qualification and continuing qualification programs for instructors and/or evaluators.
a. Documentation. The documentation required for such approval is similar to that required for certificate holders, except that training centers may obtain provisional approval of AQP instructor and evaluator AQP documentation through AQP Phase III.
b. Notification. Notification of provisional approval for instructor and/or evaluator AQPs is initiated by the manager of the appropriate Safety Standards office and follows the same process as identified in paragraph 6-5.
SECTION 5. DATA COLLECTION AND RECORDKEEPING
6-8. DATA COLLECTION. Part 121 or 135 certificate holders who obtain an approved AQP through a training center are responsible for verifying compliance with all of the requirements of their approved program, and for reviewing the results of the data collection and analysis on a continuing basis. AQP data collection, analysis, and reporting requirements for training center-administered AQPs are identical to those that apply to AQPs administered by individual certificate holders for their own employees.
6-9. DATA SUBMISSION. Either the training center or the certificate holder may transmit the required data to the FAA. The party that is delegated for this action must be clearly identified in the training center’s approved AQP Implementation and Operations Plan (I&O Plan) for a specific air carrier. The certificate holder is responsible for complying with the requirements contained in this advisory circular (AC) that pertain to the submission of AQP data to the FAA.
6-10. RECORDKEEPING. AQP recordkeeping is identical to that required under traditional parts 121, 135, and 142 training programs. However, for AQP, records must clearly indicate that the training employed to qualify pilots, other flightcrew members, instructors, or evaluators was accomplished under an AQP curriculum. When a certificate holder arranges for use of a training center to conduct an AQP, the responsibility remains with the certificate holder to assure that the training records required under part 121 or 135 are maintained.
Par 7-1 Page 75 CHAPTER 7. TRANSITION TO AQP SECTION 1. OVERVIEW
7-1. GENERAL. Most Advanced Qualification Programs (AQP) have been built using one of two approaches. Some applicants have elected to continue training with their traditional program while they developed their AQP. Other applicants have requested an optional exemption to traditional training, commonly called a Single Visit Exemption (SVE).
7-2. ENTERING AQP FROM AN ESTABLISHED TRAINING PROGRAM. Applicants entering AQP may begin with a qualification curriculum or a continuing qualification (CQ) curriculum, or both.
a. Qualification Curriculum. Entering AQP with a qualification curriculum may also require the development of an indoctrination curriculum. Having both curriculums in place allows an applicant to train new hires and provide qualification training for its established crewmembers and other operational personnel (if applicable).
b. CQ Curriculum. If an applicant develops a CQ curriculum using a 12-month training interval, a transition plan must be developed to address the modification of pilots-in-command (PIC), seconds-in-command (SIC) and Flight Engineers (FE) base months. Participants should transition to a training cycle that puts PICs/SICs/FEs in the same training cycle (annually or more frequently) to maximize simulator resources and to provide effective crew pairing. The transition plan might include:
(1) PICs scheduled for a 6-month flight training session may receive a line check during the 3-month eligibility period in lieu of the training. The AQP CQ will occur during their base month (plus or minus 1 month), 6 months later.
(2) PICs scheduled for a recurrent proficiency check during their base month will receive the AQP CQ.
(3) SICs and FEs (if applicable) scheduled for proficiency checks will receive the AQP CQ.
7-3. TRANSITIONING TO AQP USING THE SVE. The FAA grants an exemption in the public interest and with the assurance that a level of safety equivalent to the regulations from which an exemption is sought will be maintained. The exemption that is issued will contain specific conditions and limitations. It is granted for a 2-year period and may be renewed subject to FAA determination of reasonable progress towards AQP implementation. The SVE allows all fleets to transition to a training cycle that puts PICs, SICs, and FEs in the same training cycle (annually or more frequently). The transition period may require 6 months to place all crewmembers into the Single Visit Training Program (SVTP) and 12 months to complete the training cycle. The SVE applies the following conditions to recurrent training:
Par 7-3 Page 76
a. A certificate holder must maintain an SVTP for crewmembers, instructors, and evaluators. The certificate holder must submit revisions to its SVTP through its Principal Operations Inspector (POI) to the FAA manager of the Air Carrier Training Systems and Voluntary Safety Programs Branch for approval prior to the execution of privileges under the exemption. Notification of approval for the certificate holder to implement its SVTP will be approved by the POI.
b. A certificate holder must maintain a master AQP transition schedule for FAA approval, and submit quarterly written progress reports thereafter, in a format approved by the Administrator, to the appropriate Safety Standards office manager with a copy to the POI. The FAA will monitor the progress of the transition toward AQP in accordance with the certificate holder’s approved schedule. Maintaining reasonable progress toward the certificate holder’s AQP transition is an explicit condition of the exemption.
c. A certificate holder must conduct a pre-training “first-look” evaluation for all pilots that addresses at least a subset of tasks, maneuvers, or procedures included in Title 14 of the Code of Federal Regulations (14 CFR) part 121 appendix F. The certificate holder must collect first-look data before the repeated execution of any such first-look item in a flight simulator or flight training device (FTD). First-look maneuvers must not be briefed in advance of the first execution of such maneuvers. The certificate holder may elect to obtain first-look evaluation data by measuring the proficiency of first-look items the first time they occur during normally scheduled recurrent training in a flight simulator or FTD, or by scheduling a special first-look evaluation session for first-look items, or a combination thereof. The list of first-look items must be submitted through the certificate holder’s POI to the appropriate Safety Standards office manager for approval before its use. The first-look items will be selected for each type of aircraft and will focus on at least one of the following categories:
(1) The execution of maneuvers, tasks, and/or procedures under degraded modes of operation.
(2) The execution of such items under emergency conditions.
(3) Those maneuvers, tasks, and/or procedures likely to be sensitive to loss of proficiency because of infrequent practice. Unless otherwise authorized by the appropriate Safety Standards office manager with the concurrence of the POI, first-look items must be maintained therein until this exemption expires. The certificate holder must apply the same measurement methodology and rating criteria to the evaluation of first-look proficiency as that condition specified in subparagraph 7-3f below for proficiency evaluations.
d. A certificate holder must ensure all flightcrew members are trained and evaluated to proficiency at their duty position, except that type-rated first officers may occupy either pilot position for training purposes. This training and evaluation must be conducted during an SVTP that includes at least the following:
(1) Annual recurrent ground school instruction that includes all 14 CFR part 121-mandated-training requirements and that integrates, where applicable, Crew Resource Management (CRM) and human factors into recurrent ground school subject lessons.