Appendix 3 P age 4 Maneuvers Part 121 Appendix E Flight Training Airline Transport Pilot and Type Rating for Airplane Airman Certification Standards Part 121 Appendix F Proficiency Check AQP Qualification Curriculum AQP Continuing Qualification Curriculum Preflight Equipment Examination N/A Required Required Written/ETS/Oral Written/ETS/Oral Interior Preflight Inspection Required Required Required MV/LOE Line check Exterior Preflight Inspection Required Required Required MV/LOE Line check Taxiing Required Required Required MV/LOE Line check Powerplant Checks Required Required Required MV/LOE Line check Takeoffs Normal Takeoffs Required Required Required MV/LOE Line check Instrument Takeoff Required Required Required MV/LOE MV/LOE Crosswind Takeoff with gusts Required Required Required MV/LOE Line check Takeoff with Powerplant Failure Required Required Required MV/LOE MV/LOE Rejected Takeoff Required Required Required MV/LOE MV/LOE Instrument Procedures Area Departure and Arrival Required Required Require [1 Waivable] MV/LOE Line check Holding Required Required Required [Waivable] MV/LOE Brief Normal ILS Required Required Required MV/LOE MV/LOE Autopilot Coupled ILS Not Required Not Required Not Required Train to Proficiency MV/LOE Manually Controlled ILS with Powerplant Failure Required Required Required MV/LOE MV/LOE Non-Precision Approach Required Required Required MV/LOE MV/LOE Second Non-precision Approach Required Required Required Train to Proficiency Train to Proficiency Circling Approach Not Required Required Required [Waivable] Train to Proficiency Brief Missed Approach from ILS Required Required Required MV/LOE MV/LOE Additional Missed Approach Required Required Required Train to Proficiency N/A
Appendix 3 P age 5 (and 6) Missed Approach with Powerplant Failure Required Required Examiner Discretion MV/LOE MV/LOE Inflight Maneuvers Steep Turns Required Required Required Train to Proficiency N/A Stall Prevention Required Required Required [2 Waivable] Train to Proficiency Train to Proficiency Specific Flight Characteristics As Necessary As Necessary As Necessary Train to Proficiency N/A Powerplant Failures Required Required Required MV/LOE MV/LOE Abnormal and Emergency Procedures will include all systems maneuvers and procedures as required by Airplane Flight Manual (AFM) Required Required Required A sampling of Abnormals and Emergencies will be trained in the simulator and evaluated during MV and LOE.
Abnormals and Emergencies will be evaluated during ground school, trained in the simulator and evaluated during MV and LOE.
Landings Normal Landings Required Required Required MV/LOE Line Check Landing from an ILS Required Required Required MV/LOE MV/LOE Crosswind Landing With Gusts Required Required Required MV/LOE MV/LOE Landing with Powerplant Failure Required Required Required MV/LOE MV/LOE Landing from a Circling Approach Required Required Required Train to Proficiency N/A Rejected Landing Required Required Required MV/LOE MV/LOE Zero Flap Landing Required Required Not Required N/A N/A Postflight After Landing Not Required Required Not Required Line Check Line Check Parking and Security Not Required Required Not Required Line Check Line Check Training Wind shear/Microburst Train to Proficiency Train to Proficiency GPWS Train to Proficiency Train to Proficiency Low Visibility Taxi Train to Proficiency Train to Proficiency Precision Runway Monitor (PRM) Train to Proficiency Train to Proficiency Upsets/Catastrophic Failures Train to Proficiency Train to Proficiency
Appendix 4 APPENDIX 4.
ADVANCED QUALIFICATION PROGRAM DOCUMENTATION
CHECKLIST AND REVIEW JOB AID This Advanced Qualification Program (AQP) tool contains seven job aids for both the Federal Aviation Administration (FAA) and the certificate holder to use as simplified checklists for the development and review of the documentation requirements of AQP. Other document configurations may be appropriate to a specific certificate holder. If a certificate holder adopts a different document configuration, other than the one suggested in Advisory Circular (AC) 120-54A, Advanced Qualification Program, then the applicant should provide clear and specific guidance as to the location of the information for each of these document topics. The comment section may be used to record any remarks relative to the review and approval of the document.
There are six document types and one annual report required for each AQP certificate holder. Each document will have its own job aid:
1. Application – One per AQP applicant.
2. Job Task Analysis – One for each trainee type and one for each trainee type’s Instructor/Evaluators.
3. Qualification Standards – One for each trainee type (e.g., pilot, flight attendant (F/A), and aircraft dispatcher) and one for each trainee type’s instructor/evaluators.
4. Instructional Systems Development Methodology – One per AQP applicant.
5. Curriculum Outline – One per curriculum/make, model, series, variant and instructor/evaluator.
6. Implementation and Operations Plan (I&O Plan) – One per AQP applicant.
Note: Each of the above documents must remain current throughout the life of the AQP.
Each of the documents must be on a revision control process.
Annual AQP Report – Certificate holders will monitor the status of all AQP curriculums and the performance/proficiency Database and will summarize their findings annually in a report to the FAA.
Although there is no established format for the report, the associated job aid can be used to highlight areas to be addressed in the report.
Application, Phase I – AC 120-54A. The purpose of the application is to establish the applicant’s methodology for developing an AQP for all of its fleets, instructors and evaluators, and for non-fleet specific curriculum (i.e., indoctrination). The application is submitted once and is updated as information in the application changes (e.g., a change in the transition schedule, adding new aircraft, initiating flight attendant (F/A) or dispatcher AQPs, etc.). In order to establish the applicant’s intent and approach for developing an AQP, the application should thoroughly discuss the following topics numbered 1–9 in this job aid.
NOTE: An application boilerplate is available from the Air Carrier Training Systems and Voluntary Safety Programs Branch.
1 Statement of Intent Y N Comments
a. Does the Statement of Intent specify the applicant’s intent to develop, implement, and operate an AQP?
b. Does the Statement of Intent address all fleets?
Appendix 4
c. Does the Statement of Intent address how and to what extent the AQP will be operated and maintained?
d. Does the Statement of Intent address how CRM will be integrated and measured?
e. Does the Statement of Intent include the use of the single visit exemption or that single visit will not be used?
2 The Applicant’s Staff Organization Y N Comments
a. AQP Coordination: Is a person identified that will be the focal point for the applicant’s AQP development and contact with the FAA?
b. Subject Matter Expertise (SME): Are current and qualified individuals identified by name or position, who have varying levels of expertise that fairly represent the population of professionals the AQP will address?
c. Document and Curriculum Development: Are individual(s) identified by name or position, who interface with the AQP coordinator and the SMEs to develop the requisite AQP process, curriculum, and instructor/evaluator documents?
d. Document Management: Is an individual identified, who ensures AQP document control and congruence with FAA approvals?
e. Computer Specialist/Database Management:
Is an individual identified who will develop and manage the performance/proficiency data acquisition and analysis system?
f. In addition, will the computer specialist/database manager be used for other computer-related issues related to the facilitation of an AQP, such as electronic document review?
Appendix 4
3 Data Collection, Submission and Analysis Reporting Y N Comments
a. Does the applicant acknowledge their understanding and acceptance of the AQP performance data requirements by stating the intended purpose for the collection, management, analysis, and reporting of AQP training/evaluation data for each curriculum?
b. Does the applicant defer to the I&O plan for describing the process and methodology for AQP data collection and analysis?
c. Does the applicant acknowledge that an electronic data management system will be developed prior to entering Phase III of any AQP curriculum?
d. Does the applicant acknowledge the requirement for collecting SVTP data?
e. Does the applicant acknowledge that requirement for submitting de-identified data to the FAA no later than 2 months after collecting the data?
f. Does the applicant acknowledge the requirement of a more stringent collection and analysis of the data than that submitted to the FAA?
g. Does the applicant describe the purpose of the data analysis and how it will be used?
h. Does the applicant acknowledge the requirement for submitting an annual AQP report summarizing their data analysis and any resulting changes that ensued in their AQP program?
4 Supporting Documents and Manuals Y N Comments
a. Do the supporting documents and manuals list each make, model, and series aircraft or variant?
b. Has the applicant provided the FAA with the following documents or manuals:
1. A current listing of company and manufacturers manuals that governs company operations?
2. General descriptive summary of each aircraft type, including aircraft configuration and the performance baseline?
3. Flight Operations Manual (FOM)?
4. General Operations Manual (GOM)?
5. Manufacturer’s Airplane Flight Manual (AFM)?
6. Master Equipment List (MEL/CDL)?
Appendix 4
c. Does the applicant have available the training and qualification recommendations in the Flight Standardization Board reports?
5 Operating Environment Description Y N Comments
a. Does the applicant describe the operating environment, including the general meteorological and geographic factors expected to be encountered during operations?
b. Does this description include the weather norms and extremes expected to be encountered in operations?
c. Does this description include normal, abnormal, and emergency equipment operation in geographic areas that require special procedures (e.g., engine failures in mountainous terrain)?
d. Does this description include terminal and en route operating areas such as controlled and uncontrolled airfields?
6 Trainee Demographics Y N Comments
a. Does the applicant provide a general summary of trainee experience and entry level by aircraft make, model, series or variant?
b. Does the applicant identify entry requirements for ground and flight instructors and evaluators?
c. Does the applicant group students in terms of previous experience (e.g. with high, low, and mean experience included)?
d. Does the applicant identify the current and anticipated need for replacement crewmembers by duty position? This information is necessary to determine priority on curriculum development?
7 FSTDs and Training Equipment – Description and Location Y N Comments
a. Does the applicant identify the FSTDs and training equipment to be used, its location, and identify the organization (vendor or applicant) responsible for its security and maintenance?
b. Does the applicant identify flight simulators and/or flight-training devices by make, model, serial number, and/or FAA identification number assigned?
Appendix 4 8 Facilities Description Y N Comments
a. Does the applicant describe the location, general type of facility, classrooms, training aids, course software, and other resources to be used to support AQP training?
9 Master AQP Transition Schedule (MATS) Y N Comments
a. Does the MATS include all aircraft, aircrew, instructors, evaluators, and other personnel that the applicant intends to transition to AQP?
b. Is the MATS complete? A partial MATS is not acceptable.
c. Does the MATS address how currently qualified personnel may transition between traditional recurrent training & continuing qualification curriculums or single visit training?
A simple spreadsheet, provided by the applicant, may be helpful to highlight the crew pairing requirements during the first year of AQP or Single Visit operations.
d. Does the MATS address how personnel who have completed initial, transition, conversion, or upgrade curricula may enter a continuing qualification curriculum?
e. Does the MATS address personnel who have completed a traditional basic indoctrination curriculum, but have not completed an initial, transition, conversion, or upgrade curriculum?
f. Does the MATS address personnel who are current instructors or evaluators and how they may transition to AQP via a differences course?
g. Does the MATS address the incremental implementation of the curriculums as opposed to all at once?
Job Task Analysis (JTA), Phase II – AC 120-54A. A JTA is the method or procedure used to reduce a unit of work to its base components. The JTA provides a detailed, sequential listing of tasks, subtasks, and elements with the knowledge, skill, and attitude characteristics (KSAs) that clearly define and completely describe the job. An applicant will provide a JTA for each make, model, and series aircraft (or variant). These may be submitted as individual listings, or a single-higher level listing with appendices for each aircraft, showing its unique lower-level features. As a complete document, the JTA has four components: a job task list, a learning analysis (KSA), identified crew positions, and references.
1 JTA Structure Y N Comments
a. Does the JTA provide a general introduction explaining the development of the task listing and the subsequent task analysis and how it is to be used to form the basis for the qualification standards, and the AQP curriculums upon which they are built?
b. Is the JTA organized using a hierarchical system with the flight phases at the top level, tasks at the next level, component subtasks at the next level, elements at the next level?
Appendix 4
c. Is the JTA complete with tasks, subtasks, elements, and crew positions?
d. Has the applicant completed full development of the JTA to the element level?
e. In the JTA applicable knowledge, skills, CRM markers, and (where desired) attitudes are applied at the element level?
2 Flightcrew Training Requirements Y N Comments Does the JTA incorporate all knowledge and skill requirements currently specified in the regulations?
a. Aircraft Systems’ Subjects Aircraft General Equipment and Furnishings Emergency Equipment Powerplants Electrical Pneumatic Air-conditioning and Pressurization APU Hydraulics Landing Gear and Brakes Flight Controls Fuel Communications Equipment Flight Instruments Navigation Equipment Autoflight Warning and Detection Systems (to include TCAS, GPWS, and WX Radar
Fire and Overheat Protection Oxygen Aircraft Performance & Limitations
MEL/CDL
b. System-Operations Integration Training Y N Comments Preflight Visual Inspection Prestart Checklist and Procedures Powerplant Start Taxi to include lowest visibility allowed by OpSpecs
Pre-Takeoff Checks and Procedures Normal Takeoff Crosswind Takeoff With Gusts Instrument Takeoff (Low Visibility) Powerplant Failure on Takeoff (at or near V1)
Appendix 4 Powerplant Failure After V2 Rejected Takeoff Area Departure Cruise Procedures Holding Area Arrival Normal ILS Engine-out ILS Autopilot-Coupled ILS Non-precision Approach ILS missed Approach Second Missed Approach Precision Radar Monitored Approaches/Missed Circling Approach No-flap Landing Crosswind Landing With Gusts Landing With Engine Failure Landing From Circling Approach Rejected Landing Landing With 50% Power Loss Stall Prevention (Approach to Stall) Steep Turns Powerplant Failure Wind shear Training Mis-Trim Situations Selected Events - Unusual Attitudes TCAS and GPWS - Escape Normal and Abnormal Procedures Emergency Procedures
c. Company Operations Manual Content Y N Comments Company Policy or Procedures (dispatch and flight release requirements)
Regulations, Operations Specifications, and Standards Operating Procedures (SOP)
Weather Requirements (seasonal changes, flight into various geographic locations and temperature-related requirements)
Hazardous Material Security Special Operations (special airports, special approaches and departures)
Emergency crew assigned duties and procedures Operation of emergency equipment/systems Operation of ditching/evacuation equipment/systems
Appendix 4
c. Company Operations Manual Content Y N Comments Crew Resource Management (CRM) Leadership and Command Mentoring Emergency Situation Training – Rapid Decompression, Fire (Flight/Surface), and smoke control procedures
Assistance of Persons to Exits during Emergency Illness, Injury, or Other Abnormal Situations Involving Passengers or Crew (use of medical kit)
Flight Physiology (i.e., Hypoxia, Respiration, etc.)
Use of Checklist (SOP) Flightdeck Familiarization Preflight Planning and FMS In-flight Planning L-Nav, V-Nav, R-Nav, and GPS Required Navigation Procedures Navigation Systems Integration Autoflight and Flight Director Integration Use of Radar/CRTs TCAS
GPWS/TAWS Communication Systems Integration (ACARS/FMS/CPDLC)
Surface Movement Guidance Systems (SMGS) Runway Incursion Prevention Strategy Stabilized Approach Strategy Precision Radar Monitoring (PRM) Procedures Land and Hold Short (LAHSO) Procedures
CAT II/III
Appendix 4 Qualification Standards (QS), Phase II – AC 120-54A. The qualification standards document has four parts, the prologue, a regulatory comparison, the evaluation/remediation methodology, and the specific Terminal Proficiency Objectives (TPO)/Supporting Proficiency Objectives (SPO) qualification standard.
1. Prologue: This is an introductory section that explains the methodology, format, and terminology of the document.
2. Regulatory Requirements Comparison: The qualification standards document must also include regulatory comparison information. The comparison must meet the requirement of AQP regulatory guidance, which states that the AQP program “...must indicate specifically the requirements of 14 CFR part 61, 63, 65, 121 or 135, as applicable, that would be replaced by an AQP curriculum.” The comparison should be comprehensive and understandable so that a reader can discern the scope and appropriateness of the training.
3. Testing/Validation/Evaluation and Remediation Methodology: This section is a detailed plan describing the point in the curriculum when a test, validation, or evaluation will be applied. It must identify what constitutes a failure and/or unsatisfactory performance. This section will also describe the remediation strategy to be used to correct unsatisfactory performance and special tracking provisions.
4. The Qualification Standard: The qualification standard is constructed by applying a performance statement, conditions, and standards to a task or subtask, thereby creating a TPO or an SPO.
1 Qualification Standards Prologue Y N Comments
a. Does the prologue discuss the methodology used to develop the qualification standards document?
b. Does the methodology explain how any aspect, from curriculum outline to lesson elements or grade sheet items, is be traceable to an item in the qualification standard?
c. Does the prologue discuss the format (structure) that used for the qualifications standards?
d. Does the prologue define terms used for the qualification standards?
2 Regulatory Comparison Y N Comments
a. Does the regulatory comparison specify the requirements of the applicable Airman Certification Standards or practical test standards and part 61, 63, 65, 121, or 135 that would be replaced by an AQP curriculum and how they will be addressed?
b. Are departures from those requirements identified and justified?
c. Are any standards specifications used that differ from Airman Certification Standards or practical test standards)?
Appendix 4 3 Testing/Validation/Evaluation & Remediation Methodology Y N Comments
a. Does the applicant describe where to ascertain how, when, where, and who will assess a student’s proficiency on each terminal and supporting objective?
b. Does this section identify the points in the curriculum where the testing, validation, or evaluation will be applied?
Systems Validation Procedures Validation Maneuvers Validation LOE Line Checks
c. Does the applicant clearly define the different strategies that will be used to test, validate, or evaluate performance?
First Look Train To Proficiency Systems/Knowledge Validation Procedures Validation Maneuvers Validation Line Operational Evaluation Initial line Check Line Check
d. Does this section describe how the criticality and currency ratings translate into testing strategies for TPOs and SPOs in the continuing qualification cycle?
e. Does this section describe how a TPO with several SPOs may be alternatively sampled over multiple evaluation periods or continuing qualification cycles? e.g., TPO (non-Precision Approaches) SPOs (NDB, VOR, BC, etc.)
f. Does the applicant specify and clearly describe the rating scale that will be used by instructors/evaluators to score performance?
g. Do the rating scale definitions clearly discriminate performance levels? Are they clear?
h. Does the applicant identify what constitutes a failure and/or unsatisfactory performance for each validation/evaluation point?
i. Does the applicant specify the strategy for remedying unsatisfactory performance?
j. Does this remediation strategy detail when and what may be repeated and whether or not additional training is warranted?
k. Does the applicant describe the methodology that will be used to remediate unsuccessful testing, validation, or evaluation sessions?