Par 7-3 Page 77
(2) Annual training to proficiency for each flightcrew member in a flight simulator or FTD. As a minimum, proficiency training must be provided for all tasks, maneuvers, or procedures on which performance is found to be unsatisfactory during the first-look evaluation and must continue until satisfactory performance is observed.
(3) Annual recurrent training conducted every 12 months, plus or minus 1 month, in a flight simulator or an FTD approved for its intended use by the POI. This training must be composed of at least two SVTP sessions on 2 separate days, conducted to the maximum extent feasible using a full-crew complement that consists of a captain, first officer, and, where applicable, a second officer. When a full crew is available for training, an SVTP session duration of at least 4 hours per day, including reasonable time for breaks, must be employed, to include Line-Oriented Flight Training (LOFT), the scenario duration of which must be at least 60 uninterrupted minutes. Multiple flight segments representative of the certificate holder’s flight operations may be included in the LOFT. When a full-crew complement is not available, the content and duration of the training must be determined in accordance with a crew-pairing decision rule approved by the POI in accordance with the condition spelled out in subparagraph 7-3i below, but in no case must the duration of such training be less than 2 hours per day, including a reasonable time for breaks, to include LOFT or Special Purpose Operational Training (SPOT), the scenario duration of which must be at least 60 uninterrupted minutes. The current edition of Advisory Circular (AC) 120-35, Flightcrew Member Line Operational Simulations: Line-Oriented Flight Training, Special Purpose Operational Training, Line Operational Evaluation, must be used for general guidance with respect to the design and execution of LOFT and SPOT. All LOFT and SPOT scenarios must be approved by the POI for their intended use. SVTP sessions may consist of LOFT, SPOT, Line Operational Evaluation (LOE), support training, and proficiency checks, as well as individual maneuvers or events, as required for training or checking, subject to the conditions specified herein.
e. A certificate holder must ensure all proficiency evaluations consist of maneuvers, tasks, and procedures approved by the Administrator. The certificate holder may elect to propose fixed and variable items to be required on proficiency evaluations, as follows:
(1) Approved fixed items must be included on all proficiency evaluations on a given duty position in a given aircraft for the duration of this exemption; and
(2) Approved variable items may be changed at the discretion of the certificate holder and must be selected based on operational need. Before the execution of this option, the content of fixed and variable items, together with any associated evaluator proficiency assessment rating forms, must be submitted through the POI to the appropriate Safety Standards office manager for approval. Any fixed and variable maneuver list proposed by the certificate holder must incorporate specifications of the applicable duty position (e.g., PIC, SIC, or both, and FE) and pilot role (pilot flying (PF), pilot monitoring (PM), or both) to be addressed in the proficiency evaluation for each such maneuver.
Par 7-3 Page 78
f. Proficiency evaluations must be accomplished to the maximum extent feasible in a crew-oriented setting with a PIC and SIC. For all tasks, maneuvers, or procedures to be included on proficiency evaluations, a certificate holder must identify the performance standards to be employed. Where appropriate, current FAA practical flight test advisory materials (FAA-S-ACS-11, Airline Transport Pilot and Aircraft Type Rating for Airplane Airman Certification Standards, as revised) and pertinent Flight Standardization Board (FSB) Reports for a given type of aircraft should be used for guidance in developing specifications for performance standards. The specification of performance standards must be submitted through the POI to the appropriate Safety Standards office manager for approval before implementation of the certificate holder’s proposed SVTP.
g. A line check that consists of at least one flight segment and that incorporates both a technical and CRM debriefing facilitated by a line check airman must be conducted for all PICs not more than 6 months, plus or minus 1 month, following the PIC proficiency check.
h. For first-look evaluations, proficiency evaluations, and line checks, a certificate holder must develop and implement the following:
(1) A proficiency rating scale methodology (e.g., Unsatisfactory = 1; Repeated (Once Only) = 2; Debriefed (No Repeats) = 3; Satisfactory = 4; and Outstanding = 5); and
(2) A reason categorization system for use by evaluators to categorize the principal reason for below satisfactory performance (e.g., system knowledge, procedural knowledge, execution, communication/coordination, situation awareness, flight management/flight guidance system operation, and teamwork). A certificate holder must submit its proposed rating scale methodology and reason categorization system through its POI to the FAA AQP manager for approval before the implementation of its SVTP.
i. Notwithstanding any other condition of this exemption, a certificate holder must ensure that each person serving as a required flightcrew member on more than one airplane type complies with the provisions of §§ 121.433(c)(1)(i) and 121.440(a).
j. Any certificate holder PIC who fails a proficiency check must:
(1) Receive additional training to proficiency,
(2) Demonstrate within-standards performance on a subsequent proficiency check before returning to flight duty,
(3) Satisfactorily complete an additional line check not more than 3 months following an unsatisfactory proficiency check, and
(4) Satisfactorily complete an additional proficiency check not more than 6 months following an unsatisfactory proficiency check.
NOTE: The provisions of this condition must not establish a new anniversary date for training or checking.
Par 7-3 Page 79
k. A certificate holder must ensure every flightcrew member who fails to complete any training or evaluation satisfactorily under this exemption does not serve as a required flightcrew member until such deficiencies have been corrected and the crewmember has been retrained or satisfactorily reevaluated as appropriate on those items.
l. Training to be accomplished under the exemption must specifically include CRM conducted in a flight simulator. Certificate holders must refer to the current edition of AC 120-51, Crew Resource Management Training, for general guidance in the development of CRM training plans and programs.
m. Before implementation, a certificate holder must submit a documented methodology for developing and administering LOS scenarios (LOFT, SPOT, or LOE) through its POI to the FAA AQP manager for approval. That methodology must ensure that identical LOFT/LOE scenarios are not employed in two successive training sessions for a given crew, and pilots are not exposed to identical LOFT/LOE scenarios in 2 successive years.
n. A certificate holder must ensure that first-look, LOS, and proficiency evaluations are accomplished in a flight simulator meeting the requirements of part 121 appendix H and are approved for its intended use by its POI. Notwithstanding the provisions of this exemption, if a proficiency evaluation required by this exemption is not accomplished in a level B (Phase I) or higher flight simulator, then two landings must be accomplished in the appropriate aircraft in accordance with the provisions of § 121.441(e). This requirement must be accomplished within the eligibility period for the proficiency evaluation involved.
o. Data on pilot performance conducted under the provisions of this exemption must be collected by the certificate holder and reported to the FAA, as specified in subparagraph 7-3t below, beginning on implementation of its SVTP, unless otherwise authorized by the manager of the Air Transportation Division. Performance evaluation and data reporting must be accomplished in accordance with the following categories and the provisions of the condition in subparagraph 7-3f above:
(1) By aircraft make, to include separate categorization by series and variant if, according to the criteria specified in the current edition of AC 120-53, Guidance for Conducting and Use of Flight Standardization Board Evaluations, significant operational differences exist.
(2) By crew position (PIC, SIC, and/or FE) and SVTP flight simulator sessions. Each crewmember’s data must be reported as a single identifiable electronic record, with appropriate identifiers to distinguish crew position to permit tracking individual performance, where possible, from first-look evaluation through proficiency training and evaluation. The certificate holder must report additional training sessions beyond normally programmed training for any crewmember. The certificate holder must report the occurrence of seat position substitution by an instructor or other qualified pilot, or crewmembers in training who are occupying other than their normal seat position.
(3) By individual task, maneuver, or procedure, as applicable.
Par 7-3 Page 80
p. First-Look. Rating scale and reason code data must be obtained on the first occurrence of part 121 appendix F subset maneuvers in accordance with the provisions of conditions in subparagraphs 7-3c and 7-3f above.
q. Proficiency Training. Data must be obtained on the number of maneuver repetitions required during training to proficiency on first-look items on which initial performance is below standard.
r. Proficiency Evaluation. Rating scale data must be obtained for each repetition of a proficiency evaluation maneuver, task, or procedure to include reason codes for each occurrence of performance below standard, in accordance with the provisions of the condition in subparagraph 7-3f above. Proficiency must be measured against the specifications for performance standards developed in accordance with the provisions of subparagraph 7-3h above.
Certificate holder must report unsatisfactory proficiency evaluations.
s. Line Check. Line checks must employ the same evaluation methodology as specified under this exemption for proficiency checks, with the exception that such data will be limited to the PIC tasks, maneuvers, and procedures that occur during the flight segments observed, in accordance with the provisions of the condition in subparagraph 7-3e above. The certificate holder must report unsatisfactory line checks.
t. The certificate holder must provide the FAA with de-identified raw data (i.e., individual pilot performance assessment data on which name identification has been removed) on a monthly basis, in accordance with the categorization requirements specified in the condition in subparagraph 7-3m above. For this purpose, the certificate holder must convey these data via IBM-compatible diskettes or electronic media. The data format, together with a written description of the electronic record structure (to include database file relationships and data record field definitions), should be forwarded directly to the FAA AQP for approval. The certificate holder must obtain approval for any subsequent changes thereto, not less than 30 days before the implementation of any such changes.
u. In addition to any other reporting requirements specified herein, the certificate holder must submit an annual SVTP report documenting training and checking effectiveness to the certificate holder’s POI using a method and format acceptable to the Administrator. These reports must:
• Document the certificate holder’s own analysis of data acquired under this exemption.
• Identify any trends, common problem areas, or potential deficiencies.
• Include a description of any corrective steps taken or warranted.
During the second year of the exemption, the reports must incorporate comparisons of data between equivalent periods in the preceding year.
Par 7-3 Page 81
v. SVTP review meetings must be scheduled to occur on an annual basis, unless sooner requested by the FAA or by the certificate holder, to be attended by representatives of the certificate holder, the certificate holder’s POI, and Air Carrier Training Systems and Voluntary Safety Programs Branch at a location and on a date to be determined by the POI. The purpose will be to review:
(1) Compliance with the terms and conditions of this exemption.
(2) Data collection issues.
(3) Data results including, in particular, the identification of trends, as well as any associated action taken or warranted.
(4) The status of the certificate holder’s progress toward transitioning its aircraft fleets out of this SVE into AQP.
SECTION 2. THE PETITION FOR EXEMPTION
7-4. GENERAL. The petition for exemption to allow transition to AQP is made in accordance with 14 CFR part 11, § 11.25. Figure 7-1 illustrates sequence of events for obtaining and applying the Single Visit Exemption (SVE).
FIGURE 7-1.
SINGLE VISIT EXEMPTION (SVE) PROCESS 7-
5. THE PETITION PROCESS. Any interested person may petition the Administrator to issue, amend, or repeal a rule. Each petitioner must submit, unless good cause is shown, the petition at least 120 days before the proposed effective date of the exemption. Each petition must
Par 7-5 Page 82 be submitted in duplicate to the FAA at the Rules Docket (AGC-10), Federal Aviation Administration, 800 Independence Avenue, SW., Washington, DC 20591. Electronic versions may be submitted via the Docket Management System website at https://www.regulations.gov/.
7-6. THE PETITION. The petition should include a citation of each rule from which relief is requested, and a brief description of the general nature of the relief requested. In addition to identifying the regulation, the petition must explain in detail the interest of the petitioner in seeking the exemption. It must show why granting the exemption would be in the public interest and how safety will not be compromised. Finally, this information must be summarized in a format that may be published in the Federal Register. For the SVE, the applicable regulations are:
• Section 121.433(c)(1)(iii).
• Section 121.441(a)(1).
• Section 121.441(b)(1) and appendix F.
• Section 121.440(a) (when petitioning for “random” line check authority).
a. Interest of the Petitioner. The petition must explain the interests of the petitioner in the action requested, the nature and extent of the relief, and a description of each aircraft or person to be covered by the exemption.
b. Public Interest. The petition must present information, views, or arguments to support the action sought and the reasons why the granting of the request would be in the public interest.
c. Safety Considerations. The petitioner should state the reason(s) why the exemption would not adversely affect safety.
d. Safety Equivalency. Explain why the action taken would provide a level of safety equal to that provided by the rule from which the exemption is sought.
7-7. GRANTING OF THE PETITION. Upon being granted the petition through issuance of the exemption and with FAA approval of the SVTP plan, the applicant may transition specific fleets or all fleets of aircraft to the SVTP. The applicant will stipulate which fleets in the SVTP plan. See Figure 7-1 for an overview of this process. The process time expected for standard (generic) petitions is 90 days. Deviations from the standard single visit training petitions are not recommended.
NOTE: Deviations from the standard SVE petition may entail a lengthy process time. Therefore, the petitioner may want to consider submitting a separate petition for such deviations.
Par 7-8 Page 83
7-8. RENEWAL REQUIREMENTS FOR THE SVE.
a. The exemption is issued for an initial 24-month period. The FAA expects that the applicant will be ready to enter Phase IV of the AQP between 24 and 30 months. If the applicant knows that any fleet will not be ready to enter Phase IV before the exemption expires, they may submit a petition for renewal. The renewal petition should be submitted no later than 180 days prior to exemption expiration. The following statements should be included in petitioner’s renewal request:
• The petitioner should state the exemption number and request an extension for 2 years from the original expiration date.
• If applicable, the petitioner should state that all of the conditions that existed in the original petition are still in effect, and will remain so for the entire period of the extension.
• The petitioner should state that the request is in the public interest because the petitioner’s approved SVTP will continue to maintain an equivalent or better level of safety to the training programs it replaced.
b. The FAA decision towards renewal will be based on a review and analysis of the applicant’s reasonable progression towards completing AQP. Once the applicant has entered Phase IV on all its fleets, the exemption will be allowed to expire unless it includes the random line check. In that case it will be necessary to renew every 2 years or petition for the Random Line Check Exemption separately.
SECTION 3. SVTP
7-9. OVERVIEW. The SVE requires that the applicant develop an SVTP that complies with each of the conditions and limitations of the exemption. The SVTP serves as a blueprint of the steps and procedures that an AQP applicant will implement to transition from a traditional training program to a program as authorized in the exemption. The applicant must submit the initial SVTP and any subsequent revisions through its POI to the appropriate Safety Standards office manager for approval prior to the execution of training under its SVTP or its revisions.
7-10. CONTENTS. The conditions and limitations set forth in the grant of exemption will specify the requirements and provide the details necessary to conduct an SVTP. An example of a generic grant of exemption and SVTP is available on the AQP website or by requesting a copy from the appropriate Safety Standards office manager.
7-11. SVTP PROFICIENCY CHECK. In accordance with the SVE grant, a proficiency check must be conducted at least every 12 months, plus or minus 1 month, for each crewmember in a flight simulator or in an aircraft, approved for its intended use by the POI. The applicant must ensure that all proficiency checks consist of maneuvers, tasks, and procedures approved by the Administrator. In lieu of a traditional proficiency check, as allowed by the grant, the applicant may propose a check ride consisting of fixed and variable maneuvers.
Par 7-11 Page 84
a. Maneuvers: Fixed and Variable.
(1) Fixed Maneuvers. These are a subset of part 121 appendix F flight maneuvers that are identified by the applicant as being critical to evaluating the proficiency of each pilot. Any fixed maneuver items proposed by the applicant will specify applicable duty position (PIC, SIC, or both, and where applicable, FE), and pilot-flying role (pilot flying (PF) or pilot monitoring (PM)) to be addressed in proficiency checks for each maneuver. A typical proficiency check should include four to six fixed maneuvers for the PIC and three to four fixed maneuvers for the SIC. Figure 7-2 contains a sample of fixed maneuvers.
(2) Variable Maneuvers. These are part 121 appendix F flight maneuvers or other maneuvers that are identified by the applicant as being fundamental to their operations. A typical proficiency check would include two or more variable maneuvers for each pilot. There are two approaches for determining how variable maneuvers will be used. The first approach is to identify the variable maneuvers that each pilot will be evaluated on during a period (1 year) and gather data on these maneuvers. A second approach is to have a list of variable maneuvers that can be sampled evenly throughout the period. The advantage of the second method, particularly for an applicant with a large number of pilots, is that more maneuvers can be sampled and a more accurate picture of the overall proficiency of the flightcrews can be obtained. Another advantage to sampling variable maneuvers is that it allows company check airman the flexibility to adjust proficiency checks based on company needs. The use of sampled variable maneuvers requires tight control in the scheduling of these events to ensure that each maneuver is sampled evenly and that each pilot is administered the same number of maneuvers. Figure 7-2 contains a sample of variable maneuvers for an operator that uses a sampling methodology.
b. Proficiency Check Administration. Proficiency checks must be accomplished to the maximum extent feasible in a crew-oriented setting with a PIC, SIC, and where applicable, an FE. The applicant must identify the performance standards to be employed on all tasks, maneuvers, and procedures. Where appropriate, current FAA practical flight test advisory materials (FAA-S-ACS-11, Airline Transport Pilot and Aircraft Type Rating Practical Test Standards for Airplane, as revised), and pertinent Flight Standardization Board (FSB) Reports for a given type aircraft must be used for guidance in developing specifications for performance standards. The specification of performance standards must be submitted, through the POI, to the appropriate Safety Standards office manager for approval prior to implementation of the applicant’s proposed SVTP.
7-12. APPROVAL OF THE SVTP. Upon acceptance by the FAA, the appropriate Safety Standards office manager and the POI will issue a joint letter of approval to the applicant. The POI will amend the operation specifications (OpSpecs) to include the SVE and notify the applicant to implement the SVTP.
NOTE: It is the responsibility of the POI to approve all LOFT scenarios.
7-13. REVISIONS. Changes to the program (adding different aircraft) and any revisions to the documents must coincide with the conditions set forth in the exemption and must have an acceptable revision control methodology. Revisions submitted should include:
a. A brief synopsis of each change and what pages/items are affected.
b. Change bars, or acceptable substitute, identifying the text/chart that has been changed.
Par 7-13 Page 85
c. The date of the revision and revision number on each page or graphic.
d. The List of Effective Pages (LEP).
7-14. IMPLEMENTATION OF THE SVTP. On the implementation date, the flightcrew member transition should proceed as follows:
a. PICs scheduled for a 6-month flight training session may receive a line check during the 3-month eligibility period in lieu of the training. The single visit training sessions will occur during their base month (plus or minus 1 month), 6 months later.
b. PICs scheduled for a recurrent proficiency check during their base month will receive the single visit training sessions.
c. SICs and FEs (if applicable) scheduled for proficiency checks will receive the single visit training sessions.
NOTE: The pairing of flightcrew members into training cycles is one of the required features of the SVTP and may necessitate changing the base month for some individuals.
7-15. DATA SUBMISSION AND REPORTING REQUIREMENTS. The monthly submission of performance/proficiency data, a quarterly progress report towards AQP, and annual SVTP report are conditions of the SVE. The annual SVTP report will:
a. Document training and checking effectiveness through analysis of data acquired.
b. Incorporate comparisons of data between equivalent periods in the preceding year.
c. Identify any trends, common problem areas; or potential deficiencies.
d. Include a description of any corrective steps taken or warranted.
7-16. SVTP REVIEW MEETING. This annual meeting is called by the POI, who specifies the time and location. Attendees include: Air Carrier Training Systems and Voluntary Safety Programs Branch, the applicant, and other FAA personnel responsible for SVTP oversight.
Agenda items include:
• Compliance with terms and conditions of the exemption.
• Data collection and analysis.
• Data results, including the identification of trends, as well as any associated action taken or warranted Discussion of quarterly progress reports and adherence to the Master AQP Transition Schedule (MATS).
• LOFT and event set design problems and suitability.
• Methods that are used to avoid repetition of LOFT/LOS scenarios.
• Discussion of SVTP proposed and past changes.
• AQP challenges and difficulties.
• Suggested improvements.
• Performance standards and instructor/evaluation calibration.
Par 7-16 Page 86 FIGURE 7-2.
SAMPLE OF PROFICIENCY CHECK FIXED AND VARIABLE MANEUVERS Fixed: PIC PF; SIC PM; FE SUPPORT 1 ILS To CAT I Minimums 2 Takeoff With Engine Failure After V1 Before V2 3 Engine-Out ILS Approach and Missed Approach 4 Engine-Out Landing 5 Non-Precision Approach 6 Rejected Takeoff 7 Low Visibility Taxi and Takeoff 8 CAT II/III Approach
Fixed: PIC PM; SIC PF; FE SUPPORT 1 ILS To CAT I Minimums and Missed Approach 2 Takeoff With Engine Failure After V1 Before V2 3 Engine-Out ILS Approach and Landing 4 Non-Precision Approach (VOR, NDB, LOC, LOC/BC,LDA, SDF, ASR, RNAV/FMS, GPS)
Variable: PIC, SIC, FE SUPPORT 1 APU Fire 2 Asymmetrical Inboard Trailing Edge Flaps 3 Asymmetrical Outboard Trailing Edge Flaps 4 Emergency Evacuation 5 Engine Fire/Severe Damage 6 Essential Power Failure Light ON 7 Fuel Dumping-Main Tanks 8 Generator Field and Generator Breaker Tripped 9 GPWS In-flight Escape Maneuver 10 Holding 11 Landing and Landing Rollout in Crosswind 12 Loss of all Generators 13 Manual Landing Gear Extension 14 Pack Trip Off Light ON 15 Perform Bleed Air Trip Off Light ON procedure 16 Rapid Decompression 17 Rejected start/Overtemp 18 Rejected start procedure-No ignition 19 System A Restoration/Loss 20 System B Overheat Light ON 21 System B Restoration/Loss 22 Two Engine Inoperative Approach 23 Wheel Well Fire 24 Wind shear avoidance and precautionary procedures-On Approach 25 Wind shear avoidance and precautionary procedures-On Takeoff (after V1)
Fixed and Variable: Flight Engineer (Where Applicable) 1 Duties During Engine-Out Takeoffs and Landings 2 Duties During CAT II/III Approach 3 Duties During Rejected Takeoff 4 Normal, Abnormal and Emergency Procedures 5 Aircraft Systems Knowledge and Procedures
Par 8-1 Page 87 CHAPTER 8. AQP DATA MANAGEMENT SECTION 1. INTRODUCTION
8-1. OVERVIEW. This chapter provides general guidance for the management of performance/proficiency data within an Advanced Qualification Program (AQP) and a Single Visit Training Program (SVTP). It also defines the minimal requirements for the collection and submission to the FAA of de-identified curriculum data. Guidance for data management is found in the AQP Data Management Guide that is produced by the Airlines for America’s (A4A) Data Management Focus Group.
a. Regulatory Requirement. Data collection and analysis processes acceptable to the Administrator that will ensure that the certificate holder obtains performance information on its crewmembers, instructors, and evaluators that will enable the certificate holder and the FAA to determine whether the form and content of training and evaluation activities are satisfactorily accomplishing the overall objectives of the curriculum.
NOTE: The FAA uses de-identified data for program monitoring, not for individual crewmember, dispatcher, or other operations personnel monitoring.
b. Validation. The principal goal of the AQP is true proficiency-based training and qualification. This proficiency-based (expressed as performance objectives) is systematically developed and maintained, then continuously validated through the collection and analysis of performance/proficiency data. Data collection and analysis is a fundamental part of AQP and is also required for air carriers operating under an approved SVTP.
8-2. DEFINITIONS. In AQP, data is classified into the two broad categories of individual qualification records and performance/proficiency data.
a. Individual Qualification Records (Crew Records). These are identifiable records maintained in sufficient detail on each crewmember, instructor, and evaluator who is qualifying or has qualified under an AQP. These records show how and when the individual satisfied the requirements of each curriculum and therefore each assigned duty position. Air carriers may maintain a manual recordkeeping system, or a computerized recordkeeping system, based on the standard Title 14 of the Code of Federal Regulations (14 CFR) part 121 or 135 recordkeeping requirements. The recordkeeping process in AQP does not differ from traditional recordkeeping requirements.
b. Performance/Proficiency Data. This is de-identified information that represents the results of an individual’s ability to successfully demonstrate the performance objectives of each curriculum. This information is captured during validation and evaluation gates as a crewmember progresses through an AQP curriculum. This data is collected from each crewmember’s performance and is stored in aggregate in a Performance/Proficiency Database (PPDB). This data is used to analyze training programs and/or groups of participants, not for tracking individual accomplishment. Successful collection and analysis of this data will identify and correct problems, validate AQP curriculums, and identify developing trends.
Par 8-3 Page 88 SECTION 2. DATA MANAGEMENT
8-3. OVERVIEW. In AQP, data management is a continual process of data collection, entry, validation, and submission.
8-4. DATA COLLECTION—SVTP AND AQP.
a. SVTP. Collecting SVTP data essentially is a data collection process superimposed over the traditional recurrent training and line check program. SVTP data is collected for flight maneuvers performed during first-look sessions, proficiency, and line checks. This data consists of grades using a rating scale with associated reason codes as required in the certificate holder’s Single Visit Exemption (SVE) and contained in the individual carrier’s approved SVTP.
Figure 8-1 illustrates the single visit data collection fields required for submission to the FAA.
b. AQP. AQP data collection is required for all AQP curricula as defined by each carrier’s approved AQP data collection and analysis section of the certificate holder’s Implementation & Operations Plan (I&O Plan). AQP data is collected at each validation or evaluation gate. This data consists of graded proficiency objectives using a rating scale with associated reason codes (if applicable). Data collection requirements for the AQP will vary with the curriculum, the type of curriculum activity (training, validation, or evaluation), the type of participant (crewmember, instructor, or evaluator), and the overall management objectives for use of the data. Figure 8-1 illustrates the AQP data collection fields required for submission to the FAA. All performance data collected on each proficiency objective must be relative to the applicable AQP qualification standards defined for the training and evaluation activities.
NOTE: For each crewmember in a qualification or continuing qualification curriculum, the FAA must be able to associate the data records applicable for that crewmember in that curriculum through logical grouping of the records, or linkage by a common de-identified index number (but not by name).
8-5. DATA ENTRY. All performance data collected throughout the SVTP and AQP is entered into the carrier’s PPDB. Typically, this is an electronic database for ease in analysis, comparison, and reporting purposes. Considerations for data entry include the method, the hardware/software required for data input, and the hardware/software required for data storage and manipulation.
Database design is at the discretion of the carrier, providing that the design can generate the required report tables specified.
NOTE: The manager of the appropriate Safety Standards office requests copies of all grade sheets used in the evaluations or used through each gate.
8-6. DATA SUBMISSION. The FAA has established the minimal requirements for the submission of de-identified data by curriculum. Figures 8-2 through 8-4 summarize the submission requirements in three tables. The three tables are the Performance Data Report Table (PDRT), the Skill Reason Table (SklRsn) and the Training Objectives Report Table (TORT).
The information in these tables is downloaded from the carrier’s PPDB. The submissions are forwarded to the manager of the appropriate Safety Standards office electronically in 1 calendar-month blocks for both the SVTP and AQP using a Microsoft Access (.mdb) format