Senior Manager, Credential Development & Psychometrics

Job Locations
Regular Full-Time



This position is a key function within the AMPP certification program development team responsible for providing direction and strategy in the development and management of certification examinations which includes; Job Task Analysis, item reviews, item analysis, exam blue printing, cut score setting and test updates using psychometric proven processes. In addition, this role will be required to ensure to that legally defensible models and processes are followed through entire exam lifecycle process. Furthermore, this role will have a direct relationship with the AMPP exam delivery vendor to ensure exam security policies and protocols are in place and strictly adhered to.


ESSENTIAL DUTIES AND RESPONSIBILITIES include the following. Other duties may be assigned.

  • Designs and conducts job analysis studies, including surveys and focus groups, and develops exam specifications.
  • Facilitates Item development by conducting training for item writers; facilitates exam development committee meetings with subject matter experts to review examination items, forms, and item pools; Oversee that the items are reviewed for technical content, validity, items standards, and grammatical; and designs and develops performance-based assessments and examinations with alternative item types.
  • Performs standard setting studies and guides boards in the establishment of a passing standard (i.e., cut score). Determine the cut score using either the Beta, Angoff or equivalent standard setting approach.
  • Conducts statistical analysis of assessments using classical test theory and item response theory measurement models.
  • Designs and implements pre-administration and post-administration equating and linking designs to ensure measurement equivalence of examinations.
  • Manages the overall development and delivery across the certification portfolio of projects
  • working collaboratively across various internal and external parties to ensure deliverables are completed according to quality standards and project timelines and budgets.
  • Documents project activities in well-written summary reports and presents outcomes and deliverables in a way that facilitates understanding by non-technical audiences.
  • Provides guidance to boards on issues relating to psychometrics, test development, certification operations, and accreditation of certification programs.
  • Participates in internal process development and improvement initiatives assessing current models and processes to achieve ISO 17024 accreditation.
  • Establish and monitor quality control procedures related to quantitative analyses, from data cleaning to final report, ensuring the reliability and integrity of results.
  • Establish and monitor project budgets. Mange relationships with current vendors and establish relationships with new vendors to meet business and certification delivery needs.
  • Train and coach exam development team to understand and utilize statistical analysis to improve exam quality.
  • Develop new markets for existing products. Work with marketing to communicate changes in certifications and market programs to target audiences.
  • Professional Development and Contribution to the Field
    • Submit one second author conference presentation proposal per year for a national/international conference in the testing/Certification industry
    • Volunteer on one committee at an organization in the testing/certification industry


Carries out supervisory responsibilities in accordance with the organization's policies and applicable laws. Responsibilities include interviewing, hiring, and training employees; planning, assigning, and directing work; appraising performance; rewarding and disciplining employees; addressing complaints and resolving problems.




To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.



Some travel is expected for this role and a passport is required.



  • Doctoral degree in instructional design, educational measurement, or related field, required
  • 5+ years of previous demonstrable experience in test development, item analysis, and exam security, reuired
  • Prior supervisory experience, preferred


Ability to read, analyze, and interpret general business periodicals, professional journals, technical procedures, or governmental regulations. Ability to write reports, business correspondence, and procedure manuals. Ability to effectively present information and respond to questions from groups of managers, members, employees of the organization, customers, and the general public.



Ability to calculate figures and amounts such as discounts, interest, commissions, etc. Ability to apply concepts such as fractions, percentages, ratios, and proportions to practical situations. Ability to develop and interpret business graphs.



Ability to solve practical problems and deal with a variety of concrete variables in situations where only limited standardization exists. Ability to interpret a variety of instructions furnished in written, verbal, diagram, or schedule form.



Must possess a specific level of communication skill both verbal and written. Have demonstrated personnel management skills including, but not limited to, the ability to evaluate staff performance and provide direction, is highly desirable. Ability to work in a multi‑task environment taking into account various external factors and to communicate efficiently and accurately to both managers/supervisors and subordinate staff.


Must be computer literate with knowledge and experience in word processing and spreadsheet softwares. Ability to learn and use association specific software. Core skills include;

  • Competency model development facilitation and documentation
  • Blueprint development
  • Exam design and item writing facilitation and documentation
  • Project management
  • Demonstrated knowledge in test design and psychometric theory
  • Communication and presentation
  • SME training and co-ordination
  • Demonstrated proficiency in Microsoft Office products and database software
  • Excellent written and verbal communication and interpersonal skills
  • Ability to think globally
  • Excellent attention to detail and accuracy
  • Ability to prioritize and handle multiple projects simultaneously
  • Strong organizational and problem solving abilities
  • Ability to work under pressure and meet exacting deadlines
  • Proven dependability and high regard for security
  • Strong facilitation skills
  • Strong editorial skills
  • Global business and member driven \ association experience a plus


Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed