Director of Exam Requirements and Psychometrics

Company: The American Registry of Radiologic Technologists
Location: Saint Paul
Posted on: May 13, 2022

Job Description:

Director of Examination Requirements and Psychometrics- hybrid-- - St Paul, MN Description Do you have a master--------s degree, along with strong management experience in the Credentialing field? If so, we want to talk to you about our opening for a-- -.-- -You don--------t need a background specifically in psychometrics or industrial/organizational psychology. At The American Registry of Radiologic Technologists-- -, our Examination Requirements and Psychometrics team is responsible for the assessment component of our credentialing programs. As the Director of Exam Requirements and Psychometrics, you--------ll be responsible for maintaining the integrity of our programs and the leadership of the team.-- - This is a hybrid position with time divided both working onsite at our office in St. Paul, MN and remotely. -- -It reports to the Senior Director of Credentialing Operations, -- -works closely with the Executive Director and, when needed, the Board of Trustees.-- - We--------ve listed an overview of the departmental responsibilities below. We haven--------t differentiated the activities you--------ll perform and those you--------ll delegate. That--------s because this position is ultimately responsible for the performance of the team and for the quality of our assessment development process and products. -- - Department--------s Key Duties and Responsibilities-- - General Managerial Responsibilities

• As the head of your department, you--------ll be responsible for managing staff, assessing departmental staffing needs, hiring, training, performing employee performance reviews, and completing other general managerial duties.-- -
• You--------ll also be responsible for department budgeting and contributing to strategic planning for the department and organization.-- - Assessment Development (Includes examination and structured self-assessments)
  • Plan and conduct practice analyses projects
  • Develop/revise content specifications and competency/clinical experience requirements based upon practice analysis results
  • Administer program of item development (i.e., item writing, pilot testing, and calibration)
  • Plan and conduct standard setting projects
  • Responsible for all the steps in the Structured Self-Assessment (SSA) process Assembly and Production
    • Assemble assessment forms and other materials for committee meetings
    • Schedule meeting dates, plan, and coordinate activities for committee meetings
    • Conduct meetings of committees
    • Produce electronic assessment forms to send to CBT vendor
    • Conduct quality control checks on electronic assessment forms assembled by CBT vendor
    • Maintain item banks
    • Maintain Assessment Development Procedures Manual -- -Scoring, Analysis, and Reporting
      • Review item analysis and assessment participant comments
      • Run programs and interpret data to process assessment results
      • Maintain equating mechanism
      • Maintain quality control checks on overall process
      • Prepare reports summarizing assessment results
      • Maintain sections of Assessment Processing Manual which cover procedures for which Psychometrics Services is responsible Examination Security
        • Maintain the validity of the assessments by employing the latest procedures to identify: Those using others to complete the assessment for them, examinees with pre-knowledge of the assessment content, or copyright infringement
        • Develops policy recommendations and is responsible for the executing security policy for all content contained in assessments
        • Chair of the Assessments Security Team (AST) and recommends corrective action for security incidents based on AST investigations
        • Executes policies for procuring legal protection for ARRT intellectual property (copyright of item bank, trade secrets)
        • Maintain confidential and accurate records when engaged in a legal action
        • Effectively represent ARRT in depositions and/or when asked to testify in a court of law Miscellaneous
          • Assure procedural integrity for the administration of ARRT examination requirements and continuing qualifications requirements
          • Work with Strategic Communications to develop informational materials (e.g., articles, news releases, slide shows, Certification Handbooks (Primary Pathways, Post-Primary Pathways, and R.R.A.), Handbook for State Licensing Examinees, Examinee Handbook for Limited Scope, Item Writing Manual) on assessment development, assembly, scoring analysis and reporting
          • Prepare project and technical reports on examination development, assembly, scoring, analysis and reporting
          • Respond to questions/complaints on examination development, assembly, scoring, analysis, and reporting
          • Identify issues requiring Board policy decisions on exam development, assembly, scoring, analysis and reporting
          • Provide staff support on psychometric issues at Board Meetings
          • Interact with Information Technology Department on development and maintenance of computer programs for psychometric services Research
            • Collect, analyze, and report data as input into decision making processes
            • Provide technical assistance in research design and data analysis to staff
            • Participate in scholarly research as time permits
            • Keep informed of issues and new developments in certification and licensure testing Cross Departmental Responsibilities
              • Work with our Strategic Communications department to develop informational materials (e.g., articles, news releases, presentations, and handbooks)-- -
              • Partner with our Information Technology department to develop and maintain computer programs for psychometric services YourMembership. Keywords: Psychometrics Director, Location: Saint Paul, MN - 55120

Keywords: The American Registry of Radiologic Technologists, St. Paul , Director of Exam Requirements and Psychometrics, Executive , Saint Paul, Minnesota