Associate Psychometrician
TheCollegeBoard

About the Team

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. College Board's Psychometrics provides its partners with measurement solutions that set the standard for quality, efficiency and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board's mission of access and equity in Education.

About the Opportunity

As Associate Psychometrician, you will be responsible for supporting routine psychometric operational and research work for College Board Advanced Placement suite. Psychometric support includes running pre-existing code to conduct routine analyses, interpreting results, and raising issues/making recommendations based on results. Analyses include procedures such as equating and scaling, item calibration, production of item and test analysis reports using both classical and item response theory models, creation and review of test documentation materials, supporting and/or facilitating standard setting, drafting papers and reports and presenting findings to internal and external audiences. You will work collaboratively with and under the supervision of more senior staff.The role also includes providing psychometric support for other College Board Assessment Programs (ACCUPLACER, CLEP, and SAT Suite of Assessments) as needed.

In this role you will:

Operational Psychometrics

• Conduct routine operational psychometric work for College Board assessments as assigned, including but not limited to equating, linking, scaling, item and test analyses, DIF, and standard-setting, using standard and customized psychometric analysis tools and statistical software packages
  

• Contribute to the development and improvement of operational processes under the direction of more experienced staff
  
• Conduct quality assurance and quality control procedures as requested to ensure the quality and accuracy of results
  
• Contribute to the development of software programs, documentation, and implementation of statistical and reporting systems under the guidance of more experienced staff
  
• Contribute to technical reports for internal and external clients
  

Psychometric Research

• Conduct research consistent with the research agenda for the program and/or Psychometrics under the guidance/supervision of more experienced staff
  

• Create and deliver presentations of their own research (or that they are a part of) to internal and external audiences
  
• Have papers accepted to major measurement conferences (such as NCME) where they are first author and primary presenter at the conference
  
• Be a named author in a professional publication in a peer-reviewed journal
  

Relationship Management

• Most professional working relationships are with colleagues within their unit of Psychometrics, playing a predominantly support role in those relationships. These relationships are collegial, productive and the person has the respect and appreciation of those they have collaborated with
  

About you

You have:

• A Doctorate in psychometrics, educational research, educational measurement or a related field
  
• Training in and familiarity with classical test theory, equating, item response theory, item and test analyses, DIF, standard setting and other psychometric analyses
  
• Demonstrated proficiency with SAS,R and/or Python
  
• Demonstrated ability to design and conduct psychometric analyses, research studies and complex statistical analyses
  
• Proficiency with other statistical analysis tools, such as: R, BILOG, FLEXMirt, WINSTEPS, GENOVA, or PARSCALE
  
• Ability to quickly and accurately work with new datasets and assessment data.
  
• Ability to work in a collaborative environment that emphasizes quality, rigor, adaptability, and critical thinking
  
• Strong organizational, time management, and detail orientation skills
  
• Excellent oral and written communication skills including technical presentation, public speaking, interpersonal, and writing and editing skills
  
• Strong problem-solving skills
  

This job has expired.