Fast Facts
The College Board is seeking an Applied Data Scientist / Assessment Data Scientist to enhance psychometric operations and data workflows in its Latin America office, leveraging analytical skills to ensure robust educational assessment systems.
Responsibilities: Key responsibilities include maintaining automated data pipelines, performing statistical analysis and item calibration, ensuring data quality and compliance, and developing data visualizations.
Skills: Candidates must have proficiency in R, Python, SQL, and data visualization tools, along with experience in psychometrics and applied quantitative research.
Qualifications: A Master’s degree in Statistics, Data Science, or Psychometrics is required, along with 5-8 years of relevant experience and bilingual proficiency in Spanish and English.
Location: This job is located in San Juan, Puerto Rico, with a hybrid work schedule requiring on-site presence at CB offices every Tuesday and Wednesday.
Compensation: $45000 - $61000 / Annually
Internal title:Associate Director, Psychometric Operations & Data Science
External Posting Role Title:Applied Data Scientist / Assessment Data Scientist
College Board -Global Strategy and Talent, College Board LATAM
Location:San Juan, Puerto Rico.This is a hybrid role and requires the candidate to be on-site at CB offices every Tuesday and Wednesday.
Role Type:This is a full-time position.
About the Team
The Latin America Office at the College Board is dedicated to expanding educational opportunities and improving student outcomes across the region. Embedded within the Research and Development (R&D) division, the Research & Measurement (R&M) team is dedicated to ensuring that our assessments are scientifically sound, evidence-based, and aligned with our mission.
We work at the intersection of psychometrics, data science, and applied research, guiding how our assessments are designed, scored, and continuously improved. Our team ensures that research and measurement practices are transparent, defensible, and grounded in robust methodological standards.
R&M also collaborates with internal and external stakeholders to generate insights that advance the region’s educational goals, promoteequitabletest use, and strengthen the link between assessment results and educational outcomes. Together with colleagues in Technology, Assessment Operations, and Market Development, we are building the data systems and analytic capabilities that will power the next generation of digital, research-informed assessments across Latin America.
About the Opportunity
The (Applied Data Scientist / Assessment Data Scientist), internally known as, Associate Director, Psychometric Operations & Data Science, plays a hands-on role in strengthening the accuracy, efficiency, and innovation of CB-LATAM’s psychometric and operational data workflows.
You will design andmaintainautomated data pipelines that enable scoring, scaling, and reporting processes to run smoothly and reproducibly. You will also perform item calibration, statistical analysis, and quality control to support scoring operations and ensure that the item bankremainscurrent, valid, and reliable. By improving data workflows and implementing analytics-driven solutions, you will help modernize psychometric operations and embed quality controls throughout the data lifecycle.
Beyond R&M, you will also serve as CB-LATAM’s data governor—understanding what comes in and what goes out, whereit’sstored, how longit’sstored, and whatit’sused for. You will act as an owner of the architecture of our data, ensuring its integrity, accessibility, and compliance with internal policies and professional standards. Working in close partnership with Psychometricians, R&D staff, and Technology teams, you will apply advanced statistical and programming skills to streamline complex workflows, automate recurring processes, and transform data into actionable insights.
This role is ideal for a technically skilled and analytically curious professional who wants to contribute directly toevidence-based innovation in educational measurement, while ensuring that CB-LATAM’s data systems areaccurate, policy-compliant, and future-ready.
In this role, you will:
Psychometric Operations (40%)
- Support scoring operations through quality assurance routines, data validation, and review of scoring keys, parameters, and distributions.
- Maintain and update the item bank database, ensuring data accuracy, version control, and metadata integrity.
- Execute item calibrations and test-level analyses using classical test theory (CTT) and item response theory (IRT) models.
- Conduct statistical and psychometric analyses for pretests, operational forms, and field test data.
- Collaborate with Psychometricians to ensure operational equating and scaling are performed with precision and consistency.
Data Operations, Automation & Governance (35%)
- Serve as CB-LATAM data governor: overseeing data flow, architecture, and lifecycle management across psychometric and operational systems.
- Ensure that all data systemscomply withCollege Board governance policies, professional testing standards, and privacy requirements.
- Monitor data inflow/outflow and document data usage, ensuring transparency and ethical stewardship.
- Implement reproducible scripts and validation routines (in R or Python) to standardize workflows.
- Build,maintain, and automate data pipelines for scoring, equating, and reporting.
- Contribute to research documentation, technical reports, and internal publications summarizing results and innovations.
Applied Data Science & Analytics (25%)
- Develop dashboards and visualizations that summarize psychometric and operational indicators.
- Identifyopportunities to automate repetitive processes, reduce manual dependencies, and strengthen quality assurance.
- Apply AI and machine learning techniques to detect data anomalies and enhance workflow efficiency.
- Partner with Psychometricians, Technology, and R&D staff to deploy analytic solutions into production environments and improve system interoperability and reporting efficiency.
About You:
- Master’s degree in Statistics, Data Science, Psychometrics, or relatedfield.
- 5–8 years of experience in data analytics, psychometric operations, or applied quantitative research.
- Proficiencyin R, Python, SQL, and data visualization tools (Tableau, Power BI).
- Working knowledge of IRT and CTT models, scaling, and equating procedures.
- High attention to data quality, compliance, and ethical standards and the ability to dissect complex data problems, troubleshoot issues, and craft actionable solutions.
- Experienceleveragingdata insights to influence both operational and strategic decisions.
- Skilled in automation, analytical rigor, programmingproficiencyand reproducible workflow design.
- Ability to travel 1-2 times a year to College Board offices or on behalf of College Board business.
- Bilingualproficiencyin Spanish and English.
- This position primarily involves sedentary work performedata computer. The role requires the ability to sit or stand for extended periods, communicate effectively, andoperatestandard office equipment.
All roles at College Board require:
- A passion for expanding educational and career opportunities and mission-driven work
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
- Clear and concise communication skills, written and verbal
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receivingtimely, respectful feedback, and continuously improving through iterative learning and user input.
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
- Authorization to work in the United States
About Our Process
- Application review will beginimmediatelyand will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
- Whilethehiring processmay vary, it generallyincludes:resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.
What We Offer
AtCollegeBoard, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.We’rea self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
- The hiring range for this role is $45,000–$61,000.
- Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
- We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
- We adjust salaries by location to ensure fairness, no matter where you live.
You’llhave open, transparent conversations about compensation, benefits, and whatit’slike to work atCollegeBoard throughout your hiring process. Check outourcareers pagefor more.
#LI-remote
#LI-MD1
