Fast Facts

The College Board is seeking an Associate Director for the Score Validity Process and Test Security, responsible for overseeing investigations into score validity and maintaining the integrity of assessment processes. This role requires strong analytical skills and the ability to effectively communicate with stakeholders in a fully remote, full-time position.

Responsibilities: Lead investigations related to student test scores, manage communication with stakeholders, review policies for continuous improvement, and oversee projects to ensure effective test security measures.

Skills: Strong analytical and critical thinking skills, experience in data forensics, exceptional communication abilities, proficiency in case management tools and tools like Salesforce and Microsoft Office.

Qualifications: 5+ years in investigations or operational roles, Bachelor’s degree preferred, and a self-starter with a team-oriented approach.

Location: This is a fully remote position open to candidates in the USA, particularly New York.

Compensation: $56000 - $90000 / Annually

Associate Director, Score Validity Process and Test SecurityJ

College Board – Risk Management

Location: This is a fully remote role.

Role Type: This is a full-time position

About the Team

The Test Security team at College Board is a highly skilled group of 21 professionals dedicated to maintaining the fairness and integrity of our assessments. Through innovative, data-driven policies and tools, we work to prevent, detect, and resolve security threats, ensuring the credibility of SAT and AP exam scores. As part of this mission, the Score Validity Team—comprising 10 team members—leads investigations into potential score irregularities and violations of our terms and conditions using advanced analytics and investigative techniques. We collaborate closely with internal teams, who provide essential support and infrastructure, and partner with external vendors to ensure comprehensive security measures and scalable solutions are in place prior to the administration of each exam. Together, we uphold the highest standards of test security, reinforcing the trust and reliability of our assessment programs.

About the Opportunity

As the Associate Director of Test Security, Score Validity, you will lead investigations into student score validity, plagiarism, improper use of artificial intelligence, and test-day irregularities for the College Readiness Assessments (CRA) and Advanced Placement (AP) exams. Your primary responsibility will be to ensure these investigations adhere to a structured, evidence-based process, determining whether there is substantial cause to question a student’s score. You will analyze statistical and forensic evidence, review test-day reports, and examine test materials, while effectively communicating with students, parents, legal representatives, and educators to ensure fair resolutions. Additionally, your role involves enhancing policies, refining processes, and collaborating across teams to strengthen test security standards

In this role, you will:

Investigations & Communications (80%)

Analyze and investigate individual student score validity cases using data forensics, statistical analyses, test day reports, and interview findings. Maintain detailed and accurate records of all investigations, ensuring thorough documentation of notes, findings, and communications.
Ensure timely and thorough management of score validity investigations, maintaining clear and consistent communication with students, parents, educators, and representatives, and articulating investigation processes, evidence, and dispositions clearly to all stakeholders.
Regularly review and provide feedback on policies, processes, and protocols related to score validity and testing irregularities, contributing to continuous improvement.
Coordinate tasks across internal and external stakeholders, providing subject-matter expertise on test security investigations, and ensuring cohesive collaboration.
Maintain robust communication with critical system and product owners within Test Security Operations to ensure coordination with Technology, Operations, and Program teams.
Formulate and vet recommendations for score validity, plagiarism, and irregularity cases, handling sensitive data and urgent timelines with discretion.
Track and report key performance metrics for operational test security functions, integrating data from internal teams and security vendors to support informed decision-making.
Actively support the use of data forensics and algorithms to detect patterns of anomalous testing behavior, facilitating further investigation.

Project Management (20%)

Lead and manage projects related to test security investigations, ensuring timely completion and alignment with strategic goals.
Coordinate across teams for smooth execution of initiatives and clear stakeholder alignment.
Allocate and manage resources effectively to meet project milestones.
Communicate effectively with stakeholders and ensure staff are trained onnew programs and initiatives.
Develop detailed project plans, including scope, timelines, tasks, dependencies, and milestones, while identifying and mitigating potential risks.
Implement quality assurance processes, continuously monitor progress, and maintain thorough documentation and reporting.

About You

You have:

5+ years of experience in investigations or operational roles, with a strong track record of managing complex cases.
Self-starter mentality, with the ability to work independently and as a team while meeting timelines and deliverables.
Strong analytical and critical thinking skills, including experience in data forensics, reporting, and case management tools.
Exceptional communication skills, including attentive listening, confident speaking, clear writing, and effective presentation abilities.
Ability to influence and collaborate across teams, building strong stakeholder relationships.
Strategic thinking and multitasking abilities, with high attention to detail and the capacity to plan across both short and long-term timelines.
Advanced proficiency in Salesforce, cloud-based contact center solutions, Microsoft PowerPoint, Word, Excel, and Outlook.
Bachelor’s degree preferred.
The ability to travel 2-3 times a year to College Board offices or on behalf of College Board business
Authorization to work in the United States.

All roles at College Board require:

A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success

About Our Process

Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days.
While thehiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

What We Offer

At College Board, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.

A Thoughtful Approach to Compensation

The hiring range for this role is $56,000 –$90,000.
Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.
We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
We adjust salaries by location to ensure fairness, no matter where you live.

You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more.

#LI-remote

#LI-MD1

Score Validity EdTech Jobs

Associate Director, Score Validity Process and Test Security