Fast Facts
The College Board is seeking a remote Executive Director to oversee the Advanced Placement Curriculum and Assessment with a focus on Reading and Scoring, ensuring high-quality, fair, and consistent assessment for over 20 million student responses across 40+ AP subjects.
Responsibilities: Lead strategy, training, and systems for the AP Reading process, managing the development and maintenance of scoring guidelines and ensuring scoring integrity and consistency.
Skills: Proven leadership in assessment operations, expertise in scoring quality, rubric development, data-driven decision-making, and exceptional communication skills.
Qualifications: 10+ years of experience in high-impact program leadership within education, a master’s degree in a relevant field, and experience with emerging technologies in assessment processes.
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Compensation: $144000 - $215000 / Annually
Executive Director,Advanced Placement, Curriculum and Assessment, Reading and Scoring
College Board – Advanced Placement & Instruction
Location:This is a fully remote role. Candidates who live near CB offices have theoptionof being fully remote or hybrid (Tuesday and Wednesday in office).
Role Type:This is a full-time position
About the Team
The AP Curriculum and Assessment Team at College Board (110+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP’s 40+ courses in a wide variety of subject areas. AP® is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level.
The AP Reading and Scoring function lies at the heart of AP’sassessmentintegrity and instructional value. Each year, more than 18,000 college faculty and AP teachersconveneto evaluate millions of student responses, ensuring scoring quality, fairness, and consistency across subjects. The AP Curriculum & Assessment (C&A) team—through its leadership of Reader training, scoring guidelines, standard and grade setting, and publications—ensures that each exam scorerepresentsa valid, reliable measure of student achievement aligned to college-level standards.
Aboutthe Opportunity
AsExecutive Director, Advanced Placement, Curriculum & Assessment, Reading and Scoring, you will lead the strategy, systems, and professional learning infrastructure thatpowerthe AP Reading—the foundation of scoring excellence and validity across 40+ AP subjects.
You will serve as the operational and strategic leader for the planning, training, and systems that enable the 18,000+ AP Readers, 40+ Chief Readers, and 80+ internal Course Experts in AP Curriculum & Assessment to execute scoring with fidelity, accuracy, and consistency. This includes leadership overReader training and readiness, thedevelopment and maintenance of scoring guidelines and generic rubrics, theannualgrade- and standard-setting processes, and theReading publications library, as well as ongoing innovation to advance AP scoring quality and efficiency.
Each year, thesystemsand teams you lead will enable more than18,000 faculty and AP teachersto accurately score over20 million student responsesacross40+ AP subjects and multiple exam versions. Your leadership will ensure that every AP Exam score reflects fairness, validity, and reliability—empowering students, teachers, and institutions to trust in the rigor and accuracy of AP assessment.
You will collaborate closely with theAP Curriculum & Assessment Leadership Team, within which you will sit, as well as AP Assessment Production, AP Delivery, and AP Psychometrics to ensure the reliability, validity, and fairness of scoring processes and outputs. You will also champion cross-functional alignment, ensuring that all Reading, scoring, and standard-setting activities are planned, executed, and communicated with clarity and excellence.
You will directly lead three senior staff members:
- Senior Director, AP Reader Training
- Senior Director, Reading Publications and Quality Assurance
- Senior Project Manager, Reading, Scoring, and Coordination
In this Role, You Will:
DriveAP Reader Training and Course Expert Readiness (25%)
- Lead the strategy and execution of training programs that prepare 18,000+ AP Readers and scoring leaders annually to score 20 million+ student responses across 40+ AP subjects.
- Advancetraining and readiness of 80+ internal AP Course Experts, ensuring all are prepared tofacilitatePre-Reading Prep, Pre-Reading, and Reading activities across all AP Exams.
- Develop and deliver the annual AP Reader learning courses, training modules, user guides, and job aids, ensuring readiness by mid-May each year.
- Leadthe AP Internal Training Series, ensuring C&A staff receive end-to-end training on Pre-Reading planning, sample selection, annotation, digital scoring tools, and post-administration publications.
- Partner with AP Assessment Leadership and AP Delivery to ensure training systems, LMS environments, and scoring applicationsoperateseamlessly and meet needs to train Readers and execute all scoring at the AP Reading.
- Integrate learning science, accessibility, and AI-driven design tools to improve training quality, efficiency, and consistency.
- Establish systems to measure Reader confidence and scoring consistency, achieving a goal of 90% Reader agreement that scoring materials enableaccurateand consistent scoring.
- Guidethe annual selection process of the new cohort of Chief Reader Designates in partnership with AP Delivery.
Develop and Produce Scoring Assets (20%)
- Leadthe annual development and review of 650+ scoring guidelines across 40+ AP subjects, ensuring alignment with course frameworks, psychometric standards, and instructional validity.
- Lead the maintenance and evolution of AP’s library of generic rubrics to ensure consistent, transparent application across all subjects and exam formats.
- Direct the development of all Reading planning workbooks (five-part Smartsheet suite) used toidentifysample-selection requirements and scoring leadership needs for multiple forms (4–5) across 38 courses.
- Leadcreation of post-administration publication templates and assets, including Chief Reader Reports, Free-Response Questions, scoring commentaries, Summer Institute workshop packets, and AP Central materials for multiple forms across all subjects.
- Partner with AP Assessment tomaintainand provision gold-source documentation for scoring systems, including dimension names, IDs, score scales, and form data.
- Partner with AP Publications and AP Professional Learning teams to ensure all scoring and publication materials meet accuracy, accessibility, and instructional value standards.
- Provide oversight and escalation for all test-security processes related to Exam and Reading assets, ensuring management oftimelyresponses to flagged or exposed content as well as student work flagged as plagiarized or compromised, in alignment with CB Test Security standards and processes.
Drive Innovation, Systems Integration, and Continuous Improvement (20%)
- Lead modernization of Reading systems, processes, and training through digital tools and generative AI for workflow automation, content generation, and efficiency.
- Advance integration across SharePoint, Smartsheet, LMS, and vendor platforms to enhance coordination, transparency, and reporting.
- Define annual technical and MVP requirements for the scoring application, in collaboration with AP Assessment and AP Delivery leaders.
- Guidethe establishment of calibration and quality configurations supporting AP calibration, rater performance, and validity standards.
- Lead data-driven retrospectives to assess rubric design, scoring performance, and training outcomes, implementing improvements across cycles.
Lead andManagetheAP Reading and ScoringTeam (15%)
- Lead a team of 3 thatis responsible forthe planning and execution ofthe annual Reading, ensuring all student responses are scored accuratelyand fairly, according toassessmentbest practices.
- Set vision and priorities for the team, track and manage progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission.
- Cultivate an inclusive and high-achieving culture that enables all team members to live out CollegeBoard’sOperating Principleseffectively.
- Bring proven leadership experience and consistently embody CollegeBoard’sManager Expectationsin your work.
Lead Standard Setting and Grade Setting (10%)
- Lead the annualgrade-setting process across 40+ AP subjects, ensuring all cut scores aredeterminedthrough rigorous psychometric methods andestablishedCollege Board standards.
- Collaborate withAP PsychometricsandAP Curriculum & Assessment Course Teamsto analyze performance data andestablishcut scores for multiple exam forms per subject.
- Ensure100% of AP Exam cut scoresare based onpsychometric best practices, including equating orEvidence-Based Standard Setting (EBSS), to uphold fairness, validity, and reliability across administrations.
- LeadEBSS standard setting processesfor selected subjects annually, partnering with Psychometrics and C&A Course Teams to develop theBriefing Book, conduct data analyses, and support the evaluation of score outcomes.
- Maintain and analyzeAP Exam performance datato inform internal reporting, trend analysis, and continual improvement of exam design, scoring accuracy, and operational quality.
- Ensure that byJune 30each year,cut scores arefinalizedfor multiple exam forms across all AP subjects, supporting valid and reliable scoresetting.
- Partner with AP leadership to communicate grade-setting outcomes and ensure alignment between psychometric analyses, scoring policies, and instructional intent.
- Leadthe documentation, validation, and archival of standard- and grade-setting processes in compliance with College Board research and quality standards.
Strategic Planning (10%)
- Lead annual strategic and operational planning cycles for Reading and Scoring, ensuring capacity, change initiatives, and performance metrics align with AP’s strategic priorities.
- Partner with finance and operations to ensure fiscal responsibility and strategic use of resources.
- Track progress toward AP Program scoring goals and report key outcomes to AP leadership.
About You
You have
- 10+ years of experience leading high-impact programs withexpertisein large-scale assessment operations, scoring, or training systems within complex organizations, ideally in education, nonprofit, or mission-driven environments
- Deep understanding of assessment design, scoring quality, rubric development, and learning systems.
- Proven ability to apply emerging technologies—including generative AI—to improve scoring and training workflows.
- A strategic and inclusive leadership style: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging.
- Asystems-thinking mindset: you thrive in complexity and create clarity through structure, communication, and data-driven decision-making.
- Ability toexecute workas both a leader and collaborator across a variety of different internal teamsusing exceptional communication skillsto inspire collaboration.
- A master’s degree in a relevant field isrequired; an advanced degree is strongly preferred.
- Willingness to travel approximately 6 times per year, including 2–4 weeks from late May to mid-June for the on-site AP Readings.
All roles at College Board require:
- A passion for expanding educational and career opportunities and mission-driven work
- Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions anda comfortlearning and applying new digital tools independently and proactively.
- Clear and concise communication skills, written and verbal
- A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receivingtimely, respectful feedback, and continuously improving through iterative learning and user input.
- A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
- A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success.
- Authorization to work in the United States
About Our Process
- Application review will beginimmediatelyand continue until the position is filled.
- While the hiring process may vary, it generallyincludes:resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise (such as a work simulation), a panel interview, a conversation with leadership, and reference checks.
What We Offer
AtCollegeBoard, we offer more than a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.We’rea self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
- The hiring range for this role is$144,000–$215,000.
- Your exact salary will depend on your location, experience, and how your background compares to others in similar rolesatthe College Board.
- We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
- We adjust salaries by location to ensure fairness, no matter where you live.
You’llhave open, transparent conversations about compensation, benefits, and whatit’slike to workatCollegeBoard throughout your hiring process. Visit ourcareerspage for more.
#LI-REMOTE
#LI-AP1