In this role on our global content development team, you will be responsible for both AI-driven and traditional content development activities. You will provide input for the development and enhancement of AI software, utilizing this and other artificial intelligence tools to generate and curate test items, engage in prompt engineering, and collaborate with AI specialists to refine content generation algorithms.
You will be expected to manage a workstream of overlapping projects such as client-centric prompt engineering experiments. You also will likely lead small projects to tackle specific integration challenges and provide vision for innovation within the content development process. You will partner with clients and cross-functional teams on multiple exam programs and deliverables, monitoring scope and deadlines as well as escalating risks as needed.
In your support of the content development teams, you may facilitate in-person and virtual content development workshops with subject matter experts (SMEs) to write and review exam items and assemble examinations. You will evaluate test items applying best practices in assessment and statistical performance data.
SCOPE AND IMPACT OF THE JOB
The tasks performed in this position highly impact the business interests of the company. This position will play a critical role in shaping Pearson VUE’s approach to integrating generative AI in test development processes.
PRIMARY RESPONSIBILTIES
- Content Creation and Curation: Utilize both artificial intelligence tools and traditional methods to generate and curate test items and exam content, ensuring alignment with best practices in assessment and educational standards. Engage in prompt engineering to design and refine AI prompts that yield high-quality, relevant content.
- Research and Development: Contribute to the research and design of AI applications specifically tailored for content development in high-stakes exams. Stay current with the latest advancements in AI and machine learning to identify potential applications within the content development lifecycle.
- Integration and Implementation: Integrate AI-generated content into existing item banks and exam forms, ensuring seamless compatibility and functionality. Work with cross-functional teams to implement AI solutions, providing training and support to ensure smooth adoption.
- Quality Assurance: Perform rigorous quality checks on both AI-generated and traditionally developed content to ensure it meets Pearson VUE's standards for accuracy, validity, and style.
- Data Analysis and Feedback: Analyze performance data of both AI-generated and traditionally developed content to identify trends, strengths, and areas for improvement. Provide feedback to AI development teams based on statistical analysis and SME input to enhance AI algorithms.
- Training and Support: Train fellow content developers and SMEs on how to effectively use AI tools for content creation and review. Offer ongoing support and troubleshooting assistance for AI-related queries and issues.
- Collaboration and Communication: Collaborate effectively with members of testing services teams and other cross-functional Pearson teams, providing timely and complete input on reports, documentation, projects, teams, meetings, and process improvements.
- Confidentiality and Security: Understand intellectual property confidentiality and security considerations and abide by defined business practices to provide appropriate protection.
CORE COMPETENCIES
- AI Literacy and Technical Proficiency: Demonstrate a solid understanding of artificial intelligence and its applications, particularly in content development and assessment. Show proficiency in using and evaluating AI content creation tools and software, with the ability to troubleshoot and optimize their use.
- Innovation and Adaptability: Embrace and champion innovative technologies and approaches, adapting quickly to new tools and methodologies in both AI-driven and traditional content development.
- Collaboration and Communication: Work effectively with AI specialists, developers, and product teams as a key stakeholder to integrate AI solutions into the content development process. Communicate information effectively to various stakeholders, including subject matter experts (SMEs), ensuring clarity and understanding.
- Content Development Expertise: Exhibit strong skills in traditional content development processes, including item writing, item bank management, and quality control, ensuring alignment with best practices in assessment and educational standards.
- Analytical Thinking: Apply strong analytical skills to evaluate both AI-generated and traditionally developed content, using statistical data and performance metrics to inform decisions and improvements.
- Continuous Improvement: Maintain a continuous learning orientation, staying current with the latest AI advancements and traditional content development techniques. Incorporate new knowledge into the content development workflow to drive ongoing improvement.
- Integrity and Attention to Detail: Demonstrate integrity in all tasks and maintain a high level of attention to detail to ensure accuracy and quality in both AI-generated and traditionally developed content.
QUALIFICATIONS
- Bachelor’s degree required, master’s degree preferred
- Experience as content or test developer, related coursework, or other direct applicable experience preferred
- Experience with generative AI, LLMs (Large Language Models) and prompt engineering preferred
WORK ENVIRONMENT AND CONDITIONS
- Use of phone, PC, and keyboard for data input and communications
- Ability to work remotely in a secure environment
- Ability to negotiate transportation for off-site meetings and to keep on-person a laptop during transit
- Travel requirement up to 25%
Compensation at Pearson is influenced by a wide array of factors including but not limited to skill set, level of experience, and specific location. As required by the Colorado, California, Washington State, New York State and New York City laws, the pay range for this position is as follows:
The minimum full-time salary range is $80,000 .
This position is eligible to participate in an annual incentive program, and information on benefits offered is here.
We value the power of an inclusive culture and also a strong sense of belonging. We promote a culture where differences are embraced, opportunities are accessible, consideration and respect are the norm and all individuals are supported in reaching their full potential. Through our talent, we believe that diversity, equity and inclusion make us a more innovative and vibrant place to work. People are at the center, and we are committed to building a workplace where talent can learn, grow and thrive.
Pearson is an Affirmative Action and Equal Opportunity Employer and a member of E-Verify. We want a team that represents a variety of backgrounds, perspectives and skills. The more inclusive we are, the better our work will be. All employment decisions are based on qualifications, merit and business need. All qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, gender expression, age, national origin, protected veteran status, disability status or any other group protected by law. We strive for a workforce that reflects the diversity of our communities.
If you are an individual with a disability and are unable or limited in your ability to use or access our career site as a result of your disability, you may request reasonable accommodations by emailing TalentExperienceGlobalTeam@grp.pearson.com.
Note that the information you provide will stay confidential and will be stored securely. It will not be seen by those involved in making decisions as part of the recruitment process.