Head of Analysis and Psychometrics
- Recruiter
- PEARSON EDUCATION LTD-1
- Location
- Harlow
- Salary
- Competitive
- Posted
- 17 May 2017
- Closes
- 23 May 2017
- Sectors
- Education & Teaching, Teaching Assistant
- Contract Type
- Permanent
- Hours
- Full Time
Head of Analysis and Psychometrics
Description
At Pearson, we're committed to a world that's always learning and to our talented team who makes it all possible. From bringing lectures vividly to life to turning textbooks into laptop lessons, we are always re-examining the way people learn best, whether it's one child in our own backyard or an education community across the globe. We are bold thinkers and standout innovators who motivate each other to explore new frontiers in an environment that supports and inspires us to always be better. By pushing the boundaries of technology - and each other to surpass these boundaries - we create seeds of learning that become the catalyst for the world's innovations, personal and global, large and small.
Purpose of the role
The Head of Analysis and Psychometrics is primarily responsible for conducting psychometric analysis to ensure that all test and assessment instruments are developed and maintained with high quality and consistency and meet the standards upheld in educational and psychological measurement.
This role is responsible for the development of a suite of tests aligned to the Global Scale of English to ensure they are accurate and advise on the appropriate use of assessment methodology across measurement instruments and learning materials. This role is also responsible for managing staff to conduct psychometric activities reporting outcomes and conducting experimental research as necessary to support assessment and learning products.
Key Accountabilities:
Quality Management
The Head of Analysis and Psychometrics will:
Ensure adherence to the professional standards as expressed, e.g., in the APA standards and in codes of practice established in the language testing field;
Conduct and/or supervise the psychometric analyses necessary to ensure all products are aligned to the Global Scale of English (GSE);
Give advice and conduct analysis within English and Schools to ensure all its products, as required by the business, are demonstrably linked to the GSE;
Contribute to experimental research concerned with the validation of tests and their alignment with national and international standards such as the CEFR;
Be responsible for reviewing assessment specifications, approving them as valid and fit for purpose;
Review marking criteria and suggest necessary revisions;
Evaluate how technology impacts on assessment and instructional materials ;
Monitor the language testing environment and international government policy decision/reforms relating to academic criteria of tests and updating management on any significant developments that may impact on test design;
Monitor the products and research of competitors to products remain at par or ahead of the competition
Involve colleagues form other units across Pearson to ensure maximum usage of Pearson's resources to challenge our approach and procedures and to obtain advice for improvements
Be responsible for leading technical and research projects in addition to providing guidance and oversight to project staff on aspects of their work;
Ensure quality control of all deliverables;
Responsible for the psychometric quality of designated assessment and learning products.
Customer Service
The Head of Analysis and Psychometrics will:
Ensure a high standard of customer service by ensuring all documentation about the test programmes meets academic standards and is up-to-date and correct;
Write documents about psychometric issues that can be understood by stakeholders such as teacher, parents, candidates;
Contribute to publications and conferences reporting relevant outcomes of psychometric work;
Deal promptly and expertly with customer queries relating to linguistic and psychometric issues
Internal Relationships
The Head of Analysis and Psychometrics will:
Report to the Test Develop Director, Global ELT
Confer with Test Development, Psychometric and Research staff across Pearson to ensure that all psychometric analyses and internal and external research projects run a smooth and efficient workflow;
Confer with staff members within Pearson responsible for production, administration and business development to ensure a smooth and efficient workflow.
Industry Relationships
The Head of Analysis and Psychometrics will:
Maintain relationships with, and be the primary point of contact with, key academic related bodies;
Typical Tasks
The Head of Analysis and Psychometrics will:
Manage staff in conducting psychometric analyses and any experimental research;
Initiate proposals for improvement of psychometrics used to improve the quality of the test instruments;
Initiate, conduct and manage internal experimental research projects;
Contribute to the reviewing and evaluating processes in test development;
Conduct and interpret psychometric analyses of test results;
Research and propose novel procedures and methodologies;
Review test development products including test specifications, assessment criteria and training documents;
Provide advice on psychometric related matters to other teams within ELT as required;
Participate in interdepartmental and pan-Pearson initiatives;
Publish relevant experimental research results;
Deliver presentations relating to Pearson products and experimental research at national and international conferences.
Qualifications
Essential Skills
A Doctoral degree in educational measurement, educational psychology, statistics or a closely related field is required
Proven leadership and management skills in leading teams.
Broad technical understanding of current education and assessment trends and proven ability to successfully interact with colleagues in the field on substantive issues.
Very strong technical and analytical skills
Strong verbal and written communication skills.
Ability to communicate research findings and trends to policymakers, scholars, and other stakeholders.
Strong management skills, including the ability to handle multiple tasks, meet deadlines, and lead and motivate professional staff.
Preferred Skills
High level command of the English language
Knowledge of a second language
Qualified professional with extensive teaching and/or training experience
ESOL Teaching qualifications
Experience in successfully managing budgets
Personal Style and Behavior:
Leadership - Being able to lead your extended team without any formal authority. Building enough credibility and respect so that others are motivated to let you make key decisions.
Ability to influence - use both logic and emotion to win over wide ranges of audiences to your point of view as you are implementing industry standard assessment procedures.
Relationship building - build effective relationships with internal colleagues and external partners
Communication, networking and influencing skills - work effectively with colleagues in business units across Pearson and to manage effectively in a matrix structure.
Managing ambiguity - ability to work confidently and effectively in complex, changing and ambiguous situations.
Decision-making skills - ability to work independently in driving and making key strategic and practical decisions.
Commitment to Excellence - This includes excellence in the work you do and the deliverables (presentations, market requirements, business cases, etc.) you produce as well as the products themselves.
Description
At Pearson, we're committed to a world that's always learning and to our talented team who makes it all possible. From bringing lectures vividly to life to turning textbooks into laptop lessons, we are always re-examining the way people learn best, whether it's one child in our own backyard or an education community across the globe. We are bold thinkers and standout innovators who motivate each other to explore new frontiers in an environment that supports and inspires us to always be better. By pushing the boundaries of technology - and each other to surpass these boundaries - we create seeds of learning that become the catalyst for the world's innovations, personal and global, large and small.
Purpose of the role
The Head of Analysis and Psychometrics is primarily responsible for conducting psychometric analysis to ensure that all test and assessment instruments are developed and maintained with high quality and consistency and meet the standards upheld in educational and psychological measurement.
This role is responsible for the development of a suite of tests aligned to the Global Scale of English to ensure they are accurate and advise on the appropriate use of assessment methodology across measurement instruments and learning materials. This role is also responsible for managing staff to conduct psychometric activities reporting outcomes and conducting experimental research as necessary to support assessment and learning products.
Key Accountabilities:
Quality Management
The Head of Analysis and Psychometrics will:
Ensure adherence to the professional standards as expressed, e.g., in the APA standards and in codes of practice established in the language testing field;
Conduct and/or supervise the psychometric analyses necessary to ensure all products are aligned to the Global Scale of English (GSE);
Give advice and conduct analysis within English and Schools to ensure all its products, as required by the business, are demonstrably linked to the GSE;
Contribute to experimental research concerned with the validation of tests and their alignment with national and international standards such as the CEFR;
Be responsible for reviewing assessment specifications, approving them as valid and fit for purpose;
Review marking criteria and suggest necessary revisions;
Evaluate how technology impacts on assessment and instructional materials ;
Monitor the language testing environment and international government policy decision/reforms relating to academic criteria of tests and updating management on any significant developments that may impact on test design;
Monitor the products and research of competitors to products remain at par or ahead of the competition
Involve colleagues form other units across Pearson to ensure maximum usage of Pearson's resources to challenge our approach and procedures and to obtain advice for improvements
Be responsible for leading technical and research projects in addition to providing guidance and oversight to project staff on aspects of their work;
Ensure quality control of all deliverables;
Responsible for the psychometric quality of designated assessment and learning products.
Customer Service
The Head of Analysis and Psychometrics will:
Ensure a high standard of customer service by ensuring all documentation about the test programmes meets academic standards and is up-to-date and correct;
Write documents about psychometric issues that can be understood by stakeholders such as teacher, parents, candidates;
Contribute to publications and conferences reporting relevant outcomes of psychometric work;
Deal promptly and expertly with customer queries relating to linguistic and psychometric issues
Internal Relationships
The Head of Analysis and Psychometrics will:
Report to the Test Develop Director, Global ELT
Confer with Test Development, Psychometric and Research staff across Pearson to ensure that all psychometric analyses and internal and external research projects run a smooth and efficient workflow;
Confer with staff members within Pearson responsible for production, administration and business development to ensure a smooth and efficient workflow.
Industry Relationships
The Head of Analysis and Psychometrics will:
Maintain relationships with, and be the primary point of contact with, key academic related bodies;
Typical Tasks
The Head of Analysis and Psychometrics will:
Manage staff in conducting psychometric analyses and any experimental research;
Initiate proposals for improvement of psychometrics used to improve the quality of the test instruments;
Initiate, conduct and manage internal experimental research projects;
Contribute to the reviewing and evaluating processes in test development;
Conduct and interpret psychometric analyses of test results;
Research and propose novel procedures and methodologies;
Review test development products including test specifications, assessment criteria and training documents;
Provide advice on psychometric related matters to other teams within ELT as required;
Participate in interdepartmental and pan-Pearson initiatives;
Publish relevant experimental research results;
Deliver presentations relating to Pearson products and experimental research at national and international conferences.
Qualifications
Essential Skills
A Doctoral degree in educational measurement, educational psychology, statistics or a closely related field is required
Proven leadership and management skills in leading teams.
Broad technical understanding of current education and assessment trends and proven ability to successfully interact with colleagues in the field on substantive issues.
Very strong technical and analytical skills
Strong verbal and written communication skills.
Ability to communicate research findings and trends to policymakers, scholars, and other stakeholders.
Strong management skills, including the ability to handle multiple tasks, meet deadlines, and lead and motivate professional staff.
Preferred Skills
High level command of the English language
Knowledge of a second language
Qualified professional with extensive teaching and/or training experience
ESOL Teaching qualifications
Experience in successfully managing budgets
Personal Style and Behavior:
Leadership - Being able to lead your extended team without any formal authority. Building enough credibility and respect so that others are motivated to let you make key decisions.
Ability to influence - use both logic and emotion to win over wide ranges of audiences to your point of view as you are implementing industry standard assessment procedures.
Relationship building - build effective relationships with internal colleagues and external partners
Communication, networking and influencing skills - work effectively with colleagues in business units across Pearson and to manage effectively in a matrix structure.
Managing ambiguity - ability to work confidently and effectively in complex, changing and ambiguous situations.
Decision-making skills - ability to work independently in driving and making key strategic and practical decisions.
Commitment to Excellence - This includes excellence in the work you do and the deliverables (presentations, market requirements, business cases, etc.) you produce as well as the products themselves.