Sean P. Connolly, Ph.D.
Odenton,Maryland
Summary
AI evaluation and data quality specialist with expertise in annotation, taxonomy development, and structured dataset review for political content and public policy domains. 15+ years of experience synthesizing complex, high-volume information into coherent, documented, and auditable structures. Skilled in guideline-based classification, error detection, content integrity evaluation, and collaboration with multidisciplinary teams to improve AI model accuracy, fairness, and reliability. Thrives in remote, detail-focused environments with rigorous quality standards.
Overview
14
14
years of professional experience
Work History
AI Evaluator, Political Bias and Content Integrity
X (Formerly Twitter)
09.2025 - Current
- Evaluate large language model (LLM) outputs for political bias, partisanship, and ideological framing across U.S. and international contexts.
- Apply structured rubrics to assess neutrality, factual accuracy, and framing balance in AI-generated political and social content.
- Identify systemic bias patterns and propose refinements to prompts, datasets, and evaluation guidelines to improve model objectivity.
- Collaborate with social scientists, data annotators, and engineers to calibrate fairness and balance metrics in model evaluation workflows.
- Produce analytic summaries explaining causes of political skew, including lexical asymmetries, sampling effects, and implicit ideological assumptions.
- Contribute to the development and validation of datasets enhancing transparency and trustworthiness in AI-generated discourse.
Analyst
U.S. Government Accountability Office (GAO)
01.2022 - Current
- Conducts qualitative and quantitative audit research and analysis of federal education and workforce programs using generally accepted government auditing standards (GAGAS).
- Designs structured data analysis plans, rubrics, and evidence matrices to evaluate performance data, qualitative interviews, focus groups, and physical evidence.
- Produces reports and policy performance for Congressional use, ensuring accuracy, clarity, and evidence-based conclusions.
- Collaborates across interdisciplinary teams to calibrate analytic frameworks and review documentation for quality and consistency.
Director, Honors College, Associate Professor of Humanities
Bluefield State University
01.2012 - 01.2022
- Oversaw curriculum design and implementation for Honors and First-Year Experience programs.
- Led faculty in developing assessment rubrics and measurable learning outcomes across general education and discipline-specific curricula for performance reporting.
- Authored instructional materials integrating digital learning platforms (LMS, Canvas, Blackboard) to promote student engagement and accessibility.
- Mentored faculty in backward design and active learning strategies for in-person and online environments.
- Developed high-performing teams by providing mentorship, guidance, and opportunities for professional growth.
- Enhanced team collaboration through regular communication, goal setting, and performance evaluations.
Education
Ph.D. - Philosophy
Cornell University
Ithaca, NY05.2010
M.A. - Philosophy
Université Paris VIII
01.2004
B.A. - Philosophy
Stony Brook University
01.1999
Skills
- AI Evaluation, Bias Detection & Content Integrity
- Prompt, Dataset, and Rubric Analysis
- Quantitative & Qualitative Research Methods
- Federal Program Auditing & Performance Evaluation (GAO)
- Evidence-Based Reporting & Policy Analysis
- Educational Assessment & Data Interpretation
- Human–AI Collaboration & Model Calibration
- Annotation & AI Evaluation Tools: ChatGPT, Claude, Slack, Quality review platforms
- Data Analysis / Assessment: NVIVO, Qualtrics, Google Forms
- Remote Collaboration: Teams, Zoom
- LMS & Digital Content Curation: Canvas, Blackboard, Moodle
- Robust documentation habits using MS Office Google Workspace
- LMS & Digital Content Curation: Canvas, Blackboard, Moodle
- Robust documentation habits using MS Office Google Workspace
- Teamwork and collaboration
Websites
Accomplishments
"Top Performer" Badge from X Ai / Mercor for Ai Evaluator Role
Timeline
AI Evaluator, Political Bias and Content Integrity
X (Formerly Twitter)
09.2025 - Current
Analyst
U.S. Government Accountability Office (GAO)
01.2022 - Current
Director, Honors College, Associate Professor of Humanities
Bluefield State University
01.2012 - 01.2022
B.A. - Philosophy
Stony Brook University
Ph.D. - Philosophy
Cornell University
M.A. - Philosophy
Université Paris VIII