Associate Director for Evaluation & Improvement

The Southern California Clinical and Translational Science Institute (SC CTSI) supports clinical and translational research and is part of a broad national network of over 60 institutions with Clinical and Translational Science Awards (CTSAs) from the National Institutes of Health that work to translate research into better health. A crucial component of the SC CTSI’s success is a rigorous approach to evaluation and improvement for local projects and processes coupled with effective participation in quality and improvement with the national CTSA consortium. We are seeking an experienced evaluation expert to 1) lead and implement best practices for planning, evaluating and improving data collection across the various groups within CTSI; 2) ensure that CTSI continues to be an effective data- and metrics-driven organization.

The Evaluation & Improvement (EI) Associate Director will report to the SC CTSI Directors and work closely with core group leaders and staff within the Institute to design and implement programmatic and Institute-wide evaluations to determine impact and drive improvement. This will include managing a small team to develop metrics of success and methodologies for collecting and analyzing data for performance management. The EI Associate Director will also contribute to national efforts to harmonize evaluation and improvement across the national CTSA consortium. This position is an excellent opportunity for a leader who seeks to apply skills in evaluation and improvement to advance local and national efforts to translate clinical research into solutions for better health.

Key Responsibilities:

50% Leadership & Implementation-

  • Work with institute and core group leaders to design and implement rigorous evaluations of SC CTSI projects and services to inform programmatic and Institute decision-making, assess impact, and measure success using various methodologies (mixed-methods, quantitative, qualitative, ROIs, etc.).
  • Work with Institute and core group directors in setting evaluation priorities in alignment with established logic models, and implement systems to display and review progress against outcomes on a regular basis.
  • Provide a coordinated approach to metric development, analysis and tracking.
  • Facilitate regular and timely collection of high-quality data, enable tracking using existing resources or lead improvements to expand and refine datasets as needed.
  • Continuously improve data management practices and systems, and inform plans for expanding technical capabilities, improving potential analyses and presentation of findings.
  • As member of the Directors Team, participate in leadership, strategic and operational decision-making, and advance EI priorities.

30% Analysis and Impact Reporting-

  • Design, oversee and support advanced qualitative and quantitative analyses to inform performance management, continuous quality improvement (CQI), and evaluations. Continually expand and refine data sources that can be leveraged to measure SC CTSI’s progress and impact on research and the community.
  • Oversee completion and submission of annual and routine reports to funders and stakeholders including NIH, advisory boards, Institute leaders, and community partners.
  • Design, administer and evaluate SC CTSI programmatic and institute-wide surveys. Communicate findings to facilitate lessons learned, best practices, impact and program improvement
  • Support core groups in reporting progress in relation to metrics and program impact to leadership and stakeholders.
  • Lead the development of dashboards and other approaches for real-time monitoring and reporting.

15% Staff Management and Support -

  • Develop strong working relationships with SC CTSI leaders to support evaluation needs.
  • Implement and track EI team members’ work plans and team’s overall strategy.
  • Identify challenges and opportunities to meet goals and timelines, oversee process improvements.
  • Propose EI team structure and staffing to meet CTSI evaluation and improvement needs.
  • Hire and train new staff members as needed; make salary, promotion and discipline decisions in accordance with SC CTSI and USC HR policies.
  • Provide coaching and capacity building to EI staff to continuously build on existing performance and contribute to team members’ growth.  Complete annual performance reviews.

5% CTSA Consortium Contribution -

  • Participate in the national CTSA consortium, including the CTSA Evaluators group.
  • Represent the SC CTSI on national committees focused on collaborative approaches to planning, evaluation, tracking, and reporting,
  • Lead the adoption of other successful models and approaches.
  • Participate in national efforts to harmonize metrics across the CTSA network.

Knowledge, Skills and Abilities:

  • 7+ years of experience leading research evaluation and improvement, ideally in academia, biomedical or clinical organization.
  • Able to handle a fast-paced environment and systems and technologies for managing high volume of data.
  • Proven track record of effectively managing research evaluation and data to assess real world impact.
  • Able to effectively communicate analyses and findings through verbal and written reports.
  • Effective interpersonal skills with ability, and attention towards developing strong working relationships with staff at multiple levels.
  • Demonstrate flexibility, adaptability and resourcefulness when confronted with shifting priorities.

Education, Training and Experience:

  • Master or PhD in social sciences, public health, program evaluation or health sciences or equivalent experience and training, with experience in health, social sciences, biomedical or relevant quantitative or qualitative research environment.
  • Proven track record in disseminating successes in academic environment (e.g. peer reviewed publications, invited presentations, etc).
  • 10+ years experience in a relevant research, biomedical, pharmaceutical or clinical setting practicing program/project management for complex, interdisciplinary programs or projects; showing increasing seniority in related fields in any capacity.
  • Experience collaborating with others in identifying data management, analysis and evaluation needs, and implementing plans accordingly.

Minimum Education: Bachelor's degree, Combined experience/education as substitute for minimum education
Minimum Experience: 3 years
Minimum Field of Expertise: Directly related professional and supervisory experience in area of program specialization


If you are a current USC employee, please apply to this USC job posting in Workday:

USC is an equal opportunity, affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other characteristic protected by law or USC policy. USC will consider for employment all qualified applicants with criminal histories in a manner consistent with the requirements of the Los Angeles Fair Chance Initiative for Hiring ordinance. We provide reasonable accommodations to applicants and employees with disabilities. Applicants with questions about access or requiring a reasonable accommodation for any part of the application or hiring process should contact USC Human Resources by phone at (213) 821-8100, or by email at  Inquiries will be treated as confidential to the extent permitted by law.

Read USC’s Clery Act Annual Security Report

Notice on Non-Discrimination

Certain positions are subject to background screening

EEO is the Law

EEO is the Law Supplement

Pay Transparency Non-Discrimination

USC is an E-Verify Employer

NIH Funding Acknowledgment: Important - All publications resulting from the utilization of SC CTSI resources are required to credit the SC CTSI grant by including the NIH funding acknowledgment and must comply with the NIH Public Access Policy.