Job Summary
Reporting to the Medical Director, the Program Evaluator for the Proactive Support Team (PST) program will have a central role in documenting the impact of the PST model, supporting replication across sites, and producing evaluation reports that inform system-level improvements. The Program Evaluator will be responsible for leading data management, evaluation, and outcome measurements across the initiative. This role ensures that program fidelity, feasibility, scalability, and sustainability are rigorously assessed, and that data drives both daily practice and long-term strategy. The Program Evaluator will work closely with program leadership, frontline staff, and external evaluators to design, manage, and interpret qualitative and quantitative data systems, ensuring accurate reporting to funders and stakeholders. The Program Evaluator will be an active listener, provide high-quality customer service, and respond by exhibiting cross-cultural awareness with the ability to promote and contribute to an equitable and inclusive anti-racist organizational culture and environment.
Key Responsibilities & Essential Functions
Evaluation & Data Systems:
Design and oversee data collection systems to track engagement, service utilization, housing stability, and health outcomes.
Develop and manage program logic models, KPIs, and fidelity monitoring tools.
Conduct internal program evaluation, including pre/post surveys, staff fidelity assessments, and resident outcome tracking.
Collaborate with external evaluators to ensure independent validation of results.
Prepare IRB protocols and ensure compliance with ethical research standards.
Conduct both qualitative (e.g., interviews, focus groups) and quantitative (e.g., statistical analysis, dashboards) evaluations.
Produce monthly dashboards, quarterly performance reports, and annual evaluation summaries for funders and leadership.
Support continuous quality improvement by providing timely feedback loops to program staff.
Collaboration & Capacity Building
Work with program staff to integrate evaluation findings into daily practice.
Train staff in data literacy, documentation standards, and fidelity to the PST engagement model.
Support program leadership in aligning evaluation findings with organizational strategic priorities.
Disseminate findings to stakeholders, including through conference presentations, peer-reviewed publications, and policy briefs.
Administrative & Reporting:
Ensure timely submission of accurate evaluation reports to Helmsley Charitable Trust and other funders.
Manage data entry and reporting platforms (e.g., AWARDS, Excel, statistical packages).
Assist with grant applications by providing evaluation data, outcomes analysis, and projected impact metrics.
Ensure compliance with all Urban Pathways, regulatory, and funding agency requirements regarding data management.
Communication:
Communicate effectively, both verbally and in writing, in a professional manner.
Facilitate and attends meetings, training, and supervisory sessions.
Respond promptly to communications, including phone calls, emails, and written inquiries.
Performs all other duties as assigned and as required.
