Evaluation Associate (130 views)

Boston, MA
April 26, 2022 2022-06-25
Job Description

SCHEDULE:   Generally 40 hours, Monday-Friday, 8:30am-5:00pm occasional flexibility as necessary

This position carries at $2000.00 retention bonus, payable at 30 days and 3, 6, and 12 months in equal instalments.”

JOB DESCRIPTION:

SUMMARY OF POSITION:

The Evaluation Associate is responsible to analyze program data to assess the outcomes of Pine Street Inn programs and projects on behalf of the populations PSI serves.  In collaboration with the Director of Program Evaluation and the Senior Data Analyst, the incumbent is responsible for planning and conducting analysis of various data sources to provide insight on program performance and areas for improvement, towards an end of shaping best practice program models and policies. The overall goal of the Program Evaluation department is to work with program staff at all levels to improve the quality of services to the populations we serve, and to identify opportunities to expand services or fill gaps in programming in support of Pine Street Inn’s strategic plan. 

The Evaluation Associate’s work is driven by the data collected by PSI’s programs, and the Evaluation Associate will be a creative and analytical thinker able to suggest changes to current data collection and reporting practices to ensure that PSI’s work is driven by the most scientifically accurate and rigorous analyses.  In doing their work, the Evaluation Associate will be able to communicate with staff and leaders regardless of their technical or data proficiency in order to ask the questions and propose the changes and improvements needed to maximize each program’s effectiveness.

QUALIFICATIONS:

EDUCATION/TRAINING:

  • Bachelor’s Degree with two to five (2 – 5) years of database applications and administrative experience, preferably in human services.
  • Proficiency in office software and equipment including Microsoft Office Products (Word, Excel, and Outlook), internet use, telephone systems, and copy/scanner machines.
  • Training in basic evaluation concepts, such as logic models and theories of change.

PREFERRED:

  • Master’s Degree with database applications and administrative experience, preferably in human services, and graduate training in program evaluation, research methods, or program management, or equivalent professional experience.
  • Training experience

KNOWLEDGE/EXPERIENCE:

  • Proven experience in matrix-managing projects that involve numerous stakeholders
  • Significant applied knowledge of spreadsheet applications, MS Excel and otherwise
  • Project management experience.
  • Minimum of 3 years’ experience in data management
  • Profound Knowledge and understanding of relational databases
  • Experience in program evaluation and/or research design, data collection, and writing
  • Proven ability to communicate findings to a variety of audiences, from leadership to front-line staff
  • Strong organization and verbal and written communication skills

PREFERRED:

  • Experience in HMIS applications (e.g. Clarity Human Services by BitFocus, ETO by Social Solutions, or CaseWorthy)
  • Experience and/or training in qualitative data collection and analysis
  • Quality improvement training or experience
  • Experience with interventions towards ending homelessness.
  • 3-5 years experience in supervising
  • Management experience.

PHYSICAL ABILITIES/SKILLS:

  • Ability to access different Pine Street Inn building locations and attend local meetings.
  • Ability to use a workstation for long periods of time.
  • Ability to use a PC, phone, copier, and fax machine frequently.

MENTAL ABILITIES/SKILLS:

  • Ability to accomplish tasks in a timely manner.
  • Ability to juggle and follow through with multiple projects simultaneously.
  • Ability to interact positively with co-workers and work as a team.
  • Ability to be flexible when new priorities are presented.
  • Ability to work closely with the supervisors and program partners.
  • Ability to develop and execute action plans to resolve problematic situations.
  • Ability to convey database language to staff in a manner that all will comprehend.
  • Interest, or experience with, social justice as well as homeless and housing advocacy.
  • High degree of cultural sensitivity and ability to work effectively with diverse people and situations.
  • Excellent customer service skills; highly developed and effective interpersonal skills.
  • Ability to understand and work on behalf of people with untreated mental health issues, addiction disorders, and poor hygiene.
  • Must have highly developed professional ethics to maintain appropriate boundaries with program participants, staff, landlords, management agent staff, etc. and to support the work of a team.
  • Demonstrated experience as a self-starter; ability to work independently with limited supervision and as a member of an interagency/interdisciplinary team.

ESSENTIAL FUNCTIONS INCLUDE BUT ARE NOT LIMITED TO:

Analysis and Evaluation

  • Evaluates the effectiveness of Pine Street Inn programs, through quantitative and qualitative methods, and proposes changes to program design, data collection, and measurement to advance program goals and PSI’s mission, vision, and values, and develops plans to implement such changes.
  • Assists in conducting evaluations in collaboration with Director of Program Evaluation, Senior Director of Strategic Initiatives and relevant program leaders to foster buy-in and joint learning on program performance and goals.
  • In collaboration with the Director of Program Evaluation, the Senior Data Analyst, and the Sr. Director of Strategic Initiatives, manages the collection of and reporting on PSI’s program outputs and outcomes framework, including quarterly and fiscal year goals. Identifies areas of strengths and challenges for programs.
  • Collaborates with the Senior Data Analyst and Director of Evaluation in probing PSI program participant data for in-depth analysis and evaluation.
  • Produces data reports to: assist in meetings on reporting requirements, benchmark achievable program outcomes, and inform program directors of data points in a timely manner to effect programmatic course correction.
  • In collaboration with the Senior Data Analyst and the Director of Program Evaluation, designs dashboards for program managers to monitor program performance, data quality, and outcomes. Supports program managers in using such dashboards, and identifies and proposes solutions to address potential additional needs.
  • Provides enhanced program monitoring and strategic implementation support for the Housing Works Partnership, a Rapid Rehousing program.
  • Optimizes the HMIS system to produce data for outcomes and program quality improvement, in collaboration with the Director of Program Evaluation.
  • Supports program managers with creating processes and procedures to ensure accurate and timely data entry, including the design of visual and textual support material. Together with the Associate Director of HMIS and the Director of Program Evaluation, designs and implements changes to support these processes and procedures.
  • Tests results from various analytical methods if they reflect the “real-world”.
  • Plans and conducts quality improvement efforts, such as Plan-Do-Study-Act (PDSA) cycles, to test, reflect on, and scale successful program changes.
  • In collaboration with the Director of Evaluation, plans and conducts and/or oversees qualitative data collection efforts as needed to answer questions of interest. Conducts qualitative analysis, such as thematic analysis, and disseminates findings.
  • In collaboration with the Director of Evaluation, conducts process and/or implementation evaluation efforts to assist programs in reflecting on successes and challenges, as well as identifying barriers to implementation.
  • Disseminates findings from quantitative and qualitative analyses to various audiences, such as program and agency leadership and front-line staff. Employs different modalities as necessary for different audiences.  Accepts and responds to suggestions, questions, and feedback from PSI staff at all levels as to these findings.
  • Based on findings of data analysis and in collaboration with Director and Sr. Director, recommends more effective and efficient program policies and procedures.
  • Participates in the efforts to produce research on Pine Street Inn initiatives, particularly with newer interventions, which may be published and utilized in local and national arenas to increase the viability of homeless service programs.
  • Actively participates in the planning and implementation of data-based solutions to fulfill Pine Street Inn’s mission to end homelessness.
  • Proposes changes to current reporting and data collection fields, templates, and practices in support of PSI’s strategic plan.
  • Inputs data into the Pine Street Inn’s HMIS system if needed.
  • Performs any other tasks deemed necessary for maintaining the quality of the HMIS system.
  • Submits reports and responds to special information requests promptly and as needed, and in collaboration or consultation with other affected departments, such as Communications or Development

Salary 60K-65K plus 2K bonus at 1, 3, 6, and 12 months.” depending on experience