Estimated Length: 6 Months Work hours:40.00 Est. OT Hrs/Wk:

*PLEASE NOTE THIS POSITION WILL ALLOW CONSULTANT TO WORK REMOTELY.  (VERY HIGH EXPECTATION THAT CONSULTANT WILL BE PROFESSIONAL, RELIABLE, REACHABLE AND ABLE TO WORK PRODUCTIVELY WHILE REMOTE).  WILL COME ONSITE ONLY AS NEEDED BY THEIR MANAGER/TEAM (AT THEIR OWN EXPENSE).

Mandatory Requirements

The Client is migrating a large portion of its performance management and reporting system from a custom, multi-pipeline arrangement to a more unified and efficient data lake setup using Synapse. The data and performance reporting covers wide variety of agency operations:
- service quality tracking at the vehicle level, weighted for ridership
- ridership and fare evasion
- employee workhours and overtime use
- many other functions
Some data sets add a million or more records each day and current data infrastructure is constrained in ways that will be resolved by the migration to Synapse. In addition, new technologies and enhanced reporting have provided opportunities and needs for enhancements to reporting systems

AIM:
Our transition process requires skills in data engineering, coding in Python and other languages, and report/dashboard development in PowerBI and other data visualization tools. Specific tasks include:
1. Develop data lake architecture and set up Synapse:
a. Setting up automated jobs to bring in external, raw data sources. In some cases, we will be duplicating current functions. In other cases, new sources and thus new functions must be developed.
b. Setting up automated tasks to transform raw data into processed (generally not final) form. We will be duplicating processes in some cases and enhancing or adding processes in other cases.
A key element of this work will be deciphering processes with limited notation and creating new code with complete notation for the use of future programmers.

2. Program in Python and SQ to develop refined data tables for feed into dashboard and recurring reports. This work will generally transform data that has been cleaned and/or transformed in simple ways from raw to generate more complex and calculation-based tables.
a. Porting scripts over to Synapse.
b. Re-writing particularly difficult scripts from current pipeline process in Python (i.e., looking through old code, inputs and outputs to rewrite for use in Synapse).
c. Creating code to transform new data sources that replace older sources that are simpler or less accurate.
d. Adding code notation as needed to explain processes for future users.
e. Carrying out testing process to check results and improve quality of new and existing processes.

3. Generate new data visualization outputs
a. Building out many PowerBI dashboards, many relatively simple
b. Developing Streamlit sites
c. Migrating and enhancing daily email reports in PowerBI Report Builder and other tools
Specific tasks will be defined as priorities and needs dictate. The consultant’s charge is to take on and complete one specific task as a time.

REQUIREMENTS:
• Skills and experience in using Synapse or a demonstrated ability to learn quickly
• Skills and experience programming in Python and SQL – 2+ years
• Skills and experience using PowerBI
• Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees
• Excellent attention to detail and QC skills to ensure errors are found and corrected before they appear in our public reporting
• Good verbal and written communication abilities for internal collaboration

Founded in 1995, IIT is a leading provider of Workforce Solutions to Government and Fortune-1000 organizations. IIT is a winner of Inc-500 award. IIT's core services include:

Headquartered in New York, IIT has over 400 consultants deployed at Client Sites. Other IIT highlights include

Our Consultants love working for IIT

Follow us on LinkedIn or Twitter or Facebook

IIT is an Equal Opportunity Employer