IIT Inc. Home

IIT Jobs Data Bank-Job Detail

Submit Resume For This Job (via email)
Follow us on LinkedIn or Twitter or Facebook
Follow us on Facebook Follow us on LinkedIn
ID Location Skills $$ Job Type Status
14995 Downtown Manhattan, NY 10004 Database Administration - Data Warehouse [5 POS) DOE Contract OPEN
If you are unable to click on links above to submit resume, you may email your resume to

Subject=IIT Career Site/Resume for JobID=14995 (Database Administration - Data Warehouse [5 POS)) in Downtown Manhattan NY 10004 (SUP)

Estimated Length: 6 Months Work hours:40.00 Est. OT Hrs/Wk:


Mandatory Requirements

The Client is migrating a large portion of its performance management and reporting system from a custom, multi-pipeline arrangement to a more unified and efficient data lake setup using Synapse. The data and performance reporting covers wide variety of agency operations:
- service quality tracking at the vehicle level, weighted for ridership
- ridership and fare evasion
- employee workhours and overtime use
- many other functions
Some data sets add a million or more records each day and current data infrastructure is constrained in ways that will be resolved by the migration to Synapse. In addition, new technologies and enhanced reporting have provided opportunities and needs for enhancements to reporting systems

Our transition process requires skills in data engineering, coding in Python and other languages, and report/dashboard development in PowerBI and other data visualization tools. Specific tasks include:
1. Develop data lake architecture and set up Synapse:
a. Setting up automated jobs to bring in external, raw data sources. In some cases, we will be duplicating current functions. In other cases, new sources and thus new functions must be developed.
b. Setting up automated tasks to transform raw data into processed (generally not final) form. We will be duplicating processes in some cases and enhancing or adding processes in other cases.
A key element of this work will be deciphering processes with limited notation and creating new code with complete notation for the use of future programmers.

2. Program in Python and SQ to develop refined data tables for feed into dashboard and recurring reports. This work will generally transform data that has been cleaned and/or transformed in simple ways from raw to generate more complex and calculation-based tables.
a. Porting scripts over to Synapse.
b. Re-writing particularly difficult scripts from current pipeline process in Python (i.e., looking through old code, inputs and outputs to rewrite for use in Synapse).
c. Creating code to transform new data sources that replace older sources that are simpler or less accurate.
d. Adding code notation as needed to explain processes for future users.
e. Carrying out testing process to check results and improve quality of new and existing processes.

3. Generate new data visualization outputs
a. Building out many PowerBI dashboards, many relatively simple
b. Developing Streamlit sites
c. Migrating and enhancing daily email reports in PowerBI Report Builder and other tools
Specific tasks will be defined as priorities and needs dictate. The consultant’s charge is to take on and complete one specific task as a time.

• Skills and experience in using Synapse or a demonstrated ability to learn quickly
• Skills and experience programming in Python and SQL – 2+ years
• Skills and experience using PowerBI
• Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees
• Excellent attention to detail and QC skills to ensure errors are found and corrected before they appear in our public reporting
• Good verbal and written communication abilities for internal collaboration

Submit Resume For This Job (via email)
Don't See a Position Matching Your Skills?
Click here to Email / Register your resume and be notified of future job openings.
About IIT:

Founded in 1995, IIT is a leading provider of Workforce Solutions to Government and Fortune-1000 organizations. IIT is a winner of Inc-500 award. IIT's core services include:

  • Consulting for projects / IT Outsourcing
  • IT staffing (Contract / Temporary / Contingent / Consulting)
  • Custom Workforce Solutions
  • Recruitment Process Outsourcing (RPO)
  • Headquartered in New York, IIT has over 400 consultants deployed at Client Sites. Other IIT highlights include

  • Winner of Inc-500 award 2 consecutive years
  • Winner of Ernst & Young / USPAACC Fast-50 award 2 consecutive years
  • Winner of USPAACC Top-10 Award in the Northeast US
  • IBM Business Partner
  • Oracle Business Partner
  • Adobe Business Partner
  • NYSA Member - New York Staffing Association - Regional Affiliate of ASA / American Staffing Association
  • NYS MBE certified
  • Our Consultants love working for IIT

  • Competitive compensation
  • W2 or C2C
  • Biweekly Direct Deposit for W2 Consultants
  • Visa and Green Card sponsorship opportunities for qualified individuals
  • Local contact for you to meet and talk to anytime (not someone sitting overseas in a different time zone)
  • Follow us on LinkedIn or Twitter or Facebook

    IIT is an Equal Opportunity Employer