View Job

Lead Data Engineer

United Parcel Service | MAHWAH NJ 07430 USA | Full Time | Posted: 10/18/2019

Job Descriptiontop

Lead Data Engineer

We're the obstacle overcomers, the problem get-arounders. From figuring it out to getting it done… our innovative culture demands "yes and how!" We are UPS. We are the United Problem Solvers.

About Information Management at UPS Technology:
Our Information Management teams are responsible for designing and supporting data solutions to meet UPS's rapidly changing business needs. Our team is comprised of individuals who are experts in data management, compliance and governance. We ensure quality, completeness, availability, protection, understanding and effective use of our data assets. Our ability to organize and design the wealth of data we receive each day provides the foundation which enables many of UPS' core processes.

About this role:

The Lead Data Engineer interacts with Data Scientists, Business Owners, Business Data Analysts, Data Modelers, Architects, and Application Developers, to design, build and manage large-scale batch and real-time data pipelines utilizing various data analytics processing frameworks in support of Data Science practices. He/She sets direction for data engineering best practices in continuous integration and delivery. This position is responsible for managing the integration of data from various data sources, both internal and external. They also perform ETL, data conversion and facilitate data cleansing and enrichment. This position supports I.S. leadership by planning and championing the execution of broad advanced analytics initiatives aimed at delivering value to internal and external stakeholders.

Leads the Development and Design of Data Engineering Projects

  • Acts as subject matter expert on UPS business data processes, data rules, and metadata
  • Ensures that projects follow UPS data management, metadata and data quality governance practices
  • Establishes data validation and cleansing framework as it pertains data engineering and analytics
  • Analyzes and solves problems at their root, stepping back to understand the broader context
  • Designs efficient, flexible, extensible, and scalable ETL solutions
  • Tunes application and query performance using profiling tools and SQL
  • Supports the data science community by enabling data availability in environments that provide advanced analytical capabilities
  • Maintains a broad understanding of implementation, integration, and inter-connectivity issues with emerging technologies to define data strategies
  • Presents findings and recommendations to management to define problems, propose business cases and data strategies, and gain support
  • Responsible for understanding and adhering to current security and regulatory compliance as it pertains to data
  • Performs peer reviews of large and highly complex solutions with the stakeholders ensure requirements are met
  • Creates repeatable solutions through written project documentation, process flowcharts, layouts, diagrams, charts, code comments, and clear code to produce datasets that can be used in analytics and/or predictive modeling

Provides Leadership for Data Engineering Projects

  • Provides technical leadership for project teams to evaluate strategic alternatives, determine impact, recommend courses of action, and to design and implement solutions
  • Recommends data engineering patterns that are recognized in the industry and are compliant with our security standards
  • Provides technical guidance to ensure tasks are completed within established timeline, having established realistic timelines during the planning process
  • Recognizes and adopts best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
  • Leads the improvement of ongoing data engineering processes, automating or simplifying self-service support for datasets

Directs Integration of Data for Data Engineering Projects

  • Leads the analysis and integration of tools and methods to provide desired results from data engineering requirements
  • Provides consultation of the data integration to stakeholders in order to support the design of advanced analytic environments
  • Oversees procedures, maintenance, and support functions to monitor the advanced analytic environments for performance/integrity and to facilitate problem resolution

Leads Adoption of Emerging Technology Products and Tools

  • Encourages the adoption of data engineering tools and techniques to derive useful information from data
  • Keep up to date with advances in analytics technologies
  • Assists teams in the training and use of data engineering processes and technologies

Minimum Qualifications:

  • Bachelor's degree in a technical field
  • 8+ years of industry experience in IT or software-related roles
  • Expert knowledge and experience with relational data systems and SQL
  • Familiarity with Hadoop/Spark systems and related technologies such as HIVE
  • Knowledge of cloud platforms such as GCP, Azure, etc
  • Extensive hands-on experience with ETL and data engineering

Preferred Qualifications:

  • Programming experience in R or Python
  • Experience supporting data science initiatives
  • Understanding of data governance procedures with a focus on data loss prevention

This position offers an exceptional opportunity to work for a Fortune 50 industry leader. If you are selected, you will join our dynamic technology team in making a difference to our business and customers. Do you think you have what it takes? Prove it! At UPS, ambition knows no time zone.

Job Detailstop

Location MAHWAH, NJ, 07430, United States
Categories Information Technology

Location Maptop

Contact Informationtop

Contact Name -
How to apply Employer provided a link where your application will be accepted. Click on the link below and follow instructions.
Apply Click Here (apply to job)
Job Code 2029190040

Featured Employers - view all