NO SPONSORSHIP. NO C2C

Description:

There is an opening within the Data Factory Operational Curation and Landing group to assist in their core Data Engineering efforts. This specific team lands, secures and transforms data from enterprise systems including internal, external and connected product sources. They will be will be building and engineering the data pipelines for IoT data sources through Batch Processing and Software engineering and doing preventative maintenance and production quality monitoring . This position will be part of the Data Factory Operational Curation & Landing product group using tools like Attunity, Hive, Hbase, Spark, GCP, etc. The product team's objective is to ingest data from hundreds of sources within the company to the Data Factory in the cloud environment and perform transformations to make it usable for data scientists in GDI&A. This position will require an individual who has a experience with multiple database technologies, who is process oriented and has knowledge of Big Data and GCP environment. This role is part of a highly dynamic team supporting GDI&A activities.

This software engineering will be focused on figuring out the ingestion pattern then implementing it to the particular source to ingest. This could be file based, click based, Kafka topic pattern, etc. They will be implementing the ingestion pipelines for the data factory. Candidates should have experience doing code development for data ingestion or at minimum data initiatives.

-Experience with GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, Cloud functions etc.

-Experience with relational SQL databases -Experience building and optimizing "big data" data pipelines, architectures and data sets.

-Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

-Build processes supporting data transformation, data structures, metadata, dependency and workload management.

-Experience with big data tools: Hadoop, Spark, Kafka, etc. -Experience supporting and working with cross-functional teams in agile mode.

Skills:

GCP, python, Sql

Top Skills Details:

GCP,python

Additional Skills & Qualifications:

Candidates should have a core understanding of the following:

Fundamental Cloud data engineering knowledge (GCP Coursework/training/etc.)

Data Warehousing tool experience with HDFS, Hadoop, or Hive

Fundamental understanding of coding to help leverage for developing tools and processes

Big Query will be used to partition and cluster with tables in GCP so that experience will be a plus.

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.