Job Information
Public Partnerships LLC Data Lake Architect in United States
Position Title:
Data Lake Architect
Duties & Responsibilities:
The Data Lake Architect will be responsible for providing the technology roadmap for enabling and supporting a concrete enterprise data lake strategy.
This individual will be tasked with documenting the data lake architectural model and views that show how the current and future needs of the organization will be met with a successfully designed data lake solution.
The role requires a skilled individual who can provide senior level knowledge to support Apache Spark, Docker, Kubernetes, MySQL, Redis, NoSQL, MongoDB, Prometheus, React, and Nginx.
Engage with Customers and stakeholders in all phases of project life cycle – requirements gathering, solution design reviews, development, testing, UAT, delivery and support.
Understand client reporting and data analysis requirements holistically from both current and prospective environment.
Participate in discussions and drive discussions that bring clarity and details that can have positive influence on overall information quality.
Deliver design solutions leveraging latest best practices Data Warehouse, Data Analytics and Azure Cloud platform.
Evangelize across the team to adopt best practices, and continuously keep updated on latest technologies.
Ensure the design proposal makes balanced tradeoff across schedule, cost, technology, security, and compliance requirements.
Mentor team of peers ranging from database developers, analytical experts, and data integration/visualization engineers by providing technical & non-technical guidance to help them grow their skills, deliver quality implementations for successful completion of projects.
Required Skills:
Develop data lake solutions that are built for performance, fault tolerance and security to ensure quality data is being ingested and utilized.
Provide senior level knowledge to support Apache Spark, Docker, Kubernetes, MySQL, Redis, NoSQL, MongoDB, Prometheus, React, and Nginx.
Support a large Microservices clustered environment with experience in adding and removing nodes, configure and tune the clusters and monitor the environment.
Be able to support the current implementation and ongoing future enhancements to data lake infrastructure.
Administer the data lake infrastructure utilizing Red Hat Linux and be able to perform the following:
Security setup
Configuration changes
Tuning
Troubleshooting
Monitoring
Perform many data lake administrative functions across multiple servers that use the Microservices Architecture
Define standards and techniques to guide architecture solution decisions for microservices architecture
Must be hands on, deeply technical and exposure to latest features within data platform development, able to do both coding and system design/architecture activities.
Excellent communication skills to interface with team members directly and proficient in all types of communication modes – Listening, Reading, Writing and Speaking
Strong experience in Performance Tuning / Optimization Initiatives
Ability to act independently to resolve issues
Qualifications:
Education:
High school diploma or equivalent experience required
Experience:
12+ years of relevant experience in architecting, design, and development of data lake systems (SQL Server based on Cloud/on premise and Analytics) at enterprise scale.
Python experience and capabilities to create Bash/shell scripts.
Experience with Apache Spark, Docker, Kubernetes, MySQL, NoSQL, MongoDB, Redis, React, and Nginx.
Experience with large Micro Services clustered environment.
Strong skills in security setup, configuration changes, tuning, troubleshooting, and monitoring.
Ability to define standards and techniques to guide architecture solution decisions for microservices architecture.
Excellent communication and leadership skills.
Experience working in Agile environments.
Certification:
Certifications Relevant certifications may include:
Microsoft Certified: Azure Developer Associate
Microsoft Certified: Azure Solutions Architect Expert
Microsoft Certified: Azure DevOps Engineer Expert
Microsoft Certified: Data Analyst Associate
Microsoft Certified: Azure Administrator Associate
Microsoft Certified: Azure Security Engineer Associate Security Clearance
WORKING CONDITIONS:
Remote office setting
The above is intended to describe the general contents and requirements of work being performed by people assigned to this classification. It is not intended to be construed as an exhaustive statement of all duties, responsibilities or skills of personnel so classified.
PPL does not discriminate based on race, color, religion, or belief, national, social, or ethnic origin, sex, gender identity and/or expression, age, physical, mental, or sensory disability, sexual orientation, marital, civil union, or domestic partnership status, protected veteran status, citizenship status, family medical history or genetic information, family or parental status, or any other status protected under federal, state, or local law.