Senior Data AWS Engineer @ Bayer
(práce v Polsku)

Senior Data AWS Engineer @ Bayer

Polsko

•        5+ years of experience in data engineering on AWS

•        Strong knowledge of AWS data stack: Glue, Athena, Lake Formation, S3, Step Functions, Lambda, RDS etc.

•        Proficient in Python for scripting, automation and data manipulation tasks

•        Experience with PySpark for building scalable, distributed ETL/ELT pipelines using Apache Spark (especially within AWS Glue)

•        Experience designing enterprise data lakes and data mesh architecture

•        Experience in structuring and modelling data in both relational and non-relational forms

•        Ability to elaborate and propose relational/non-relational approach

•        Advanced knowledge of databases, including query optimization, relational and non-relational schema design

•        Expertise in data storage technologies, including files, relational databases, NoSQL and various data types (structured, unstructured, metrics, logs)

•        Deep understanding of data governance, lineage and metadata management

•        Experience in implementing data quality frameworks, validation checks and monitoring to ensure reliability of data

•        Hands-on experience with real-time data streaming technologies and patterns (e.g. Kinesis, Kafka, or similar) for event-driven architectures

•        Solid awareness of DevSecOps practices, including automation of CI/CD pipelines (GitHub Actions or similar), infrastructure as code (Terraform), IAM roles, encryption, SAST/SCA tools integration, auditability

•        Leadership and team coordination skills - ability to lead distributed teams

•        AWS Certified Data Engineer - Associate, additional certifications such as AWS Certified DevOps Engineer, AWS Certified Solutions Architect or AWS Certified Developer are a plus

•        Fluent in English (written and spoken)

For Digital Hub Warsaw, we are looking for:

Senior Data AWS Engineer

 

Participate in a global, strategic project in the Bayer Consumer Health division that will influence data in our business and manufacturing processes going forward. Our AWS-based data platform aggregates information from various sources to promote efficiency, creativity and better decision-making. To build scalable, high-performing and secure pipelines while working with teams around the world, we are seeking a hands-on Data Engineer. Contribute to a platform that will shape Bayers digital future for Consumer Health division.

,[Play a key role in driving the design and implementation of AWS Data Lake, including orchestration and security guardrails, Define and enforce data architecture standards, including metadata, lineage and governance, Build and optimize ETL/ELT pipelines using AWS Glue, Spark, Athena, Lake Formation, S3, Step Functions, Lambda, Collaborate with DevSecOps engineers on infrastructure automation and CI/CD pipelines using tools such as GitHub Actions and Terraform, Automate deployment and management of data infrastructure and workflows to ensure reliability and scalability, Implement and manage IAM policies, KMS encryption, VPC configurations and audit mechanisms to ensure security and compliance, Ensure platform scalability, performance and cost efficiency (e.g., partitioning, catching strategies), Coordinate integration with AI/ML pipelines, including feature engineering and data validation, Participate in validation and documentation efforts aligned with GxP, Engage with stakeholders (Product, PM, PO, Architects) to align technical design with business needs, Manage and reduce technical debt in data pipelines and infrastructure, Act as technical lead and reviewer for offshore data engineers] Requirements: AWS, Data engineering, Glue, Athena, AWS S3, AWS Lambda, Amazon RDS, Python, PySpark, ETL, Apache Spark, Data Lake, Infrastructure as Code, DevOps, GitHub, NoSQL, CD pipeline, Kafka Tools: GitHub. Additionally: Sport subscription, Training budget, Private healthcare, Lunch card, International projects, Free coffee, Canteen, Playroom, Free snacks, Free beverages, Free parking, In-house trainings, Modern office.

Kategorie

data

Odpovědět na inzerát