Full Stack Engineer - Hadoop Admin @ Antal
(práce v Polsku)

Full Stack Engineer - Hadoop Admin @ Antal

Polsko

Must-Have Skills & Experience

• 5+ years of experience engineering solutions in Big Data on-prem or cloud environments.
• Hands-on expertise with Cloudera Hadoop distributions (Hive, Beeline, Spark, HDFS, Kafka, Yarn, Zookeeper, etc.).
• Proven experience in Hadoop cluster installation, capacity planning, performance tuning, and monitoring.
• Strong knowledge of Hadoop security (Apache Ranger, Knox, TLS, Kerberos, encryption zones).
• Proficiency in Linux system administration and shell scripting for Hadoop management.
• Experience with CI/CD automation (Jenkins, Ansible) and infrastructure provisioning.
• Solid troubleshooting skills with the ability to diagnose and optimize Apache Spark jobs.
• Exposure to Agile/Scrum or Kanban methodologies.
• Creative, independent, and proactive mindset – able to thrive with limited documentation in a complex environment.

Nice to Have

• Experience with S3-based storage (e.g., VAST) integrated into big data platforms.
• Familiarity with microservices, Kubernetes, and containerized workloads.
• Experience in designing tools for cross-team collaboration and process improvement.

Full Stack Engineer – Hadoop Admin
? Kraków (Hybrid – 6 days per month)
? Employment type: B2B

We are looking for a Full Stack Engineer – Hadoop Admin who will help us design, build, and support system capabilities on our core on-premises Hadoop big data platform.

What You’ll Work On

• Building automation and integration solutions to streamline user journeys and reduce complexity.
• Supporting platform uplift initiatives: service resilience, real-time capabilities, CI/CD automation, and AI adoption.
• Collaborating with globally distributed teams and engaging with a diverse technology ecosystem (CI/CD, Service Management, Identity).
• Developing tools and processes to reduce manual toil and enhance engineering efficiency.

Why Join Us?

• Be part of a highly strategic initiative at the heart of a global financial institution.
• Work with a modern, hybrid platform that spans on-premises and cloud environments.
• Contribute to transformational projects shaping the resilience, scalability, and automation of enterprise-scale data systems.
• Collaborate with top-tier engineers, data scientists, and architects across the globe.
• Thrive in a culture that values innovation, ownership, and continuous improvement.

,[Contribute to the design, build, and automation of Hadoop clusters and related services., Work across the stack – from backend (containerized services, APIs) to front-end UI solutions – delivering automation tools and system improvements., Collaborate with solution architects, engineers, and business stakeholders to create robust, resilient, and scalable platform components., Play a key role in incident management, troubleshooting, and performance tuning of big data solutions., Support Hadoop users by managing Linux accounts, Kerberos principals, and verifying access across HDFS, Spark, and MapReduce., Ensure 24/7 environment availability and uphold operational excellence standards.] Requirements: Big Data, Cloud, Cloudera, Hadoop, Hive, Spark, HDFS, Kafka, Yarn, Apache ZooKeeper, Performance tuning, Security, TLS, Kerberos, Linux, Shell, Jenkins, Ansible, Apache Spark, Kanban, Storage, Microservices, Kubernetes

Kategorie

fullstack

Odpovědět na inzerát