Data Engineer @ Mindbox Sp.z.o.o.

• Experience Python, PySpark, Pandas, JupyterLab (working with notebooks).
• Experience using AWS platform.
• Experience with continuous integration and continuous delivery tools like Git, Jenkins etc.
• Agile development/Software life cycle.
• Knowledge around BI tools (Qlik, Tableau, Power BI, ...)

Nice to Have Skills

• Experience with Kafka.
• Experience in SQL, Hive, Hadoop.
• Specifically, experience using EMR (Elastic Map Reduce) in AWS to run Spark clusters.
• Knowledge of Terraform
• Experience with Ansible, Bash scripting, boto3.
• Experience configuring continuous integration and continuous delivery tools.

Creating an inspiring place to thrive for the talented, we use their expertise and courage to introduce the technology of the future into your business. - This is the foundation of Mindbox and the goal of our business and technology journey. We operate and develop in four areas:

? Autonomous Enterprise - automation of business processes using RPA, OCR, and AI.

?Business Managment Systems ERP - we implement, adapt, optimize, and maintain flexible, safe, and open ERP of production and distribution companies worldwide.

?Talent Network - we provide access to the best specialists.

☁ Modern Architecture - we build integrated, sustainable, and open CI / CD environments based on containers enabling safe and more frequent delivery of proven changes in the application code.

We treat technology as a tool to achieve a goal. Thanks to our consultants reliability and proactive approach, initial projects usually become long-term cooperation. For over 16 years, it has provided various services to support clients in digital transformation.

#LI-Hybrid

 

We offer:

• We are open to the employment form according to your preferences 
• Work with experienced and engaged team, willing to learn, share knowledge and open for growth and new ideas 
• Flexible hybrid model, 2 days per month from the Warsaw office or less frequently.
• Mindbox is a dynamically growing IT company, but still not a large one – everybody can have a real impact on where we are going next
• We invest in developing skills and abilities of our employees
• We have attractive benefits and provide all the tools required for work f.e. computer
• Interpolska Health Care, Multisport, Warta Insurance, training platform (Sages) 

,[Ingestion of multiple data sources in batch / near real-time in a shared storage., Decoupled storage from compute and data processing to provide increased scalability and performance while reducing storage costs., The data is compressed and partitioned using a parquet data format which improves the performance while reducing the cost of the data retrieval., Centralized metadata catalogue that maintains a single view of the data model for all its consumers., Integration with other AWS services (Athena, EMR, QuickSight, ...) and third-party solutions (Apache Spark, Presto, Tableau, ...)., Take responsibility for the software delivery by ensuring quality and scope expectations are met., Contribute and take ownership of the technical design and ensure all aspects of the system architecture are well documented., Work closely with partner technology teams and collaborate effectively.] Requirements: Python, PySpark, pandas, AWS, Continuous integration, Git, Jenkins, BI, Qlik, Tableau, Kafka, SQL, Hive, Hadoop, Amazon EMR, Spark, Terraform, Ansible, Bash script Additionally: Sport subscription, Private healthcare, International projects.

Kategorie

data

Odpovědět na inzerát