Africa Climate Careers Network's Climate Job Board

Discover emerging career opportunities in the climate and clean energy sectors

Data Engineer

Hatch

Hatch

Software Engineering, Data Science
Johannesburg, South Africa
Posted on Sep 22, 2023

Requisition ID: 87533 

Job Category: Digital 

Location: Johannesburg, Gauteng, South Africa 
 

Join a company that is passionately committed to the pursuit of a better world through positive change. With more than 65 years of business and technical expertise in mining, energy, and infrastructure, our 10,000 colleagues in 150 countries tirelessly work toward bettering the industries in which we operate. With practical solutions that are safe, innovative and sustainable, we think globally while acting locally. Are you looking for an opportunity to join a diverse group of professionals who are committed to remaining exceptional? We look forward to hearing from you.

 

We're at the forefront of our clients' digital transformation journey, successfully implementing emerging digital services into our clients' projects and operations that unlock a step change in their performance. Join the team to improve project outcomes, leverage the digital twin, deliver systems integration and interoperability, and support decision-making, autonomous execution, and integrated operations and performance centers.

 

With over six decades of business and technical experience in the mining, energy, and infrastructure sectors, we see challenges evolving in every industry. We respond quickly with solutions that are smarter, more efficient, and innovative. We draw upon our 9,000 staff, with experience in over 150 countries, to challenge the status quo and create positive change for our clients, our employees, and the communities we serve. We're at the forefront of our clients' digital transformation journey, successfully implementing emerging digital services into our clients' projects and operations that unlock a step change in their performance. Join the team to improve project outcomes, leverage the digital twin, deliver systems integration and interoperability, and support decision-making, autonomous execution, and integrated operations and performance centers.

 

We are hiring Data engineers who have an interest in using the latest development technologies to make an impact in heavy industry by delivering high impact applications and software to some of the biggest mining, infrastructure and energy companies in the world. In this role you will develop cutting edge solutions by integrating data, software and advanced systems to create a better world through positive change.

You will be challenged to deliver high quality high-quality data solutions in an environment where mutual respect, integrity, and creativity is commonplace. Individuals applying should be solutions-oriented with a can-do attitude, high energy, and willingness to act. We are looking for someone who embraces learning and is eager to explore the latest technologies and tools in delivering client value. Our data engineers bring strong analytical skills and critical thinking, picking the relevant technologies to breakdown ambiguous problems and structure effective solutions.

 

A successful candidate would:

  • Be involved with all technical activities within the team: estimating, architecting, designing, Agile development, code reviews, documentation.
  • Introduce and guide best practices to level up our data engineering standards.
  • Drive team culture through effective communication, mentoring, and participation in team growth.
  • Embrace the engineering challenge and design stellar solutions that automate routine tasks.

 

Experience:

  • Minimum of 8 years’ experience in direct development within the MS or Azure environment.
  • BSc degree in Electronic Engineering, Computer Engineering, Computer Science, or equivalent from a reputable South African university preferred.
  • Data engineering certifications with Microsoft is preferred.

 

Preferred technical competencies:

Ingestion and orchestration

  • ETL Processes: Working history with ETL tools and techniques, including experience with SSIS.
  • Azure Data Factory: Comprehensive understanding and hands-on experience in creating packages, organizing data flows, and constructing pipelines from various data sources, including production data from Historian, Controller, Sensor data, and on-premise databases.
  • Data Management: In-depth understanding of different data types and frequencies, with the ability to ingest the information into an Azure environment.
  • API and Microservices Integration: Proven experience with API integrations and employing ESB in conjunction with services and microservices architectures

 

Preparation, Transformation, and Enrichment:

  • Data Warehouse Development: Proven ability in developing a data warehouse and robust experience in SQL.
  • Technologies: Hands-on experience with DataBricks, Azure DW, Synapse, CosmosDB, MongoDB.

 

Store:

  • Data Management: Comfort in working with various data storage types, including staging areas, blob storage, data lakes, and databases.
  • Scaling: Knowledge and experience in scaling server requirements and expansion with Azure Kubernetes or equivalent functions.

 

Serve:

  • Modeling Skills: Solid understanding of modeling concepts, including data schema and ERD (entity relationship diagrams).

 

Visualize:

  • Business Requirements: Ability to interpret and translate business analysts' requirements into functional development needs.
  • Visualization Tools: Proficiency in using PowerBI, Tableau, and other front-end development apps.

 

In addition to the technical skills outlined, the successful candidate must demonstrate a variety of other proficiencies and characteristics. At our company, we value self-leadership, and each team member is expected to guide their work with autonomy, embracing challenges, and driving their tasks to completion. Cloud proficiency is essential, with experience in working with Cloud Providers (Azure, AWS, GCP), and the ability to architect or implement individual cloud solutions. Familiarity with Azure DevOps or other equivalent CICD tools is required, as well as an understanding of various database solutions such as SQL Server, Azure Storage, MongoDB/Cosmos DB. Experience with specific protocols, particularly REST via Web API + JSON, is also a key requirement. Agile and Kanban methodologies are part of our workflow, and experience in these areas is vital. Finally, we value candidates who show trustworthiness, a self-starting attitude, strong organizational skills, and the ability to work with minimal supervision, reflecting our emphasis on individual responsibility and collaboration within our team.

 

Why join us?



What we offer you?

 

  • Flexible work environment
  • Long term career development
  • Think globally, work locally

 

Don't meet every single requirement? You don't need to. At Hatch, we are building a diverse, inclusive workplace that fosters innovation. If you're interested in this role, we encourage you to apply even if your past experiences don't perfectly align with the skills we've listed.

 

We're committed to fostering a workforce that reflects the diversity of the communities in which we operate and serve. Hatch is an Equal Opportunity Employer that considers applicants without regard to age, race, color, national origin, citizenship, religion, creed, gender, sexual orientation, marital status, disability, veteran, or any other protected status. If you have any accommodation requirements, please let us know. We'll do our best to meet your needs in accordance with applicable local legislation.