Specialist Data Engineer
Job Description
About the Role
As a Data Engineer, you will play a key role supporting Digital Factory projects that fundamentally change BHP's performance across safety, productivity and people performance. The Digital Factory is BHP's approach to rapid design and development of digital products (software-focused, minimal or no hardware) that provide solutions to operational challenges that are currently being addressed through manual methods.
The work:
- The Data Engineer's primary responsibilities are to define the data lifecycle (including data models and data sources for analytics / ML platforms), and to gather and clean business data from the business in order to provide ready-to-work inputs for Data Scientists and other consumers.
- Critical in the successful development and implementation of digital solutions and products, as these are built on effective access to high-quality data.
- Strong expertise in data mining and information retrieval to design, develop, optimise, and maintain cloud native data architecture and pipelines that adhere to ETL principles and business goals.
- Utilise a product mindset to build and maintain reusable data pipelines and the Coal Data Utility platform at a scale.
- Partner with the Customer and Data Modelling Engineer to ensure the data is delivered to meet the customer and quality requirements.
Job Requirement
About you:
As the successful candidate you will possess the following:
- Data Warehousing / Data Governance experience, including;
- Experience in multiple database technologies such as RDBMS and NoSQL
- AWS Cloud experience, including;
- Experience with AWS cloud services: S3, EC2, EMR, RDS, Lambda, Cloud Watch, Step Functions and Managed Airflow
- Experience in designing and building streaming data ingestion, analysis and processing pipelines in cloud native technologies
- Ideally have experience with Infrastructure as Code using Terraform
- Software Development experience, including
- Strong experience with Python and SQL
- Experience with data orchestration tools such as Apache Airflow
- General
- Preferred bachelor's degree in Computer Science, IT, Engineering, or related field with strong experience in cloud based technology solutions
- Hands on experience working in data engineering or architecture role
- Experience working in DevOps, Agile, Scrum, Continuous Delivery and/or Rapid Application Development environments
- Attitude to thrive in a fun, fast-paced start-up like environment
- Experience working on a collaborative Agile product team
- Self-motivated with strong problem-solving and learning skills
- Flexibility to changes in work direction as the project develops
- Excellent communication, listening, and influencing skills
Company Info
About BHP
At BHP we support our people to grow, learn, develop their skills and reach their potential. With a global portfolio of operations, we offer a diverse and inclusive environment with extraordinary career opportunities. Our strategy is to focus on creating a safe work environment where our employees feel strongly connected to our values and objectives, and where the capability of our people is key to our success. Come and be a part of this success.
About our Process
At BHP, we are committed to employing individuals who align with the BHP Charter Values and meet the requirements of the role. As part of the recruitment process, there are a number of checks which may be conducted to demonstrate applicants suitability for a role including police / criminal background checks, medical, drug and alcohol testing, due diligence checks, right to work checks, and/or reference checks.
BHP also requires employees in Australia to be fully vaccinated against Covid-19 to ensure the safety and wellbeing of our people (from the 31st of January 2022 or earlier depending on relevant state health directives). If you are applying for a role at BHP please consider this new requirement when submitting your application. BHP will also adhere to any relevant health directives that may be made that affects our workforce. For further information please see our website (LINK) [link removed]
Supporting a Diverse Workforce
The size and magnitude of our business not only provides significant opportunity for professional development, but also attractive salary packages with performance-based bonuses and a unique BHP employee share program.
At BHP, we recognise that we are strengthened by diversity. We are committed to providing a work environment in which everyone is included, treated fairly and with respect. We are an Equal Opportunity employer and we encourage applications from women and Indigenous people. We know there are many aspects of our employees' lives that are important, and work is only one of these, so we offer benefits to enable your work to fit with your life. These benefits include flexible working options, a generous paid parental leave policy, other extended leave entitlements and parent rooms.