Big Data Engineering Lead

  • Company:
    BHP Group
  • Location:
  • Salary:
    negotiable / month
  • Job type:
  • Posted:
    3 hours ago
  • Category:

Big Data Engineering Lead | Brisbane or Perth based




Queensland, Western Australia

Work type

Full Time

Job category


Date published

11 September 2020

Date closing

25 September 2020 at 00:00 GMT

About BHP

At BHP we support our people to grow, learn, develop their skills and reach their potential.

With a global portfolio of operations, we offer a diverse and inclusive environment with extraordinary career opportunities. Our strategy is to focus on creating a safe work environment where our employees feel strongly connected to our values and objectives, and where the capability of our people is key to our success.

Come and be a part of this success.

About the role

BHP is generating large amounts of data from different sources. Reporting to the Manager Data Engineering & Analytics, your task, as the Big Data Engineering Lead is to provide expertise in the efficient operations and cloud modernisation of BHP’s big data and analytics platforms.

BHP has begun its cloud transformation program and there is a need to optimise our big data ecosystem while driving it’s modernisation towards cloud. This role is a technical role; you will be providing technical leadership on big data technologies, guiding data engineers, data analysts and data scientists be productive with our big data ecosystem. As well as advising solution architects to help determine the best pathways to cloud adoption.Key Responsibilities:

  • Provide expertise in design, development and operational maintenance of core Business Intelligence and Data Analytics platforms
  • Guide the adoption, advising key users of best practise and efficient utilisation
  • Define, communicate and maintain standard operating procedures (e.g. Runbooks, Knowledge base, FAQs and User Guides)
  • Fulfil (where necessary) Lead engineer role on projects, guiding Solution Architects in the design of solutions dependent on the platforms
  • Provide expertise on pathways to cloud adoption for equivalent services offered in the cloud market
  • Fulfil (where required) the implementation of cloud services to help guide streamlined adoption of cloud data services

About You

You are a person with a drive for continuous learning and adaptable to new technologies.You enjoy keeping up to date with the latest happenings in the market in regards to big data and analytics.You will bring your expertise in implementation and management of big data ecosystems (Apache Hadoop), data ingestion pipelines and analytics packages to ensure their optimised configuration and efficient operation. You will be able to translate your hands on knowledge of these technologies to their cloud equivalents.

  • You are also an excellent communicator who can guide and influence technical and non-technical stakeholders across the organization.
  • 3+ years in big data lead implementation role or operational role.
  • Technical proficiency and experience with the following big data technologies (HDFS, HBase, YARN, Zookeeper, Spark, Kafka, Hue, Hive, Impala)
  • 2+ years of experience with the following AWS cloud services (S3, EMR, Kinesis Streams and Firehose, Glue, DMS, DynomoDB, ECS, EKS, Lambda, KMS, Cloudwatch)
  • Experience with CI/CD tooling and source control with respect to maintaining data pipelines
  • Experience in the creation of data platform related solution architecture, implementation plans and run books
  • Proven service management skill and customer engagement.
  • Drive for continuous learning/improvement and adaptable to new technologies and approaches.
  • Excellent communicator, both verbal and written.

Supporting a diverse workforce

At BHP, we recognise that we are strengthened by diversity. We are committed to providing a work environment in which everyone is included, treated fairly and with respect. We are an Equal Opportunity employer and we encourage applications from women and Indigenous people.

We know there are many aspects of our employees’ lives that are important, and work is only one of these, so we offer benefits to enable your work to fit with your life. These benefits include flexible working options, a generous paid parental leave policy, other extended leave entitlements and parent rooms.


The safety of BHP’s people and our candidates is our number one priority. Due to the unfolding circumstances of COVID-19 and the Government regulations in place to deal with the pandemic, your working location and/or roster as advertised in this advert may be temporarily subject to change whilst the government regulations are in place. This is to ensure the health safety of our workforce, and to implement effective social distancing measures. These changes if applicable will be discussed at screening and interview stage.