Data Engineering Consultant

You will be responsible for building data lakes and massive scale ingestion pipeline solutions, including batch/grid, micro batching, stream processing and lambda solutions. Ultimately, you will create data solutions which encompass high utilisation, elastic scaling and efficient data distribution for our clients.

Ensono Digital has a diverse set of communities, as well as your core competency, that you’ll be encouraged to contribute to and learn from where projects and client commitments allow.

You will be a self-starter, proactive in your project work and your career, including identifying your training needs and planning to fill them with the help of your training budget.

We are a client-facing business, but we do encourage clients to allow us to work remotely for a majority of the time so if you are not required to be on client site, you can choose to work from home or in our Ensono Digital offices.

We are looking for passionate Data Engineers who have a proactive attitude and can interact effectively within a team. You will also need the following skills and experience:

• Building and contributing to Big Data solutions, such as data lakes, data warehouses, start schemas and data ingestion pipelines  
• Working across data storage, including RDMS, cloud storage, HDFS and NoSQL
• Practicing TDD/BDD testing  
• Understanding compression and encoding techniques and common Big Data file formats (e.g., Parquet and Avro) and of storage requirements i.e., columnar storage, indexing, partitioning, replication and sharding
• Advanced development skills in at least one core programming language, such as Python, Scala or Java
• Working with distributed query and data processing platforms, such as Apache Spark and Google Big Query  
• Understanding of engineering best practices, such as SOLID, TDD, DRY, Separation of Concerns and Clean Code
• Great communication skills, in particular: presenting, collaborating and working with stakeholders
• Understanding business and client requirements and an ability to articulate solutions to both technical and non-technical audiences.