Data Engineering Consultant
About the role and what you'll be doing
You will be responsible for building data lakes and massive scale ingestion pipeline solutions, including batch/grid, micro batching, stream processing and lambda solutions. Ultimately, you will create data solutions which encompass high utilisation, elastic scaling and efficient data distribution for our clients.
Amido has a diverse set of communities, as well as your core competency, that you’ll be encouraged to contribute to and learn from where projects and client commitments allow.
You will be a self-starter, proactive in your project work and your career, including identifying your training needs and planning to fill them with the help of your training budget.
We are a client-facing business, but we do encourage clients to allow us to work remotely for a majority of the time so if you are not required to be on client site, you can choose to work from home or in our Amido offices.
What you’ll bring to Amido
We are looking for passionate Data Engineers who have a proactive attitude and can interact effectively within a team. You will also need the following skills and experience:
- Building and contributing to Big Data solutions, such as data lakes, data warehouses, start schemas and data ingestion pipelines
- Working across data storage, including RDMS, cloud storage, HDFS and NoSQL
- Practicing TDD/BDD testing
- Understanding compression and encoding techniques and common Big Data file formats (e.g., Parquet and Avro) and of storage requirements i.e., columnar storage, indexing, partitioning, replication and sharding
- Advanced development skills in at least one core programming language, such as Python, Scala or Java
- Working with distributed query and data processing platforms, such as Apache Spark and Google Big Query
- Understanding of engineering best practices, such as SOLID, TDD, DRY, Separation of Concerns and Clean Code
- Great communication skills, in particular: presenting, collaborating and working with stakeholders
- Understanding business and client requirements and an ability to articulate solutions to both technical and non-technical audiences.
What we offer you
- We will give you a place to strive and grow, where you will have the opportunity to work on interesting, yet challenging projects. Applying your thinking to build a better world founded on intelligent technologies alongside highly skilled and like-minded individuals.
- This will be an extremely varied position that’s all about problem-solving and finding the right technical solutions for your client. You will be given autonomy over your work so that you will have the opportunity to shape the projects you’re working on.
- We are a people-first business, which means people are at the heart of everything we do here. We offer our consultants a safe environment where knowledge sharing, and open communication is encouraged. Whether at one of the internal monthly events, such as Lunch & Learns, Tech Time, and internal competency meet-ups, or at one of our community groups, such as football, gaming, yoga, or wellbeing; we have strived to build a business where everyone feels welcomed, included, and valued.
Benefits package
- 27 days annual leave, rising each year to a total of 30 days (plus bank holidays)
- An annual training budget of £2,000
- Generous company pension
- Private healthcare with Vitality
- Season Ticket loan
- Cycle to Work Scheme
- Life insurance
- Income protection
Apply for this role
If you haven't had a response within two weeks, please assume that we won't be taking your application to the next stage on this occasion. We list all our roles on the Careers page so do keep checking the page in the coming months to see if anything else opens up.
