Senior Data Engineer
Technology
-
London, UK
-
Technology
-
CI/CD
-
Databricks
-
ETL
-
PySpark
-
Snowflake
-
SQL
-
Azure
Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it’s big, it’s real, and it’s always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform data from sources such as Social, Reviews, Search, and broader marketing and sales data. These reveal fresh insights for our clients; helping them to build better products and brands, to deliver effective marketing to consumers.
Our software, machine learning and AI are key to how we deliver impact, centred on:
- Natural Language Processing, GPT & other LLMs: unearthing trends, themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions
- Marketing Data Science & Personalisation: using first party consumer data to understand each client’s consumer base, building personalisation and other machine learning models to better engage with and excite consumers
- Data Engineering & Data Architecture: data engineering across a variety of tools to integrate these leading technologies into optimised and efficient data models and ecosystems, feeding into best-in-class analytics dashboards, marketing activation and front-end platforms
- Software Engineering: full stack expertise to build, maintain and support internal and externally facing Software & Data as a Service solutions, in AWS, that accelerate delivery and unlock deeper insights for our clients
As a start-up, we can move faster than most companies and do things differently. We have experienced rapid growth so far and we’re looking for a Senior Data Engineer to join our growing team.
You will join our Technology Practice, playing a crucial role in designing, building and productionising innovative data solutions, in the cloud, from scratch. You’ll work within our fantastic team of 25+ Data Scientists & Engineers, Software Engineers and Architects to deliver and manage innovative projects which push the boundaries of what we can do with data.
Beyond client work, you will play a key part in shaping the future of our fast-growing and vibrant start-up, and to support the development of our great Junior Data Engineers. We’ll let you challenge yourself, from your core of data engineering to support our data science and DevOps work, to grow your data & cloud architecture knowledge, and to understand the business and strategic impact of your great engineering work – to whatever extent suits you.
You should be passionate about developing industry first data, AI and analytics capabilities and have an innovative and creative mindset.
- Shape technical delivery; taking ownership for designing and building innovative data solutions, and for the success of the people you’re coaching and managing.
- Work with a mix of cloud services (majoring in Databricks and Azure, alongside AWS and Snowflake)
- Develop and deploy automated ETL/ELT pipelines using Python, PySpark and SQL, to bring together best-in-class technologies to meet our clients’ needs
- Help to deploy machine learning models and AI capabilities
- Work closely with a great programme team – project lead, data scientists and analysts – and interface with client technology counterparts
- Identify ways to improve reliability, processing efficiency and quality of our data and model outputs
- Work alongside Architects, and hone cloud and data architecture skills to shape what and how we build
- Produce detailed documentation and champion code quality
- Interrogate rich data sources such as social, search, surveys, reviews, clickstream, sales, connected devices and beyond
- Identify and explore opportunities to acquire new data sources that deliver innovative perspectives to our clients
- Work with increasing autonomy to shape the data engineering and technology work we do now and in the future
- Bachelor’s degree or higher in an applicable field such as Computer Science, Statistics, Maths or similar Science or Engineering discipline
- 3+ professional experience developing data solutions in cloud environments such as Azure, AWS or GCP – Databricks experience a bonus
- Experience with designing efficient physical data models/schemas and developing ETL/ELT scripts
- Strong Python and other programming skills (Spark/Scala desirable)
- Experience both using and building APIs
- Strong SQL background
- Exposure to big data technologies (Spark, Hadoop, Presto, etc.)
- Works well collaboratively, and independently, with a proven ability to form and manage strong relationships within the organisation and clients.
- Ability to support others and clients in understanding and applying technical best practice
- You proactively identify issues and opportunities for our code, methods, practices and team to be better and resolve them
- Experience of Solution, Integration and Data Architecture design
- Experience utilising consumer datasets such as eCommerce, CRM, Social Media
- Experience of Object Oriented Programming, CI/CD pipelines and broader DevOps technologies and practices
- 30 minute video interview with the People & Operations Team
- 45 minute technical video interview with our Lead Software Engineer
- Final interview with our Partner, Head of Technology
Explore our story
Get to know Curve's journey and meet some of the minds fuelling our passion