Senior Databricks Automation Test Analyst – 70-80K
📍 Location: London (Hybrid Working)
📄 Type: Permanent
We’re working with a leading financial services organisation that is building out a modern, cloud-native data platform – and they’re looking for a Senior Data Automation Test Analyst to help embed a test-first approach and enhance the quality of their data solutions.
This is an exciting opportunity to join a team at the start of their data transformation journey, where you’ll play a key role in implementing best practices and shaping their testing capability for the future.
What You’ll Be Doing
-
Collaborating with engineers, architects, and stakeholders to ensure effective and consistent data testing across the platform.
-
Designing and building automated tests for data pipelines, transformations, and validations within a Databricks environment.
-
Supporting the evolution of the organisation’s data quality strategy by influencing testing approaches and tooling selection.
-
Working with business and technical teams to analyse testing requirements (both functional and non-functional).
-
Creating and maintaining reusable data queries and scripts to support test preparation and execution.
-
Identifying opportunities to improve automation and test coverage, and driving those initiatives forward.
-
Helping embed BDD/TDD practices and mentoring junior colleagues.
What They’re Looking For
-
Strong, hands-on experience with Databricks, PySpark, and cloud-native data technologies.
-
Practical experience testing data pipelines, particularly in Azure and ADF (Azure Data Factory) environments.
-
Proficient in Python and SQL, with the ability to work with large datasets and complex queries.
-
Familiarity with tools like Postman/ReadyAPI for API testing.
-
Understanding of CI/CD pipelines and how test automation fits into the broader SDLC (desirable).
-
Experience in environments with evolving or maturing data engineering capabilities — someone who can help “bring others on the journey.”
-
Confident communicator who can advocate for testing, coach others, and challenge constructively when needed.
-
Ideally, 5+ years working in data-focused or cloud environments with a solid grasp of data quality best practices.
Bonus Points For
-
Experience with Power BI for creating data quality dashboards or reports.
-
Knowledge of modular test frameworks and structured, scalable approaches to testing in a Databricks context.
-
Exposure to medallion/lakehouse architectures and familiarity with modern data engineering principles.
