About Me

I am Connor Charles, a Technical Lead and Data Engineer with more than 11 years of experience building data-intensive applications, pipelines and machine learning products.

I started my career as a Data Scientist at an energy company. I spent 5 years there building machine learning models and data pipelines that forecasted retail commodity demand for various European energy portfolios. I then started moving away from machine learning and data science into a more data and software engineering focussed role.

Medium Blog Posts

When I worked at Autotrader I wrote a number of blog posts on their engineering blog. You can find them here

dbt-dry-run

I currently maintain a python package called dbt-dry-run which is a tool for validating that a dbt project can run successfully without querying any data. This allows you to validate thousands of models very quickly and for free! This is useful in CI/CD and also running locally. I’m really proud of this project and it is being used in production by a number of companies.

Education

I hold a First Class MPhys (Hons) in Physics from The University of Manchester.