One of the most exciting new developments in the Polars world has been the release of the Polars GPU engine. With the GPU engine Polars users can accelerate their data pipelines with a tiny modifi...
Reading and writing files on S3 with Polars
In this post we see how to read and write from a CSV or Parquet file from cloud storage with Polars. We also see how Polars applies query optimisations to reduce the amount of data transferred acr...
Running a Jeckyll blog locally with Docker
I build my blog with Jekyll and host it on Netlify. Before pushing the site to github for Netlify to build and deploy it I like to build and run the site locally. I do this with Docker by running ...
Optimising Parquet reads with Polars
Polars can significantly accelerate Parquet file reads. In this post, we demonstrate how to leverage Polars query optimizations to enhance the efficiency of reading from a Parquet file. Want to...
Polars, Altair and Vegafusion
Altair has been my favourite visualisation library for a long time. It allows me to make attractive visualisations with an API that is concise and consistent. The good news is that Altair is now th...
Cheatsheet for Pandas to Polars
Getting started with Polars? This post shows you how to convert some familar Pandas commands to Polars. But it also tries to go beyond that to introduce you to some of the more fundamental differen...
Fast python package installs with uv in Docker
There is a new, faster alternative to pip installs called uv from the team at Astral behind ruff. It is a drop-in replacement for pip that is designed to be faster and more reliable. I’ve been usin...
Fitting linear models within Polars
Linear models are a staple of data science and machine learning. They are simple to understand and quick to fit. With this great new Polars plugin you can now fit linear model - including Lasso and...
Reading from S3 with Polars (or DeltaLake) using AWS SSO
Polars can read and write files from S3. However, to do this Polars needs to authenticate into your AWS account. While there is a crude solution where we copy our AWS access key and secret key from...
What is a Polars expression?
I got a good question recently from a new Polars user: What is the difference between a Series and an expression in Polars? Well, a Series is a 1D data structure. An expression is a function that ...