Home
Rho Signal
Cancel

Pandas to Polars: what to know for time series analysis

There are differences between some important time series concepts in Pandas and Polars that you should know. In this post, to help you make the Pandas to Polars switch I talk through some of these ...

Cheatsheet for Pandas to Polars

Getting started with Polars? This post shows you how to convert some familar Pandas commands to Polars. But it also tries to go beyond that to introduce you to some of the more fundamental differen...

Which operations work in streaming mode in Polars?

In a recent post I set out the key ideas behind streaming mode in Polars. However, streaming is still a developing part of Polars and not all operations support streaming. I’d like to improve docu...

Streaming large datasets in Polars

One major advantage of Polars over Pandas is that working with larger-than-memory datasets can be as easy as adding a single argument to a function call. However, streaming doesn’t work in all case...

AWS Lambda with Polars

Updated December 2023 This post was created while writing my Up & Running with Polars course. Check it out on Udemy with a 50% discount These days working in serverless environments with ...

What does ChatGPT's Advanced Data Analysis have installed?

How we do it So what does ChatGPT’s Advanced Data Analysis have installed? On Twitter last night I showed how you can get ChatGPT to install a python package like Polars from a wheel file. We do t...

Maybe they should just call it Regular Data Analysis

Open AI used to have a product called Code Interpreter. Which was a name that didn’t make much sense because it doesn’t interpret code. Instead it’s a language model that can ingest CSVs and genera...

Reading from S3 with Polars

Updated October 2023 In this post we see how to read and write from a CSV or Parquet file in S3 with Polars. We also see how to filter the file on S3 before downloading it to reduce the amount of ...

Understanding the Polars nested column types

Polars has 4 native nested column types. These can be very helpful at solving problems such as: working with ML embeddings splitting strings working with nested JSON data working with aggr...

Comparison of Matplotlib and Plotly in Polars

Updated July 2023 From Plotly v5.15.0 onwards Plotly has native support for Polars😊. So you can pass the DataFrame as the first argument and the column names as strings to the x and y encoding argu...