polars
Category: data-science-and-ml · License: https://github.com/pola-rs/polars/blob/main/LICENSE · Version: 1.2
Tags: DataFrames, data engineering, ETL, data analysis, Python
When to use it
High-performance DataFrame library for Python ETL, analytics, and pandas migration. Use for expression-based data manipulation with lazy query optimization, parallel execution, streaming out-of-core processing, Arrow interoperability, and optional GPU execution.Example requests
Ask your agent in plain language, for example:- “my pandas groupby is painfully slow, how do I convert it to polars?”
- “I have 40 GB of Parquet files in data/trips/.parquet (columns: trip_id, vendor, pickup_ts, fare, distance_km). I need average fare per km by vendor and by hour of day, and the script keeps getting killed with a MemoryError when I use pd.read_parquet. Can you rewrite it?”*
- “I’ve got sensor logs from several lab instruments in separate CSVs. I want to join them on timestamp, compute a rolling 5-minute mean per instrument without a Python loop, and write one compact columnar file I can reload quickly later. What’s a fast, clean way to do this?”
Install
/plugin marketplace add KalarisLabs/research-agent-skills and install the whole data-science-and-ml category with /plugin install data-science-and-ml@research-agent-skills.