โ FAQ
-
What versions of Polars are supported?
Short answer: Polars == 1.29.0 is supported.
Long answer: We recommend handling most of the heavy lifting on the DataFusion side (e.g., using SQL and views) and relying on Polarsโ streaming capabilities primarily for projection, filtering and sinking results. Right now, Polars 1.29.0 is the last version that supports pyo3 0.24.x that is required by DataFusion. With the most recet version of polars-bio (0.13.0) we migrated to the Polars new streaming engine.
-
What to do if I get
Illegal instruction (core dumped)
when using polars-bio? This error is likely due to the fact that the ABI of the polars-bio wheel package does not match the ABI of the Python interpreter. To fix this, you can build the wheel package from source. See Quickstart for more information. -
How to build the documentation? To build the documentation, you need to install the
Some pages of the documentation take a while to buildโto speed up the process, you can disable dynamic content rendering:polars-bio
package and then run the following command in the root directory of the repository: -
How to build the source code and install in the current virtual environment?
-
How to run the integration tests? To run the integration tests, you need to have the
azure-cli
,docker
, andpytest
installed. Then, you can run the following commands:Check thecd it source bin/start.sh JUPYTER_PLATFORM_DIRS=1 pytest it_object_storage_io.py -o log_cli=true --log-cli-level=INFO source bin/stop.sh
README
init
directory for more information.