Introduction¶
omniload is a polyglot data loader framework based on dlt. It allows you to load data from any source into any destination, either using a concise CLI from your shell, or the Python API from your own applications.
omniload provides the same efficient incremental data loading modes
inherited by dlt: append, merge, and delete+insert.
Installation¶
We recommend using uv to run omniload.
pip install uv
uvx omniload
Alternatively, if you’d like to install it globally:
uv pip install --system omniload
While installation with vanilla pip is possible, it’s an order of magnitude slower.
Next Steps¶
Check out the Quickstart guide to get started with omniload.
License¶
The project is licensed under the MIT License, see the LICENSE file for details. Some components are licensed under the Apache 2.0 license, see the NOTICE file for details.
Acknowledgements¶
This project would not have been possible without the amazing work by the authors and contributors to SQLAlchemy, dlt, and ingestr, turtles all the way down. Kudos.