Arctic is a high performance datastore for numeric data. It supports Pandas, numpy arrays and pickled objects out-of-the-box, with pluggable support for other data types and optional versioning.
Arctic can query millions of rows per second per client, achieves ~10x compression on network bandwidth, ~10x compression on disk, and scales to hundreds of millions of rows per second per MongoDB instance.
Arctic has been under active development at Man Group since 2012.
ArcticDB, Man Group's high-performance Python-native DataFrame database, is available on GitHub.
ArcticDB is the next generation of Arctic and is designed to be a drop-in replacement for it, providing a platform that is:
- Fast: Capable of processing billions of rows in seconds
- Flexible: Designed to handle complex real-world datasets
- Familiar: Built for the modern Python Data Science ecosystem - Pandas In/Pandas Out!
This repository does not contain the code for ArcticDB, but instead contains the older (first) version of the Arctic platform. This repository is now in maintenance mode and all ongoing development efforts will be focused on ArcticDB.
If you would like information on ArcticDB please see the website or get in touch with us at [email protected].
Information on how to set up, install and use Arctic has been migrated to README-arctic.md.
This repository is in maintenance mode as ongoing development has migrated to ArcticDB.