We recommend our Python API to everyone, but in case you cannot use it, perhaps because you use another programming language, you can access the S3 backend storage directly.
The data storage consists of a directory structure with paths like this: s3://qnt.data/market-data/cryptofeed/trades/exchange=BINANCE/symbol=BTC-USDT/dt=2022-01-01/random_name.parquet and contains compressed parquet table files that are easy to load from any programming language. If you use this interface, please implement some kind of caching or don’t download the same data often to stay compliant with our Terms. Without caching implemented, our automated monitoring might ban you. Also be warned that the column names might slightly differ from the Python API and Schemata part of this page.
For listing available data, you can read contents.json.bz2 file in the data type directory instead of lakeapi.list_data function. For example for funding data, the file is located in s3://qnt.data/market-data/cryptofeed/funding/contents.json.bz2 and is a simple bzip2 compressed json file. Please avoid recursively listing s3 directories directly, as it might be very slow and resource intensive. For