Skip to main content

Accessing parquet files

DuckDB is the recommended way to access the parquet files of the IP.THC.ORG bulk dataset. It lets you query the full 6 billion-record reverse DNS dataset locally without loading it into a database.

  • Install duckdb:
    curl https://install.duckdb.org | sh
  • Start duckdb (in the same folder as the parquet file) by running : duckdb
  • Query the data (with the duckdb shell):
    select * from 'rdns.parquet' where ip_address='1.1.1.1' limit 10;