Accessing parquet files
DuckDB is the recommended way to access the parquet files of the IP.THC.ORG bulk dataset. It lets you query the full 6 billion-record reverse DNS dataset locally without loading it into a database.
- Install duckdb:
curl https://install.duckdb.org | sh
- Start duckdb (in the same folder as the parquet file) by running :
duckdb - Query the data (with the duckdb shell):
select * from 'rdns.parquet' where ip_address='1.1.1.1' limit 10;