Readit News logoReadit News
adesh_nalpet commented on Apache Iceberg   iceberg.apache.org/... · Posted by u/jacobmarble
volderette · 7 months ago
How do you query your iceberg tables? We are looking into moving away from Bigquery and Starrocks [1] looks like a good option.

[1] https://www.starrocks.io/

adesh_nalpet · 7 months ago
Common opensource options (other than Spark and Flink): 1. Dremio: https://www.dremio.com/ 2. Trino: https://trino.io/ 3. Iceberg Java API: https://iceberg.apache.org/docs/1.6.1/api/
adesh_nalpet commented on Apache Iceberg   iceberg.apache.org/... · Posted by u/jacobmarble
mritchie712 · 7 months ago
If you're looking to give Iceberg a spin, here's how to get it running locally, on AWS[0] and on GCP[1]. The posts use DuckDB as the query engine, but you could swap in Trino (or even chdb / clickhouse).

0 - https://www.definite.app/blog/cloud-iceberg-duckdb-aws

1 - https://www.definite.app/blog/cloud-iceberg-duckdb

adesh_nalpet · 7 months ago
You can just used Iceberg Java API: https://iceberg.apache.org/docs/1.6.1/api/#file-level

Use it with Dropwizard/Springboot, you get to expose rest APIs too.

u/adesh_nalpet

KarmaCake day1January 28, 2023View Original