Readit News logoReadit News
r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
0x3331 · 6 months ago
Very cool! Tested it with the demo, very smooth!
r0b3r4 · 6 months ago
Thanks!
r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
alrocar · 6 months ago
Awesome stuff! Just published something similar today

Just curious, what is the most challenging thing in your opinion when building such log viewer?

r0b3r4 · 6 months ago
That sounds great! Do you have a link? I'd love to check it out.

For me, the most challenging parts are still ahead - live tailing and a plugin system to support different storage backends beyond just ClickHouse. Those will be interesting problems to solve! What was the biggest challenge for you?

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
kbumsik · 6 months ago
How is it different from Signoz, a complete observability stack (including Logs) built on top of Clickhouse?
r0b3r4 · 6 months ago
Telescope is focused purely on viewing logs for existing data. It doesn’t enforce any specific ingestion setup or schema and doesn’t support traces or session storage.

You can think of it as just one part of a logging platform, where a full platform might consist of multiple components like a UI, ingestion engine, logging agent, and storage. In this setup, Telescope is only the UI.

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
helsinki · 6 months ago
Just curious, as I'm in the market - why should I use this instead of the ELK stack?
r0b3r4 · 6 months ago
Well, if you're happy with ELK, you should definitely use it! As I mentioned earlier, I’m not trying to sell anything or convince people to switch from their current solutions - just offering an alternative perspective on how things can be done.

From my perspective, a ClickHouse-based setup can be cheaper and possibly faster in certain conditions – here’s some comparison made by ClickHouse Inc. - https://clickhouse.com/blog/clickhouse_vs_elasticsearch_the_...

My motto is "Know your data". I’m not a big fan of schemaless setups - I believe in designing a proper database schema rather than just pushing data into a black hole and hoping the system will handle it.

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
oulipo · 6 months ago
Very cool! Would be nice to have a library for the frontend components for the log viewer, to be able to reuse them in other projects :)
r0b3r4 · 6 months ago
Nice idea! However, I’m not experienced enough with Vue (and frontend) development to properly design an exportable component. So, at least for now, I don’t think I’ll be able to make it happen myself.
r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
smjburton · 6 months ago
Would this also work with something like Plausible (https://github.com/plausible/analytics) which uses ClickHouse to store web analytics data, or is it primarily for log data?
r0b3r4 · 6 months ago
Despite the fact that Telescope is focused on application log data, it could be used for any type of data as long as it's stored in ClickHouse and has some time fields.

At the moment, I have no plans to support arbitrary data visualization in Telescope, as I believe there are better BI-like tools for that scenario.

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
ericb · 6 months ago
Very cool! Just digging in. Does it works with the new JSON format clickhouse introduced recently?

Also, what service did you use to make the video, if you don't mind my asking?

r0b3r4 · 6 months ago
Thanks!

I haven't tested the new JSON format in ClickHouse yet, but even if something doesn't work at the moment, fixing it should be trivial.

As for the video service, it wasn’t actually a service but rather a set of local tools:

- Video capture/screenshots - macOS default tools

- Screenshot editing - GIMP

- Voice generation - https://elevenlabs.io/app/speech-synthesis/text-to-speech

- Montage – DaVinci Resolve 19

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
nh2 · 6 months ago
It would be great if the logs could describe a bit what exactly one has to do to use this as an alternative to Grafana Loki.

How do I get my logs (e.g. local text files from disk like nginx logs, or files that need transformation like systemd journal logs) into ClickHouse in a way that's useful for Telescope?

What kind of indices do I have to configure so that queries are fast? Ideally with some examples.

How can I make that full-text substring search queries are fast (e.g. "unexpected error 123")? When I filter with regex, is that still fast / use indices?

From the docs it isn't quite clear to me how to configure the system so that I can just put a couple TB of logs into it and have queries be fast.

Thanks!

r0b3r4 · 6 months ago
Telescope is primarily focused on log visualization, not on log collection or preparing ClickHouse for storage. The system does not currently provide (and I think will not ever) built-in mechanisms for ingesting logs from any sources.

I will consider providing a how-to guide on setting up log storage in ClickHouse, but I’m afraid I won’t be able to cover all possible scenarios. This is a highly specific topic that depends on the infrastructure and needs of each organization.

If you’re looking for a all-in-one solution that can*both collect and visualize logs, you might want to check out https://www.highlight.io or https://signoz.io or other similar projects.

And also, by the way, I’m not trying to create a "Grafana Loki killer" or a "killer" of any other tool. This is just an open source project - I simply want to build a great log viewer without worrying about how to attract users from Grafana Loki or Elastic or any other tool/product.

r0b3r4 commented on Show HN: Telescope – an open-source web-based log viewer for logs in ClickHouse   github.com/iamtelescope/t... · Posted by u/r0b3r4
csh602 · 6 months ago
Looks simple and clean! Big ups for starts of good screenshots, docs, and quickstart (Docker) instructions.

Regarding the name, "Telescope" is also the name of a Neovim fuzzy finder[0] that dominates the ecosystem there. Other results appear by searching "telescope github".

[0]: https://github.com/nvim-telescope/telescope.nvim

r0b3r4 · 6 months ago
Well, every single name I came up with was already taken and present in GitHub. So...

u/r0b3r4

KarmaCake day82May 30, 2022View Original