Damn, if you took out the “Kubernetes” part, and made it generalized, it looks like you built something that I have wanted to see for a long time. I think log explorers work best as a GUI, and that they need deep integration with structured logs. Basically I just want the DataDog log explorer but locally, and able to simply intake from some files. Some have tried, but they are always too simple, not parsing out properties of structured logs and building good filtering on top of that. I think setting up Grafana/Loki/Whatever is way too heavy for such a simple ask.
Anyway all that is anecdotal, what you made here is really cool!
andres 15 hours ago [-]
Thanks! Part of what enables us to make a helpful lightweight solution is that we're leveraging the Kubernetes API to give logs context without requiring extra configuration. It'd be great to generalize Kubetail but a lot of that depends on how cloud platforms evolve over the next few years. Do you use Kubernetes?
bbkane 10 hours ago [-]
Look into https://logdy.dev . I've played around with it a little bit, but really putting some work into learning it and integrating it with OTEL traces is my next side project.
Another alternative is https://openobserve.ai/ . It needs to run as a daemon to ingest logs (instead of opening a file), but it has a really nice UI.
piterrro 2 hours ago [-]
Logdy author here, thanks for calling out the project! Kubetail is probably best fit for k8s while Logdy is leveraging more unix-like philosophy of being a self contained tool you can tailor to your needs whether that's tailing files, pumping it through TCP socket or REST API.
I have plans to include a sqlite storage so Logdy could be used in environments where permanent storage is needed
AYBABTME 13 hours ago [-]
Sorry for bringing up my own side-project on a "Show HN", but I'm making humanlog.io which does exactly what you want. Local-first log query engine (and tracing too, soon). You feed it your logs and you can search them, aggregate them, and soon make some graphs and dashboards with them. It started as just a CLI tool to parse and make structured logs pretty, and now I'm turning it into a full observability tool on your machine.
It's very WIP but I would love to help you get started if you want to try it out.
glitchcrab 16 hours ago [-]
My personal preference for log tailing is Stern. It doesn't have a web UI but then I've never felt like I needed one.
I was about to comment about Stern. It's an established well known OSS project - I wonder if the author knew about it, and if so.. what was his inspiration for creating an almost identical clone, albeit with a UI on top?
rc00 13 hours ago [-]
+1 for Stern especially since it only has Go dependencies whereas Kubetail does not. Ease of integration with an existing stack is a bigger addition than the lack of a web UI is a subtraction.
andres 15 hours ago [-]
If you get a chance to try out the Kubetail CLI, I'd love to hear your thoughts! There's a lot of overlap with stern at the moment but we're planning on adding new features soon that will be unique (e.g. remote grep, system logs).
LetMeLogin 16 hours ago [-]
Stern is the best!
carlgreene 15 hours ago [-]
Wow, this is exactly what I’ve been missing—juggling a dozen kubectl logs windows and still losing context. Seeing all container logs merged in real time is a game-changer for debugging multi-pod workloads. Love that it runs locally against the API—no more sending sensitive logs offsite. Big thanks to the author for saving my sanity here!
biot 12 hours ago [-]
While the search offered is handy, I watch logs on multi-pod workloads via:
kubectl logs -f -l app=api --max-log-requests=50
This follows along all pods with the given label (app: api) for up to 50 pods or however many you want. Quite useful when I'm looking for specific output such as ERROR logs to just pipe it to grep like this:
and get realtime filtering of all log output without having to tail individual pods by name.
andres 15 hours ago [-]
Thanks! Your comment made my day! It sounds like your use-case is similar to mine when I started working on the project. Now we have a community of contributors working on Kubetail so if you have time, stop by our Discord and let us know what else we can do to help (https://discord.gg/CmsmWAVkvX).
nomilk 6 hours ago [-]
I don't use kubernetes but the GUI looks great, I'm looking for something sililar for heroku (currently storing logs in papertrail but haven't found a great way to search through achieved logs, especially locally).
Great demo video btw. Would you mind detailing which software you used to make it? I'd like to do similarly for some of my projects.
andres 6 hours ago [-]
Thanks! I used Screen Studio for the demos (https://screen.studio). I had to pay for it but I couldn't find the zoom+highlight feature anywhere else.
Regarding Heroku - I loved Heroku the first time I used it so I set up my Kubernetes cluster to work in a similar way (`git push` to deploy to production). I know K8s has a reputation for being useful only for large deployments/large teams but in my experience this isn't true. You can run a single node cluster and use it to host multiple projects all sharing the same load balancer, or you can scale up to thousands of machines with many microservices working together internally. Would it be helpful for you to see a HOWTO for setting up a Heroku-like K8s cluster?
Thanks for sharing! The zoom and highlight are so simple but really make your demo pop.
> Would it be helpful for you to see a HOWTO for setting up a Heroku-like K8s cluster?
Sure, I think a lot of people would appreciate that!
otterley 13 hours ago [-]
"Search" feels like a bit of a stretch to me--that suggests that it plays in the same space as OpenSearch or Splunk. There's no index here that I can tell.
"Filter" sounds more accurate.
andres 12 hours ago [-]
Yes, there's no index. It uses grep (powered by ripgrep) under the hood.
ai-christianson 15 hours ago [-]
This looks awesome --do you cache or store the logs, or is that left up to k8s?
andres 15 hours ago [-]
Thanks! Kubetail doesn't cache or store logs itself. By default, it uses the Kubernetes API to fetch logs from your cluster and send them directly to your client (browser or terminal). If the "Kubetail Cluster API" is installed then it uses Kubetail's custom agent to do the same.
ai-christianson 15 hours ago [-]
Presumably I can install this (the web frontend) into k8s itself. Is there a helm chart or kustomize?
Would be really cool to install it into k8s and just hit a hosted web endpoint with all the logs and grep/exploration capabilities kubetail has.
andres 15 hours ago [-]
Yep! You can use Kubetail on your desktop (using the CLI tool) or you can install it directly in your cluster using helm:
Thanks for posting a link to Johan's project. I'm in touch with him to figure out the best way to avoid confusing users.
cassianoleal 4 hours ago [-]
A good starting point would be to not take over the name of an existing product.
badmonster 13 hours ago [-]
How does it compare to tools like Loki/Grafana or Stern?
andres 12 hours ago [-]
Kubetail is more lightweight than Loki/Grafana. It fetches logs using the Kubernetes API which means you can only see the current state of the cluster but you can use it without installing any additional software or provisioning storage. Our new search feature greps container log files on the nodes themselves as compared to Loki/Grafana that builds a full-text index in the background and queries that at search time (I think).
Stern is a CLI tool which more closely compares to the Kubetail CLI tool (as opposed to the Kubetail web interface). Currently, there's a lot of overlap between the two tools but Kubetail gives you more control over source filters and time. For example with the Kubetail CLI tool you can do queries like this:
I'm not too familiar with stern though so please correct me if I'm wrong. In any case, soon we're going to add more features to the Kubetail CLI tool that will be unique (e.g. remote grep, system logs).
gitroom 5 hours ago [-]
bruh merging logs from all pods at once is something i always wanted, props for finally making this sane
Anyway all that is anecdotal, what you made here is really cool!
Another alternative is https://openobserve.ai/ . It needs to run as a daemon to ingest logs (instead of opening a file), but it has a really nice UI.
It's very WIP but I would love to help you get started if you want to try it out.
https://github.com/stern/stern
Great demo video btw. Would you mind detailing which software you used to make it? I'd like to do similarly for some of my projects.
Regarding Heroku - I loved Heroku the first time I used it so I set up my Kubernetes cluster to work in a similar way (`git push` to deploy to production). I know K8s has a reputation for being useful only for large deployments/large teams but in my experience this isn't true. You can run a single node cluster and use it to host multiple projects all sharing the same load balancer, or you can scale up to thousands of machines with many microservices working together internally. Would it be helpful for you to see a HOWTO for setting up a Heroku-like K8s cluster?
Thanks for sharing! The zoom and highlight are so simple but really make your demo pop.
> Would it be helpful for you to see a HOWTO for setting up a Heroku-like K8s cluster?
Sure, I think a lot of people would appreciate that!
"Filter" sounds more accurate.
Would be really cool to install it into k8s and just hit a hosted web endpoint with all the logs and grep/exploration capabilities kubetail has.
https://github.com/johanhaleby/kubetail
Stern is a CLI tool which more closely compares to the Kubetail CLI tool (as opposed to the Kubetail web interface). Currently, there's a lot of overlap between the two tools but Kubetail gives you more control over source filters and time. For example with the Kubetail CLI tool you can do queries like this:
I'm not too familiar with stern though so please correct me if I'm wrong. In any case, soon we're going to add more features to the Kubetail CLI tool that will be unique (e.g. remote grep, system logs).https://github.com/stern/stern