Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Might be worth taking a look at ripgrep[1].

[1] https://github.com/BurntSushi/ripgrep



That tool looks great :) but since we're already seeing <1s search times and the tool is only used by internal support employees, I'm mostly going with "never touch a running system" these days.

While for a database like ES you'd put all of the data into one big pile and then filter by keywords, e.g. host=ftp service=ftp query=IP, for logfiles you usually search on a much smaller set. They are rotated by day and logs are broken down by host and service by rsyslog, so instead of filtering the full 150TB - which is what ES has to do - my grep only needs to look at the 1-2 GB of data inside the file where host, service, and date match.


Do you understand something about such thing as ES indices?


RG is awesome for the basic use case. Using it across platforms just makes you tear your hair out, though.


I'm curious, why? Looks pretty easy to get the binaries.


Why? Can you share your frustrations?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: