Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I have a simple bash script composed of 6 sed commands piped together to convert >100GB csvs (table dumps of recommendation data) into Redis binary protocol which are then ingested into a Redis Cluster using redis-cli --pipe. It takes somewhere around 15 minutes running on a modest bare metal server.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: