Processing 256M publications records using Awk and parallel scripting

Heykuki News

9 points

6 years ago

I participated in a organizational data challenge in 2018 and chose awk to process the massive data to solve several interesting challenges.

The repo is: https://github.com/ketancmaheshwari/SMC18

A report detailing the approach and results is here: https://github.com/ketancmaheshwari/SMC18/blob/master/report/SMC18_DataChallenge4.pdf

3 comments

Processing 256M publications records using Awk and parallel scripting | Heykuki News