Mastering Development

shell script: use pipelines instead of files for batch processing

I’m using these two commands in order to process a huge single sequence of json objects:

$ jq -c '.[]' csvjson.json | split -l 25 - splitted

Above command, creates several splitted-* files, containing 25 lines each one.

$ jq --slurp 'map({PutRequest: {Item: map_values({S: .})}})' splitted-n > output-n.json

Is there any way to pipeline above two commands?

Leave a Reply

Your email address will not be published. Required fields are marked *