Hi all,
I have a script that generates 4 million + snippets of json code.
What would you agree on on being the best way to store them?
I have considered:
- json files - way too many even if split in subfolders
- mongo DB
- mySQL with json type field
The aim is to be able to easy retrieve them for processing later.
Language is python.
Bonus question: each of these 4m+ json will have 10-15 images related to it. Where and how do you store the images?
I have a script that generates 4 million + snippets of json code.
What would you agree on on being the best way to store them?
I have considered:
- json files - way too many even if split in subfolders
- mongo DB
- mySQL with json type field
The aim is to be able to easy retrieve them for processing later.
Language is python.
Bonus question: each of these 4m+ json will have 10-15 images related to it. Where and how do you store the images?
Comment