python - How to save and load data from JSON?

Question

How can I load data from JSON file with raw long text data?

I have big file with news:

[body] is a news data that I need to analyze.

I tried to read it like this:

with open('file.json', 'r') as openfile: 
  
    # Reading from json file 
    dfnew = json.load(openfile) 
openfile.close

But I get an error:

Extra data: line 2 column 1 (char 1938)

Maybe you know the better way, how can I save it, to easily read?

I created the file from dataframe by using this code:

df.to_json('file.json', orient='records', lines=True)

question from:https://stackoverflow.com/questions/65881546/how-to-save-and-load-data-from-json

Answer 1

Your data seems to be in the Newline Delimited JSON format. Instead of trying to parse the whole file, you can parse the individual lines with json.loads. Also you don't need to close files if you are using a with statement.

import json

with open('file.json') as openfile:
    for line in openfile:
        dfnew = json.loads(line)
        print(dfnew)