How To Convert A .csv File Into A .json File

Cover Image for How To Convert A .csv File Into A .json File
James Phoenix
James Phoenix

Depending upon your situation, you might need to change file formats to correctly upload your data into another platform. This can easily be achieved with Python with the pandas package.


!pip install pandas
import pandas as pd
import json

. . .

Firstly you can load .csv data in pandas with:

pd.read_csv('some_filename.csv')
df = pd.read_csv('ice-cream-example.csv')
df
Ice Cream TypeGBP Price
0Vanilla3.50
1Chocolate2.50
2Strawberry2.25

Then you can transform it into json:

.to_json()

json_data = df.to_json()

print(json_data)
{"Ice Cream Type":{"0":"Vanilla","1":"Chocolate","2":"Strawberry"},"GBP Price":{"0":3.5,"1":2.5,"2":2.25}}

It’s also possible to change the structure of the json data returned by modifying the orient parameter.

For Series objects the default is ‘index’ and the allowed values are:

  • ‘split’
  • ‘records’
  • ‘index’
  • ‘table’

For DataFrames, the default is ‘columns’ and the allowed values are:

  • ‘split’
  • ‘records’
  • ‘index’
  • ‘columns’
  • ‘values’
  • ‘table’
df.to_json(orient='records')
'[{"Ice Cream Type":"Vanilla","GBP Price":3.5},{"Ice Cream Type":"Chocolate","GBP Price":2.5},{"Ice Cream Type":"Strawberry","GBP Price":2.25}]'
df.to_json(orient='index')
'{"0":{"Ice Cream Type":"Vanilla","GBP Price":3.5},"1":{"Ice Cream Type":"Chocolate","GBP Price":2.5},"2":{"Ice Cream Type":"Strawberry","GBP Price":2.25}}'

By including a file name inside of the .to_json() method, the json will be automatically saved:

df.to_json(path_or_buf='saved_data.json' , orient='records')

Alternatively if we don’t include a file name in the path_or_buf parameter, then the result returned from to_json() is a string, which we can easily turn into a local json file with:

with open('json_example.json', 'w') as f:
    json.dump(json_data, f)

TaggedPython For SEO


More Stories

Cover Image for What Are Webhooks? And How Do They Relate to Data Engineering?

What Are Webhooks? And How Do They Relate to Data Engineering?

Webhooks are a simple and powerful method for receiving real-time notifications when certain events occur. They enable a whole host of automated and interconnected applications. Broadly speaking, your apps can communicate via two main ways: polling and webhooks.  Polling is like going to a shop and asking for pizza – you have to ask whenever you want it. Webhooks are almost the…

James Phoenix
James Phoenix
Cover Image for What is an API? And How Do They Relate to Data Engineering?

What is an API? And How Do They Relate to Data Engineering?

An API, or Application Programming Interface, is a set of rules and protocols that allow different software systems to communicate with each other. Put simply, APIs define how software components should interact and allow developers to create new applications by leveraging existing functionality from other systems. Research shows that business investment in API has boomed in recent years, and significant API investment…

James Phoenix
James Phoenix