Keyword search in a large CSV file using Python

Question

I wonder if there is a way to search a list of keywords using Python. I am able to search though my data using PostgreSQL. Here is my PostgreSQL code

SELECT distinct ON (id) id, year, cost, description
FROM mydata
WHERE description similar to'%((hotel)||(travel)|(taxi)|(food))%';

I don't know if Python is the best way to do it, but the work that I am replicating uses Python and would like to stick with Python.

I was able to search one keyword but am not sure how to do multiple.

 import csv
 with open('mydata.csv', 'r') as f:
    for line in f.readlines():
        if 'food' in line:
            print(line)

I need help with

1) searching using multiple keywords

2) way to export the data back to csv

Assuming you have a reasonable amount of data to search, pandas would be an easy/efficient way to import, search, and export. Basics: pandas.pydata.org/pandas-docs/stable/10min.html. Here's an answer that specifically addressed what you're trying to do: stackoverflow.com/questions/38185688/… — ZaxR
– ZaxR, Commented Apr 5, 2018 at 4:02

Kul · Accepted Answer · 2018-04-05 06:02:27Z

0

> import pandas as pd

multiple keyword search using contains

> df = pd.read_csv('mydata.csv')
> df[df.description.str.contains('hotel|travel|taxi|food')]

Export to csv

> df.to_csv('new.csv')

answered Apr 5, 2018 at 6:02

Kul

738 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1