Advertisement
furas

Python - pandas read csv in loop

Mar 19th, 2017
202
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.46 KB | None | 0 0
  1. import pandas as pd
  2.  
  3. # --- functions ---
  4.  
  5. def read_part(start, size):
  6.     try:
  7.         df = pd.read_csv('data.csv', skiprows=start, nrows=size)
  8.         return df
  9.     except pd.io.common.EmptyDataError:
  10.         return None
  11.  
  12. # --- main ---
  13.  
  14. start = 0
  15. size = 8000
  16. while True:
  17.     print('start:', start)
  18.    
  19.     df = read_part(start, size)
  20.    
  21.     if df is None or len(df) < size:
  22.         print('end of data')
  23.         break
  24.    
  25.     start += size
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement