0
In the colab a mistake:
"Session failed after using all available RAM. If you have interest in accessing execution environments with more RAM, check out Colab Pro."
I wanted to decrease the csv file so as not to give this problem while importing, what do I do? It is very large 3 GB, due to this the RAM available on google Colab is not enough to import it. The file is on https://download.inep.gov.br/microdados/microdados_enem_2019.zip , and only download if needed. This is the way to download on the drive to get the file I’m referring to /content/drive/Mydrive/Microdata_enem_2019/DADOS/MICRODADOS_ENEM_2019.csv. If you could help me narrow down the csv file to get it into google colab, I would really appreciate it, and simply and just help me decrease the amount of line in the csv file, in this 5-mile file, it would be easier if I had half a million or less, to be able to import into colab.
from google.colab import drive
drive.mount('/content/drive')
import pandas as pd
#aqui que dá o erro, ao importar o arquivo csv, eu só queria diminuir ele para conseguir importar
microdados = pd.read_csv('/content/drive/MyDrive/Microdados_Enem_2019/DADOS/MICRODADOS_ENEM_2019.csv',sep=";", encoding="ISO-8859-1")
microdados.head()
The message ends with
confira o Colab Pro... It means you have to pay for a service to have more memory available. My suggestion if you don’t have the budget for this is install Jupyter on your machine. I believe that splitting the file is not the solution, because you will have to load all the same, right?– Paulo Marques
Did you try to open the file with a text editor, delete a few lines and save? I don’t understand what your question has to do with programming.
– fernandosavio
If you seek the documentation of Pandas will also see that the function
read_csvcan receive a videonrowswhich specifies how many lines of the file you want to read.– fernandosavio
that I wanted @fernandosavio , thank you very much! did not know this parameter of the read_csv "nrows", thank you very much!
– wendller