-1
Working with automatic measurements every 5 min in a database, as illustrated:
I usually use Excel for analysis (sum, mean, distribution, etc.). However, due to the large volume of data, about 500 thousand lines, excel does not account for the processing. I would like to develop an application that only does the analysis I need, but I don’t know what would be the most correct way to store the data (csv, txt, mysql, etc.) or what is the most suitable programming language for data processing of this type.
I’d like your opinion.
I understand well that at this time still has no database, only excel? Where do the data/ measurements come from? what kind of accounts do you want to do?
– Sergio
Only excel and files . csv . This data comes from dataloggers that monitor solar power systems and weather stations.
– Rafael
And how do the data get to the computer? via internet, file, or handwritten?
– Sergio
A file for each month, where each file has a file for each day, for example: C:/January/ has the archives: 01-01-2014.csv, 02-01-2014.csv, ...
– Rafael
R is an interesting language to work with data analysis.
– Renato Dinhani
Don’t invent the wheel, there are statistical software like SAS ($) and R (free).
– Motta
Thank you very much, guys, I’m going to do a little research on the options you’ve provided.
– Rafael