1
I have a program in Delphi that imports certain CSV file to an SQL database in order to later compare the data between different versions of the same file, for example a version of the file is from 01/09 and another from 15/09, the purpose of the program is to compare what has changed
First the program imports the CSV data to a Jvmemorydata object and then executes an Adoproc loop that does the Insert in SQL with the data of that Jvmd per line
It turns out that the CSV has a 38-column pattern and something Prox of 1 million rows! As the client does not use all the information in the spreadsheet I made a quick import option that does the input only of the columns used, but even so the process of reading and importing the file takes up to 50 min
How can I make this go faster?
Moving forward, in the article Bulk import of data you can find tips on how to import using SQL commands -> https://portosql.wordpress.com/articles/
– José Diz