May God bless you with JOY, PEACE and LOVE on this Christmas
Wish you all Merry Christmas
Friends,
I am so happy to connect with you all through blogging. In this Christmas time, I would like to share my work experience on the recent data migration project.
Core logic required was
Replacing comma separated GUID values in the column with the corresponding name for the GUID from the system
I should not use tables need to manipulate using flat files.
I did it as two-step:
- Split the values, frame it like a table, do the join with reference table to get the name of the GUID and store it in a flat file.
- Then convert into comma separated values as source.
Just like this below figure
for second step, i got a snippet from google search. It really reduced my development time for this work. Here is the link
Prototype is ready. While implementing the similar transformation, I just copied the data flow task and done the required changes.
While executing the whole package, faced two error (where the DFT-Data Flow Task pasted)
Error 1:
The value is too large to fit in the column data area of the buffer
Normally, this error comes if the source column length is greater than the destination column. I am sure in my project maintained the same.
I don’t have any clue, what’s wrong? Refreshed the component, multiple time build the script component project. No use..
Finally got the solution..Delete the script component and Create it 😀
Lesson learnt: DON’T COPY PASTE THE SCRIPT COMPONENT. Time wasting on development is better than debugging the error
Error 2:
The code in the above link will not handle empty rows. So I got error like this.
There is no current row in the buffer. A row may need to be added using the AddRow method.
Added code for validate the empty rows. Problem resolved.
That’s all from my end.
If you have any suggestions on this topic, please do share your thoughts.
Feel free to reach out to me If you need any help on data migration project / consulting.
Expertise in SSIS, Talend (ETL tool), Dynamics 365/CRM adapters – Kingswaysoft, Cozyroc, Scribe, OneTapAdapter.
