Posted in Data Migration, Dynamics 365, Dynamics CRM, SSIS

{SSIS – Special characters getting appended while migrating records from CSV to SQL table}

After long back..

Hope everyone had wonderful New year and Pongal celebrations. Hoping for the next year (2018)  Pongal celebrations  with full fledged government support  for conducting JALLIKATTU in Tamil Nadu.

Lets discuss an important tip for data migration.

Recently I faced an issue in moving records from CSV file to Dynamics CRM 2016.

Scenario:  In my data file, it has Arabic letters. So i set the properties of CSV file in UTF-8 format. After i moved the data to the table, checked out the Arabic field column. It has some special characters are appended. If i am moving using Excel file, it’s not appending any special characters.

Resolution: After searched various forums , I have found that It’s a data type issue. If we check the arabic values column and its data type, it shows as DT_STR. But it supposed to be DT_WSTR. So changing the data type of the required columns to DT_WSTR data type will help to overcome this issue.

Hope will help somebody in future.

Happy sharing !!

Posted in Data Migration, Dynamics 365, Dynamics CRM, SSIS

Data Migration SSIS Tips – 1

Recently we were migrating records from Source system to staging database and then to Dynamics CRM 2016 using SSIS.

Few issues are encountered while we migrating the large number of records.

Script component:

Some time we might require to use the script components because some conversion is not possible/not easy with SQL. In this case, number of columns which you processing will affect performance of the package.

How to improve ?

Avoid using the script component as much as possible

We can utilise the BDD – Balanced Data Distributor. It helps to parallelize the data flow. if you new to this, here is the link for more information (BDD – Balanced Data Distributor)

Try to use synchronised transformation. It’s better compared to Asynchronous. Ideally it’s up to the requirement. for better understanding, here is the link (Synchronous vs Asynchronous

Derived column:

The number of columns in derived columns also affects the performance of the package.

Then how to ?

Try not to use the derived columns as much as possible

If there is a need, we have to use. then use multiple “Derived columns” component for manipulation. Instead of doing all the manipulation in single “Derived column”. Significantly it will improve the performance

Data Conversion:

This component in SSIS which will help to convert the data type of column to another compatible data type. It’s just drag and  drop and easy to use. when you really care about the performance, then here we go. It does maintains the old column as well as converted column too.

Then how to ?

Try to do the conversion at source itself. It’s best as package don’t need to maintain the duplicate of it.

If the conversion is not possible at source, do the manipulation at staging.

Always, i prefer to have the manipulation in Stored Procedure. It really faster and it will not impact the performance as much as others.

Do share your knowledge on these..

Keep Sharing …

Posted in Dynamics 365

Controls to explore in #Dyn365

From November 1, Microsoft has released the Dynamics 365 for general use. I just started exploring the new features available in it.

Lets see whats new in the controls and its configuration?

New Controls at Entity Level

In Dynamics CRM, We can add the controls for the entity.It could be enabled or disabled for Phone and Tablet.

Ex. List/Grid, Calendar and Timeline.

In Dynamics 365, We can add few more controls for the entity. It could be enabled or disabled for Web, Phone and Tablet.

Ex. List/Grid, Calendar, CardFeedContainer, Editable Grid and Timeline.


How to configure the new controls?

In my previous post, I have shared screenshots of editable grid features. here is the steps to configure it too.

Editable Grid Properties:

Once you added Editable Grid control, another tab with the name of “Events” will be visible. So here you can configure the events to be triggered on the Editable Grid. Continue reading “Controls to explore in #Dyn365”