BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations) : Part 1

This topic explains how to export data entities from Dynamics 365 Finance & Operations into their own Microsoft Azure SQL database. This feature is also known as Bring Your Own Database (BYOD). This feature was released with platform update 2 with Minor improvements and bug fixes in subsequent platform updates.

Currently, more than 1,700 data entities are available and it allows us to export data (via data entities) into another Azure SQL Database where normalized and aggregated data can be easily accessed for reporting, BI or integration purposes. Export can be done via full push (all data) or incremental push (only changed records).

Introduction

This is part one of a three-part series, In this part I talked about Data base type and the idea behind BYOD (Bring Your Own Database) , In second part, I will set up BYOD (Bring Your Own Database), and in the third part We will check some system logs for error messages as a result of BYOD (Bring Your Own Database) runs. Before start BYOD (Bring Your Own Database) system configuration within Dynamics 365 for Finance and Operations (Dynamics 365 Finance & Operations), let us understand the data model.

We has 3 data stores in Dynamics 365 Finance & Operations:

1.     Primary Data Base : 

• This is the operational database and experimental results are submitted directly into the database by any other tool-set.

1.     Secondary Data Base: 

• This is a real-time replicated database, which is used to support the application and also experimental results are submitted directly into the database by any other tool-set.

1.     Entity Store or BYOD : 

• Entity store is the operational data warehouse it can be thought of as a database attached to the primary operational database(s) but whose function is to expose the data entities in an aggregated way – note that the Entity store resides within the Dynamics 365 Finance & Operations system.

Conclusion

In this article, I talked about Data base type and the idea behind BYOD(Bring Your Own Database) , In second part, I will set up BYOD(Bring Your Own Database), and in the third part We will check some system logs for error messages as a result of BYOD(Bring Your Own Database) runs.

BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations) : Part 2

This is part second of a three-part series, In first part I talked about Data base type and the idea behind BYOD (Bring Your Own Database) , In this part, I will set up BYOD (Bring Your Own Database), and in the third part We will check some system logs for error messages as a result of BYOD (Bring Your Own Database) runs.

How-to set up BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations)

BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations) uses the Data Management Framwork Export services in Dynamics 365 for Finance and Operations, found in the “Modules > System Administration > Data Management” workspace of the environment.

Let’s begin. We will walk through the steps to set up BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations):

Step 1: set up configuration to Azure SQL DB

• Go to the System administration >> Data management >> Configure data source 

• Create a new Data source name BYODW and type Azure SQL DB

• Go to the System administration >> Data management >> Configure entity export to database 

• Go to your new created data source BYODW and replace the connection string with the given code and Validate:

• Go to the System administration >> Data management >> Data Entities

• Select all entities one by one and click Publish

• Select the BYODW data source and then Publish All

• After Publish all entity in BYODW data source Go to System administration >> Data management >> Data Entities and Select all entitie which one you want to Export under change tracking and click Change tracking after that you have to select Enable entire Entity

Step 2: export data to Azure SQL DB

• When all entity Published and Enabled change tracking then Go to System administration >> Data management >> Export and Create a new Group BYODW

• Click on Add Entity button and select all Entity which you want to export in your own Database(BYOD)

•  Click Export.

Congratulations, you have now set up BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations).

BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations) : Part 3

This is part third of a three-part series, In first part I talked about Data base type and the idea behind BYOD (Bring Your Own Database) , In second part, I will set up BYOD (Bring Your Own Database), and in this part We will check some system logs for error messages as a result of BYOD (Bring Your Own Database) runs.

How-to search system logs for BYOD and other errors in Dynamics 365 Finance & Operations

In this article I will show how to search the Execution log for errors in the running of BYOD jobs. The obvious place to look for error messages is in the Execution log of the BYOD job, but sometimes the message there is not detailed enough to understand what caused your job to fail. For detailed information you need to check system log in Event Viewer in your system.

Let’s begin. We will walk through the steps to search the Execution log for errors in the running of BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations) jobs:

Here, I have a BYODW job containing some entities, one of which failed due to some run time error. In order to see the error message, Go to System administration >> Data management >> click on “Execution details” in the Job history of your BYODW group and click “View execution log”:

In the execution log, there are some things to look for, the first thing being the error message itself. However, the error message may be too generic or even non-existent after that Staging status, Target status and Log text. first you have to notice that the Staging status is ‘Ended’ meaning that the data is imported in staging table in the BYOD job ran without issue, but the Target status is in ‘Error’. This means that the writing of the data into the destination caused the job to error out. The Log text for the Source (i.e. staging) is displayed and tells us that “'Product attribute values' record(s) inserted in staging”

After selecting the Target, you can see the Log text and got error related details sometimes it is not in details but in my scenario i got some data duplicate error you have to understand Log Text in details:

If it is not in details So, what do we do to resolve the issue? It is apparent that the Job history does not give us enough details and we simply cannot do nothing because the error will occur again in the next run of the BYOD job. For detailed information you need to check system log in Event Viewer in your system. 

When finished, click the X in the top right corner to close this search.

Congratulations, you have searched event logs for BYOD (and other) errors. we created BYOD ( Bring Your Own Database in Dynamics 365 Finance & Operations).