How to Use Microsoft Graph Data Connect to Extract Data Using Azure Data Factory from Office 365 and Push to Azure Blob Storage – Part 2


Sathish Nadarajan
SharePoint MVP
Published On :   12 Nov 2018
Visit Count
Today :  1    Total :   260



In the earlier article, we saw How to create the Azure AD Application and the Blob Storages. Now, let us focus on the Azure Data Factory

As usual, let us see the step by step procedures.

1. Login to the Azure Portal with your Office 365 account.

clip_image002

2. Create New Resources “Azure Data Factory”

clip_image004

3. Click on Create

clip_image006

4. Enter the Values and Click on Create.

clip_image008

5. Click on Author and Monitor

clip_image010

6. Click on Author

clip_image012

7. Create a New Pipeline

clip_image014

8. Drag and Drop the Copy Data Activity in the Canvas.

clip_image016

9. Now, we need to give the Source and the Sync for this activity pipeline.

clip_image018

10. Click on the Source Tab.

clip_image020

11. Click on the New Source Dataset.

Select the Office 365 Data source.

clip_image022

12. Under the Dataset, the newly selected datasource will be listed.

clip_image024

13. Now, establish a connection with the new application which we have created.

14. Enter the Application ID as Service Principal ID and Key as Service Principal key

clip_image026

15. In this example, I am going to pull the Users.

clip_image028

16. Yes, Now, we are done with the Source. Let us target the Target. i.e.,nothing but the blob storage which we have already created.

17. Select the Pipeline and Go to the Tab “Sink”

clip_image030

18. Add New Dataset and select the Azure Blob Storage

clip_image032

19. Establish a connection for that as well, using the application ID which we have created already.

20. The Linked Service details are as follows.

clip_image034

clip_image036

21. Select the Container which we have created.

clip_image038

22. With this, we are done with the pipeline, source and target data sources.

23. Now, Validate the ADF.

24. After the validation, click on the Publish.

clip_image040

25. Once, it is published, then Trigger the pipeline.

clip_image042

26. Now, the ADF started extracting the user related information from the Office 365 and trying to push it to Azure Blob Storage.

27. Before, that, we need to approve the task by going to the URL https://admin.microsoft.com/AdminPortal/Home#/Settings/PrivilegedAccess

clip_image044

clip_image046

28. Once, we triggered the job, we can monitor the job on the “Monitor” tab.

clip_image048

clip_image050

Happy Coding,

Sathish Nadarajan.

Categories