ÃÛ¶¹ÊÓÆµ

1.2.5 Data Landing Zone

In this exercise, the goal is to setup your Data Landing Zone Source connector with Azure Blob storage.

Data Landing Zone is an Azure Blob storage interface provisioned by ÃÛ¶¹ÊÓÆµ Experience Platform, granting you to access a secure, cloud-based file storage facility to bring files into Platform. Data Landing Zone supports SAS-based authentication and its data is protected with standard Azure Blob storage security mechanisms at rest and in transit. SAS-based authentication allows you to securely access your Data Landing Zone container through a public internet connection.

NOTE
ÃÛ¶¹ÊÓÆµ Experience Platform enforces a strict seven-day time-to-live (TTL) on all files uploaded to a Data Landing Zone container. All files are deleted after seven days.

Prerequisites

To copy blobs or files to your ÃÛ¶¹ÊÓÆµ Experience Platform Data Landing Zone you’ll use AzCopy, a command-line utility. You can download a version for your operating system via , scroll down on that page to Download the AzCopy portable binary and select the approproate version for your OS.

dlz-install-az-copy.png

  • Unzip the downloaded file

dlz-install-az-copy.png

dlz-install-az-copy.png

  • Open a terminal window and navigate to the folder on your desktop, you should see the following content (azcopy and global-context-websiteinteractions.csv), for example on OSX:

dlz-unzip-azcopy.png

1.2.5.2 Connect Data Landing Zone to ÃÛ¶¹ÊÓÆµ Experience Platform

Log in to ÃÛ¶¹ÊÓÆµ Experience Platform by going to this URL: .

After logging in, you’ll land on the homepage of ÃÛ¶¹ÊÓÆµ Experience Platform.

Data Ingestion

Before you continue, you need to select a sandbox. The sandbox to select is named --aepSandboxName--. After selecting the appropriate sandbox, you’ll see the screen change and now you’re in your dedicated sandbox.

Data Ingestion

In the left menu, go to Sources. In the Sources catalog, search for data landing.

Data Ingestion

Click the Data Landing Zone card, you’ll see the credentials on the right tab.

dlz-view-credentials.png

Click the icon as indicated to copy the SASUri.

dlz-copy-sas-uri.png

Copy your csv-file to your AEP data landing zone

You’ll now ingest data into ÃÛ¶¹ÊÓÆµ Experience Platform using Azure command line tools using AZCopy.

Open a terminal at the location of you azcopy install location and execute the following command to copy a file into AEP’s data landing zone:

./azcopy copy <your-local-file> <your SASUri>

Make sure to surround your SASUri with double quotes. Replace <your-local-file> by the path to your local copy of the file global-context-websiteinteractions.csv in the azcopy directory, and replace <your SASUri> by the SASUri value which you copied from the ÃÛ¶¹ÊÓÆµ Experience Platform UI. Your command should look like this:

./azcopy copy global-context-websiteinteractions.csv "https://sndbxdtlnd2bimpjpzo14hp6.blob.core.windows.net/dlz-user-container?sv=2020-04-08&si=dlz-xxxxxxx-9843-4973-ae52-xxxxxxxx&sr=c&sp=racwdlm&sig=DN3kdhKzard%2BQwKASKg67Zxxxxxxxxxxxxxxxx"

After executing the above command in your terminal, you’ll see this:

dlz-exec-copy-command.png

Lookup your file in your Data Landing Zone

Go to your Data Landing Zone in ÃÛ¶¹ÊÓÆµ Experience Platform.

Select Sources, search for data landing and click the Setup button.

dlz-inspect-datalanding-zone.png

This will open the Data Landing Zone. You’ll see the file that you just uploaded in the data landing zone’s select data panel.

dlz-datalanding-zone-open.png

Process your file

Select your file and select Delimited as data format. You’ll then see a preview of your data. Click Next.

dlz-datalanding-select-file.png

You can now start mapping the uploaded data to match the XDM schema of your dataset.

Select Existing dataset and select the dataset Demo System - Event Dataset for Website (Global v1.1). Click Next.

dlz-target-dataset.png

Now you are ready map the incoming source data from your csv file to the target fields from the dataset’s XDM schema.

dlz-start-mapping.png

NOTE
Don’t mind the potential errors with the mapping. You’ll correct the mapping in the next step.

Map fields

First of all, click the Clear all mappings button. You can then start with a clean mapping.

dlz-clear-mappings.png

Next, click New field type and then select Add new field.

dlz-clear-mappings.png

To map the ecid source field, select the field identities.ecid and click Select.

dlz-map-identity.png

Next, click Map target field.

dlz-map-select-target-field.png

Select the field --aepTenantId--.identification.core.ecid in the schema structure.

dlz-map-target-field.png

You need to map a couple of other fields, click + New field type followed by Add new field and add fields for this mapping

source
target
resource.info.pagename
web.webPageDetails.name
timestamp
timestamp
timestamp
_id

dlz-add-other-mapping.png

When finished your screen should look like, the screen below. Click Next.

dlz-mapping-result.png

Click Next.

dlz-default-scheduling.png

Click Finish.

dlz-import-finish.png

Monitor dataflow

To monitor you dataflow, go to Sources, Dataflows and click on your dataflow:

dlz-monitor-dataflow.png

Loading the data can take a couple of minutes, when succesful, you’ll see a status of Success:

dlz-monitor-dataflow-result.png

Next Step: Summary and benefits

Go Back to Module 1.2

Go Back to All Modules

recommendation-more-help
aeafc5b5-cd01-4e88-8d47-d76c18d7d349