Import Events from Databricks to Netcore

Import Databricks event data to power targeted campaigns and journeys in Netcore CE.

Overview

An Events import moves event records, such as Add To Cart, from a Databricks table or view into Netcore CE. You choose the Databricks connection, catalog, schema, and table. You select the event, its source, and the app. You map the identity columns. You then run the import once or on a recurring schedule.

ItemDetail
SourceDatabricks
DestinationNetcore CE, as event records for your contacts
Location in Netcore CESettings > Data transfer > Import
Required identity mappingEMAIL (Primary key) and Event time
Attributes mappingNo. Events has Identity mapping only.
Schedule optionsOne-time or Recurring
Multiple event types in one tableSupported. Select the column that contains the event name.

Pre-requisites

  • An active Databricks connection of type Import in Netcore CE. See Databricks.
  • Read access to the Databricks catalog, schema, and table or view that holds your events.
  • At least one email address to receive import alerts.
  • The event name, the event source, and the app name that the imported events belong to.

Refer to this document to learn the steps to start an Events Import.

Step 1: Setup

The Import details section asks for the basic details of your import.

Field nameDescription
Import titleA unique name for this import. Up to 80 characters.
ConnectionSelect an existing Databricks connection that you created under Integrations.
PathSelect the path for the import. This field stays disabled until you select a connection.
CatalogSelect the Databricks catalog to import from.
SchemaSelect the schema within the selected catalog.
TableSelect the table or view to import events from.
EventSelect the event that the imported rows represent, for example Add To Cart.
Source of eventSelect where the event comes from, for example App.
App nameSelect the app that the event belongs to.
Alert emailRequired. Select the email addresses that receive alerts about this import.

Databricks Event Import

Each field after Connection stays disabled until you complete the field above it. A Contacts import does not have the Event, Source of event, and App name fields.

After you select a table, click PREVIEW to see a few sample records. Then click NEXT. Netcore CE saves your setup details.

Import a Table That Contains Multiple Events

After you select a table, the Table contains multiple events checkbox appears. Select it when a single Databricks table stores more than one event type. An information icon next to the checkbox shows this hint: "Use this when a single table stores multiple event types. Select the column that contains the event name."

  1. Select the Table contains multiple events checkbox. A Column name dropdown appears.
  2. In the Column name dropdown, select the column that contains the event name. The placeholder reads "Select column name containing event."
FieldDescription
Table contains multiple eventsA checkbox. Select it when one table stores multiple event types.
Column nameRequired when you select the checkbox. Select the column that contains the event name.

If you select the checkbox and leave Column name empty, Netcore CE outlines the dropdown in red and shows the error "Column name is required." Select a column to continue.

Import a Table That Contains Multiple Events

After you complete the Setup fields, click NEXT.

Step 2: Data Mapping

An Events import has Identity mapping only. Netcore CE does not show attribute mapping for events.

Netcore attributeRequirement
EMAIL (Primary key)Required. Map it to the Databricks column that identifies the contact who performed the event, for example contact_email.
Event timeRequired. Map it to the Databricks column that stores when the event happened, for example event_time.

When you map Event time, a date time format dropdown appears. Select the format that matches the values in your column.
The available formats include YYYY-MM-DD, YYYY/MM/DD, DD/MM/YYYY, DD-MM-YYYY, DD-MM-YYYY hh:mm:ss, YYYY-MM-dd HH:mm:ss.SSS XX, and yyyy-MM-dd'T'HH:mm:ssXXX.

Click NEXT to move to Schedule.

Step 3: Schedule

The page shows your account timezone and the current date and time. Select one of two options:

OptionBehaviorFields
One-timeNetcore CE transfers the complete dataset once. It performs no incremental transfer.Scheduled at
RecurringThe first run transfers the complete dataset. Later runs transfer incremental data.Start date time, End date time, Frequency (for example Every hour or Weekly)

Related Pages


Did this page help you?