Google Drive connector as a destination
The ETL pipeline, to transfer customer data from a Langstack entity to a csv file on Google Drive, is created as follows.
An ETL pipeline named โTestEntitytoGDriveโ is created.

To connect to the data source, the necessary information is added in the Data source section:
The โEntityโ tab is selected.
The โTest_Customers_Entityโ entity is selected from the drop-down menu.

To connect to the data destination, the necessary information is added in the Data destination section:
The โConnectorโ tab is selected.
For this example, โGDrive123โ is selected from the drop-down menu. The connector can be added by selecting a connector from the drop-down menu or a new connector can be created by clicking the [+] button.
To go to the settings, click the โEdit the settingsโ arrow.

To disallow multiple simultaneous runs of the ETL pipeline, the toggle button is left enabled for โskip execution while in progressโ. Enabling this toggle button defines that the execution of this ETL pipeline will be skipped when there is one already in progress.

The default selection for ETL pipeline execution is โImmediateโ.

To align the source fields with destination fields, the settings for the reader and writer format are defined in the โData Formatโ tab. The โReaderโ tab is selected by default. For this example, the fields are added as per the image below.

To update the settings for how the data should be written, select the โWriterโ tab.
The writer stream is โCSV Stream.โ
To add the table name, click on the โEdit the settingsโ arrow.

To add details necessary to write the records, the settings in this section โGoogle drive CSV format details:โ are defined as follows:
In the field โFile path or File URL or Folder path or Folder URLโ the Google drive folder name is entered "GDriveTest".
The โFile nameโ is entered as โcustomersDataโ.
The โCharacterSetโ is selected as โUnicode(UTF-8)โ.
The โLanguageโ is selected as โEnglishโ.
The โStart reading CSV from lineโ is defined as โ1โ.
The โseparatorโ is selected as โCommaโ.

In the โSample dataโ, the column names of the entity are pasted: โCustomer_ID,First,Last,Countryโ.

Once the sample data is added, the writer fields are displayed:
The column names are copied to Field Mapping by clicking โCopy to Field Mappingโ.
Click on "Accept & Collapse" to save the information.

The โWriterโ mode is โAppendโ.
In the Field Mapping section, all the โMapped Fieldsโ are aligned.

When the ETL pipeline is executed (after Save and Publish), the records will be added to the destination.
Last updated