Skip to main content

csv

This output mapper extension allows you to convert stream worker events processed by the GDN stream processor to CSV message before publishing them. You can either use custom placeholder to map a custom CSV message or use predefined CSV format where event conversion takes place without extra configurations.

Syntax

CREATE SINK <NAME> WITH (map.type="csv", map.delimiter="<STRING>", map.header="<BOOL>", map.event.grouping.enabled="<BOOL>")

Query Parameters

NameDescriptionDefault ValuePossible Data TypesOptionalDynamic
delimiterThis parameter used to separate the output CSV data, when converting a Stream App event to CSV format,,STRINGYesNo
headerThis parameter specifies whether the CSV messages will be generated with header or not. If this parameter is set to true, message will be generated with headerfalseBOOLYesNo
event.grouping.enabledIf this parameter is set to true, events are grouped via a line.separator when multiple events are received. It is required to specify a value for the System.lineSeparator() when the value for this parameter is true.falseBOOLYesNo

Example 1

CREATE SINK BarStream WITH (type='stream', topic='{{symbol}}', map.type='csv') (symbol string, price float, volume long);

Above configuration will perform a default CSV output mapping, which will generate output: symbol-price-volumegdn-55.6-100

If header is true and delimiter is "-", then the output will be: symbol-price-volume

Example 2

CREATE SINK BarStream WITH (type='stream', topic='{{symbol}}', map.type='csv', map.header='true', map.delimiter='-', map.payload="symbol='0',price='2',volume='1'") (symbol string, price float,volume long);

Above configuration will perform a custom CSV mapping. Here, user can add custom place order in the @payload. The place order indicates that where the attribute name's value will be appear in the output message, the output will be produce output as follows: gdn,100,55.6.

If header is true and delimiter is "-", then the output will be: price-volume-symbol 55.6-100-gdn

If event grouping is enabled, then the output is: price-volume-symbol 55.6-100-gdnSystem.lineSeparator() 55.6-100-IBMSystem.lineSeparator() 55.6-100-IFSSystem.lineSeparator()