google cloud data fusion - CDAP PUBSUB Realtime Pipleine MAP Datatype

Question

Im trying to pull through a pubsub subscription using cdap realtime pipeline.

I can connect the pubsub up but the attributes column is coming through as a MAP datatype and I seen unable to do anything with it (I need the data in it).

The idea is to take that message and place it in a database for further processing.

Is there any way to take the MAP data type and convert it to something useful?

question from:https://stackoverflow.com/questions/65602658/cdap-pubsub-realtime-pipleine-map-datatype

Answer 1

You can convert the column using JavaScript transform plugin.

output.attributes = JSON.stringify(output.attributes);

This will convert the map type to a string.