question

Upvotes
Accepted
3 0 1 1

How to store EMA data ? Any best practice that can be suggested (capturing in elastic search / Hadoop) ?

elektronrefinitiv-realtimeelektron-sdkrrtema-apielektron-message-apidatastream-api
icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 5.0 MiB each and 10.0 MiB total.

1 Answer

Upvotes
Accepted
13k 32 12 18

Hi @ashwathguru.s, If you are interested in storing level 1 data, it comes in the form of a map of key/value pairs; where the keys are Field Identifiers and the values are the data for that field.

For storage, I think best option might be to serialize the OMM message into a JSON object, since it is the format used by Elasticsearch and Hadoop is able to read it as well. If following this approach, ensure that your callback method is not slowed down by field decoding or file I/O operations.

icon clock
10 |1500

Up to 2 attachments (including images) can be used with a maximum of 5.0 MiB each and 10.0 MiB total.

Click below to post an Idea Post Idea