I use the .NET SDK, and followed the extraction example: "Tick History / Request Time and Sales for RICs" available in the API Examples sample application.The suggested way to unpack the results following the sample application is to get the ReadStream:
//Download the results using (var response = ExtractionsContext.RawExtractionResultOperations.GetReadStream(result)) using (var stream = response.Stream) using (var reader = newStreamReader(stream)) { var lineCount = 0; while (!reader.EndOfStream) { Debug.WriteLine(reader.ReadLine()); lineCount++; } }
It appears this method works fine only as long as the data extracted is small. As soon as I try to retrieve a few RICs the response.Stream seems to be truncated. Is that limited? I have run a couple of extractions, and by the Notes in the RawExtractionResults I should have received about 20,000 updates. However when I read the stream extracted like above it always seem to cap it at 5314 lines.
I assume I am hitting a limitation placed on the stream? Can you confirm please? If that is so, could you please:
a) point me to any documentation or sample code comments that states that such limitation exists,
b) point me to the alternative way to retrieve the extracted data.
Many thanks.