Tick History Raw Extraction result does not retrieve all the rows; the manifests are always fine for all jobs, but not all rows are available when I extract the results for the finished jobs.
I am using Python aiohttp package to execute ClientSession.request() method.
Then we parse all lines of json content which we received. The results are consistent between Chrome and my Python application.
Below extraction result; we see only 2 of 4 rows.
Extraction Services Version 15.0.42358 (01a7f7ea050d), Built May 20 2021 18:20:45
User ID: 9028636
Extraction ID: 2000000274338174
Schedule: 0x079ae3f6c06cd2d6 (ID = 0x0000000000000000)
Input List (2 items): (ID = 0x079ae3f6c06cd2d6) Created: 2021-06-24 19:21:56 Last Modified: 2021-06-24 19:21:56
Report Template: _OnD_0x079ae3f6c06cd2d6 (ID = 0x079ae3f6c08cd2d6) Created: 2021-06-24 19:20:53 Last Modified: 2021-06-24 19:20:53
Schedule dispatched via message queue (0x079ae3f6c06cd2d6), Data source identifier (A665CFE4E0C34D93BE691CF39752B49D)
Schedule Time: 2021-06-24 19:20:53
Processing started at 2021-06-24 19:20:53
Processing completed successfully at 2021-06-24 19:21:57
Extraction finished at 2021-06-24 17:21:57 UTC, with servers: tm01n01, TRTH (41.752 secs)
Instrument <RIC,SPXWf252132750.U> expanded to 1 RIC: SPXWf252132750.U.
Instrument <RIC,SPXWc312228500.U> expanded to 1 RIC: SPXWc312228500.U.
Total instruments after instrument expansion = 2
Quota Message: INFO: Tick History Options Quota Count Before Extraction: 9; Instruments Approved for Extraction: 1; Tick History Options Quota Count After Extraction: 9, 0.428571428571429% of Limit; Tick History Options Quota Limit: 2100
Manifest: #RIC,Domain,Start,End,Status,Count
Manifest: SPXWc312228500.U,Market Price,2021-06-23T06:45:44.690108670Z,2021-06-23T10:30:41.362530994Z,Active,2
Manifest: SPXWf252132750.U,Market Price,2021-06-23T06:46:14.906572283Z,2021-06-23T10:31:11.921941834Z,Active,2
19:22:25.007065000 [Info ] [app.refinitiv_client] 6: TX GET https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value
19:22:25.449803000 [Info ] [app.refinitiv_client] all response : {'_body': None,
'_cache': {'headers': <CIMultiDictProxy('Cache-Control': 'no-cache', 'Pragma': 'no-cache', 'Content-Length': '440', 'Content-Type': 'text/plain', 'Content-Encoding': 'gzip', 'Expires': '-1', 'Accept-Ranges': 'bytes', 'Server': 'Microsoft-IIS/10.0', 'BeginRequestTime': '17:22:25.0514990', 'BeginRequestDate': '2021-06-24', 'X-Request-Execution-Correlation-Id': 'CiD/9028636/AAAAAA.079b2cc3246cd44e/RA', 'X-App-Id': 'Custom.RestApi', 'X-App-Version': '15.0.155.64', 'CPUUtilization': '3.048618', 'RequestsPerSec': '0', 'W3WP-PrivateBytes': '1214820', 'Date': 'Thu, 24 Jun 2021 17:22:25 GMT')>,
'url': URL('https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value')},
'_closed': True,
'_connection': None,
'_continue': None,
'_headers': <CIMultiDictProxy('Cache-Control': 'no-cache', 'Pragma': 'no-cache', 'Content-Length': '440', 'Content-Type': 'text/plain', 'Content-Encoding': 'gzip', 'Expires': '-1', 'Accept-Ranges': 'bytes', 'Server': 'Microsoft-IIS/10.0', 'BeginRequestTime': '17:22:25.0514990', 'BeginRequestDate': '2021-06-24', 'X-Request-Execution-Correlation-Id': 'CiD/9028636/AAAAAA.079b2cc3246cd44e/RA', 'X-App-Id': 'Custom.RestApi', 'X-App-Version': '15.0.155.64', 'CPUUtilization': '3.048618', 'RequestsPerSec': '0', 'W3WP-PrivateBytes': '1214820', 'Date': 'Thu, 24 Jun 2021 17:22:25 GMT')>,
'_history': (),
'_loop': <_UnixSelectorEventLoop running=True closed=False debug=False>,
'_protocol': <aiohttp.client_proto.ResponseHandler object at 0x7f0a0d370730>,
'_raw_headers': ((b'Cache-Control', b'no-cache'),
(b'Pragma', b'no-cache'),
(b'Content-Length', b'440'),
(b'Content-Type', b'text/plain'),
(b'Content-Encoding', b'gzip'),
(b'Expires', b'-1'),
(b'Accept-Ranges', b'bytes'),
(b'Server', b'Microsoft-IIS/10.0'),
(b'BeginRequestTime', b'17:22:25.0514990'),
(b'BeginRequestDate', b'2021-06-24'),
(b'X-Request-Execution-Correlation-Id',
b'CiD/9028636/AAAAAA.079b2cc3246cd44e/RA'),
(b'X-App-Id', b'Custom.RestApi'),
(b'X-App-Version', b'15.0.155.64'),
(b'CPUUtilization', b'3.048618'),
(b'RequestsPerSec', b'0'),
(b'W3WP-PrivateBytes', b'1214820'),
(b'Date', b'Thu, 24 Jun 2021 17:22:25 GMT')),
'_real_url': URL('https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value'),
'_request_info': RequestInfo(url=URL('https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value'), method='GET', headers=<CIMultiDictProxy('Host': 'transfer01:10180', 'Authorization': 'Token ', 'Prefer': 'odata.maxpagesize=20000', 'Accept': '*/*', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'Python/3.6 aiohttp/3.7.3')>, real_url=URL('https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value')),
'_session': None,
'_timer': <aiohttp.helpers.TimerContext object at 0x7f0a12a30e10>,
'_traces': [],
'_url': URL('https://transfer01:10180/RestApi/v1/Extractions/RawExtractionResults('0x079ae3f6c06cd2d6')/$value'),
'_writer': None,
'content': <StreamReader 426 bytes eof>,
'cookies': <SimpleCookie: >,
'method': 'GET',
'reason': 'OK',
'status': 200,
'version': HttpVersion(major=1, minor=1)}
19:22:25.450062000 [Info ] [app.refinitiv_client] 6: RX 200 OK
19:22:25.450225000 [Info ] [__main__] raw_template header: b'#RIC,Domain,Date-Time,GMT Offset,Type,MsgClass/FID number,UpdateType/Action,FID Name,FID Value,FID Enum String,PE Code,Template Number,Key/Msg Sequence Number,Number of FIDs\n'
19:22:25.450816000 [Info ] [__main__] raw template row: b'SPXWc312228500.U,,2021-06-23T06:45:44.690108670Z,,FID,64,,OPINT_1,0,'
19:22:25.450909000 [Info ] [__main__] raw template row: b'SPXWc312228500.U,,2021-06-23T10:30:41.362530994Z,,FID,64,,OPINT_1,0,'
@vinod.amarnath