The Lab

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from this space and version 1.5.14

...

EndMarker Messages

For CLOB Priucing Pricing sessions, EndMarkers are sent to the Client in two contexts:

...

SecurityStatus EndMarkers

An On session establishment, an EndMarker message is sent by Whisperer to mark the end of the initial set of SecurityStatus messages sent after the venue session is established. It . This serves as an indication to the Client that the status full list of all available instruments, and their status has been published.

Note
titleAlways Published at Start of Session

The EndMarker message is always published on session establishment for CLOB MarketData feeds. Where venues do not provide any  initial SecurityStatus info, we will publish the EndMarker immediately.

The EndMarker message may thus be used by the Client as a reliable "ready" signal to initiate market data subscriptions.


Note
titleNot Published Intra-Day
EndMarker messages are not utilised for intra-day SecurityStatus updates, (e.g. for ValueDateRoll),  clients are expected to respond to these as soon as they are published.

MarketDataIncrementalRefresh EndMarkers

...

Info
titlePerformance considerations

For Change events, the following principles apply:

  • If the venue also delivers unchanged fields in addition to those that trigger the update, these will also be supplied.
  • In the typical case where the venue only delivers the modified fields, Whisperer does not re-populate the previously published fields.

...

  1. Process the individual updates contained within the market data message.
  2. Collect the orders by price level. This is redundant for a PriceDepth book, which is already aggregated.
  3. Sort prices for each side of the book best to worst. I.e.  The Client always sorts the book by price for each side (not MDEntryID).
  4. For each price level at or above the subscribed MDBookDepth, sort MDEntryIDs smallest (oldest) > largest (newest). Again, this is redundant for a PriceDepth book, which is already aggregated. I.e.  the MDEntryID is a secondary key for OrderDepth books, to sort multiple orders at a give price level.
Info

The presence of any entries outside the subscribed MDBookDepth is unintended behaviour.

Book Integrity

...

  • Whisperer ensures that books will never exceed any specific requested depth - when  when implicit deletes are detected, the explicit Delete MDEntry is placed before the New that triggers it.
  • Two MDEntries in a PriceDepth book may momentarily have the same price - this typically occurs when multiple MDEntries on one side of the book change their prices up or down, such that the first MDEntry moves to a price level occupied by a different MDEntry that has yet to have it's price modified.

...

As well as the EndMarker behaviour outlined above, the client needs to be aware of the following unique attributes of UDP Market Data feeds:

  • Line Arbitrage - the MDSubFeedType specifies the UDP market data source for venues which utilise A/B circuits.
  • Gap Detection - in the event that a UDP message gap occurs, this is reported to the Client User immediately it is detected for each affected subscription, via the publication of a EmptyBook MarketDatIncrementalRefresh message with MDFlags.IsSnapshot and MDFlags.GapDetected both set to TRUE.
  • Gap Recovery - the gap will be resolved by the Gateway utilising the venue's standard Late-joiner logic, and the next message will be a fresh Snapshot (typically, but not always, representing the full book.

Orders

The Orders workflow is always normalised and consistently implements the state transition model as outlined in the diagram below. Where Venue events are absent, synthetic equivalents are generated by Whisperer in their place. These messages are easily discernible by reference to the TradingFlags.IsSynthetic field.

Info
titleExecutionAck
It's worth remembering that while  all inbound messages will adhere to the same state transition model, there will necessarily be Venue-specific variation in whether and how outbound ExecutionAck messages are handled.

Order State Transition Diagram

...

  • ). Thereafter Incrementals will be published as normal.

Orders

...

Order Submission and Modification

...