The Lab

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 74 Next »

This page sets out the key aspects of establishing and managing sessions between a Whisperer Enterprise Client and a Feed Handler. In addition details are provided setting out how to initiate or terminate connectivity to the target Venue.

Overview

Terminology

  • Customer - The organisation utilizing MarketFactory's systems.
  • Client - The software component(s) maintained by the Customer that are used to communicate with Venues via Whisperer
  • User - A logical entity defined by the Customer and configured by MarketFactory, used to associate a Client Session with a Venue Connection.
  • Venue - External trading system - may be a Maker (e.g. a Bank), a Taker (e.g. an ECN), or a CLOB.
  • Logon Service - Whisperer's security and session administration component.
  • Feed Handler - The Whisperer component responsible for maintaining connectivity with a Venue.
  • Venue Connection - A connection established between the Feed Handler and the Venue and Whisperer. Typically this will be a single FIX session (i.e. a specific Target/SenderCompID pair), but in some cases this may incorporate additional physical connections - for example, a Pricing session for a CLOB may comprise A/B UDP market data feeds in addition to a standard TCP FIX session used for message recovery.
  • Client Session - A connection maintained between  the Feed Handler and a Client User, dedicated to delivering messages between the User and the Venue for a specific Session Type.



Sessions

Session Types

Whisperer Enterprise maintains the following session types:

  • Pricing
    • Delivery of Market Data from a CLOB Venue.
    • ESP mass-quotes from a Maker MFSBE4 Client to a Taker Venue.
    • ESP mass-quotes from a Maker Venue to a Taker Client.
  • Orders
    • Submission and execution of MFSBE4 Client orders against a CLOB Venue.
    • Orders against ESP liquidity (published on a separate Pricing session) from a Taker Venue to a Maker Client.
    • Orders against ESP liquidity (published on a separate Pricing session) from a Taker Client to a Maker Venue.
  • RFS
    • Full RFS/RFQ quotation negotiation life cycle between Maker Client and Taker Venue.
    • Full RFS/RFQ quotation negotiation life cycle between Taker Client and Maker Venue.
  • DropCopy
    • Delivery of post-Trade Straight-Through Processing (STP) trade notifications. Typically this will be restricted to notifications from dedicated Venue API connections only.

For a given Client and given Whisperer Feed Handler deployment, each session type will be assigned unique Venue connection credentials (typically target IP:Port details and associated Target/SenderCompIDs, but potentially additional details such as Username and Password, PKI certs, etc).

Session Architecture


Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: SessionArchitecture

24x5.5 Availability

All session types are maintained directly with an individual Whisperer Feed Handler. All Feed Handlers are available 24 x 5.5 - the full trading week commencing on Sunday prior to Asia-open and ending on Friday, NY-close, irrespective of the schedule of the Venue itself.

Message Header

In addition to the default SBE message header fields (blockLength, templateId, schemaId and version), the MFSBE4 header additionally defines the mandatory population of the following fields:

  • messageLength - this is provided to allow verification that the full message has indeed been received (e.g. should it span multiple packets).
  • sendingTime - nanosecond-precision timestamp indicating when the message left the sender.
  • msgSeqNum - this is the standard integer message sequence number. When first establishing a connection at the start of a trading week, it should be set to '1', and incremented with every subsequent message sent for the remainder of the trading week.


msgSeqNum

This field should never be reset intra-week, for any session type.

If the Client should disconnect from Whisperer during the trading week, it must continue the message sequence when re-establishing the session.

Client Session Management

Logon

Authentication & Authorization

When the Client requires a new session with a Venue, it must first establish a TCP socket connection with the  Whisperer Logon Service on a single, standard IP address and port - no matter the User, Session type, or Venue. Once connected, it must then send a Logon message specifying the desired session.

The Logon Service is responsible for the following functions:

  • Authentication - validation of the provided Username and associated Password.
  • Authorisation - verification that the User is permissioned for the specified SessionType and Venuename.


Should either of these checks fail,  the Logon Service will terminate the connection without a Logout message.

In this event, the Customer should contact MF Support in order to confirm the validity of the specified credentials.


Otherwise the Logon Service will hand off the connection to the target Feed Handler. From this point on, the Client is communicating directly with the Feed Handler itself,  neither the LogonService, nor any other processes are involved.

Message Persistence

All Whisperer Enterprise messages are exchanged over TCP, with connectivity maintained directly between the Client and FH - so message delivery and ordering are both guaranteed, whilst the socket connection is operating correctly.

A message is deemed to have been sent, and received, successfully when:

  • The send completes successfully, and
  • The TCP session remains up for a period subsequent to the send.


Previously Sent Messages

The MF FH guarantees persistence of sent outbound messages for possible resend for a minimum period of three heartbeat intervals, allowing for detection of dead connections as per Whisperer Enterprise - Session Management, below.

Unsent Messages

Any unsent messages will be persisted indefinitely until either:


The table below specifies what messages are to be persisted and resent when necessary, as opposed to being gap-filled:


MessageSent ByReceived ByPersisted
LogonClient (Both)Feed HandlerNo
LogonResponseFeed HandlerClient (Both)No
LogoutClient (Both)Feed HandlerNo
LogoutResponseFeed HandlerClient (Both)No
SequenceResetGapFillClient (Both)Feed HandlerNo
Feed HandlerClient (Both)No
HeartbeatClient (Both)Feed HandlerNo
Feed HandlerClient (Both)No
TestRequestClient (Both)Feed HandlerNo
Feed HandlerClient (Both)No
SecurityStatusFeed HandlerClient (TAKER)No
UserRequestClient (Both)Feed HandlerNo
UserNotificationFeed HandlerClient (Both)No
ErrorReportFeed HandlerClient (Both)Yes
MarketDataRequestClient (Both)Feed HandlerNo
MarketDataRequestRejectFeed HandlerClient (Both)No
MarketDataIncrementalRefreshFeed HandlerClient (Both)No
QuoteRequestClient (TAKER)Feed HandlerOptional
Feed HandlerClient (MAKER)Yes
QuoteClient (MAKER)Feed HandlerNo
Feed HandlerClient (TAKER)No
MassQuoteClient (MAKER)Feed HandlerNo
Feed HandlerClient (TAKER)No
QuoteResponseClient (MAKER)Feed HandlerOptional
Feed HandlerClient (TAKER)Yes
Client (TAKER)Feed HandlerOptional
Feed HandlerClient (MAKER)Yes
NewOrderMultilegClient (Both)Feed HandlerOptional
Feed HandlerClient (MAKER)Yes
OrderCancelReplaceRequestClient (Both)Feed HandlerOptional
OrderCancelRequestClient (Both)Feed HandlerOptional
OrderCancelRejectFeed HandlerClient (Both)Yes
OrderTimeoutFeed HandlerClient (Both)Yes
ExecutionReportClient (MAKER)Feed HandlerYes
Feed HandlerClient (TAKER)Yes
ExecutionAckClient (TAKER)Feed HandlerOptional
Feed HandlerClient (MAKER)Yes


It will be noted that that all  messages that represent stateful events are persisted and resent by the MF FH - but only these. It is the responsibility of the Client application to determine the appropriate response.

For sequence gaps identified on the outbound Client Session, it is entirely the responsibility of the Client application to determine which message types are to be persisted for possible resend. This is typically most important for Maker clients accepting or rejecting orders against Taker Venues, but other scenarios may need to be considered.

User Session Synchronisation

Whisperer Enterprise utilises the 'new' model of session synchronisation introduced in FIX 4.4. This ensures that each side can expect any sequence number gaps to be filled automatically, eliminating the need for ResendRequest messages - and the problems that historically accompany these.


The MFAPI Client initiates a new session with a Logon message - populating NextExpectedMsgSeqNum which contains the next msgSeqNum value that the Client expects to receive from the Whisperer Feed Handler. 

The Whisperer Feed Handler validates the sequence number value as expected by the MFAPI Client as follows:

  • If the Client is expecting a sequence number higher than the FH's next-to-be-assigned msgSeqNum, then this is an unrecoverable error and the FH will abort the session with a Logout message (using it's next sequence number).

    The Customer should contact MF Support to agree the correct resolution actions.
  • Otherwise, the FH will issue a LogonResponse message - populating NextExpectedMsgSeqNum which contains the next msgSeqNum value that it expects to receive from the Client.
  • If the Client is expecting a sequence number lower than the FH's next-to-be-assigned msgSeqNum (as used in the preceding Logon response), then the message gap is resolved by the FH with SequenceResetGapFill messages and/or the resending of persisted messages as necessary. The preceding LogonResponse will be gap-filled over.

    Should a Client specify a next-expected inbound sequence number too low (e.g. expecting '1' on re-logon just prior to weekly trading session close), then the FH will service most of the range to correct with a SequenceResetGapFill. For the more recent messages that are still persisted, these will be processed as normal.

    The FH will not resend a week's worth of persisted messages. Refer to Whisperer Enterprise - Session Management above for more detail.

     Resent messages are characterised by: 

    • Msg.messageHeader.msgSeqNum populated with the original sequence number
    • Msg.messageHeader.sendingTime populated with the resend time
    • Msg.TradingFlags.PossDupFlag = TRUE
    • Msg.OrigSendingTime populated with Msg.messageHeader.sendingTime of original message


  • The Whisperer Feed Handler signals it's completion of session synchronisation with a TestRequest. 

    Any new (i.e. not SequenceResetGapFill or resent) messages sent by the MFAPI Client prior to the required Heartbeat response will result in ErrorReport messages.

  • After any inbound sequence number gaps have been resolved for the MFAPI Client , the Client then reciprocates in a similar manner, based on the the next msgSeqNum value that the Whisperer Feed Handler expects to receive from the Client - as specified in it's LogonResponse. The Whisperer Client signals it's completion of session synchronisation with a TestRequest.


The mutual exchange of TestRequest and Heartbeat (response) messages are required as verification that no sequence number gaps remain.

The MFAPI Client should only proceed with new messages after it has received the Heartbeat sent in response to it's own TestRequest.


Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: Logon 4.0 Sequence_3


Diagrams with the same name were found on the following pages:


Erroneous Scenarios

Second Logon to Existing Session

Any attempt by the Client to send a Logon message on an existing session that it established previously will result in the session being aborted.

Second Session for User/SessionType/Venue

Should the Client attempt to establish a second  (additional) session using the same credentials as of a currently-active Client session, then it will be rejected. The original session will be unaffected.



 

Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: 4.0 Schema_2ndLogon


Diagrams with the same name were found on the following pages:

Session Monitoring

Active sessions are monitored at the application level by each party via Heartbeat and TestRequest messages. Indications of problems must result in the monitoring party aborting the session.


MaxTx

For inbound Heartbeat and TestRequest messages sent by the Client , the FH will allow a fixed maximum allowed message transmission time (MaxTx), currently set to one second, before treating the message as 'missed'. This is used to allow for some degree of hysteresis WRT message delivery latencies.

The Client may specify it's own MaxTx value and logic when monitoring inbound messages sent by the FH.

In both cases only the local clock is used as reference.


Heartbeats

Once the Client has successfully established a session with the Whisperer Feed Handler (i.e. on dispatch of the first Heartbeat message in response to the end of synchronisation TestRequest), subsequent Heartbeat messages are sent by each party at the interval specified by the Client in it's Logon message.

Unlike standard FIX sessions, Heartbeat messages must be published as a metronome - no allowance should be made based on whether or not other messages are sent within each interval.
A heartbeat is deemed to have been missed if it is not received within HeartBtInt + MaxTx seconds and must result in the monitoring party issuing a TestRequest.


Metrics

MF plans to utilise the Heartbeat message to periodically publish additional metrics to and from the server/Client :

  • performance metrics
  • additional identification information for human investigators
  • Etc.

This functionality will be made available via a backwardly-compatible schema change.



Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: 4.0 Schema_Heartbeat_3


Diagrams with the same name were found on the following pages:


Test Request

TestRequest messages may be issued by either party and under normal circumstances result in a Heartbeat being sent in response, echoing the specified TestRequestID.


TestRequest messages may be used to obtain an approximate indication of message round-trip times between the MFAPI Client and the Whisperer Feed Handler.

If no Heartbeat response is received within HeartBtInt + MaxTx seconds of the issuance of the TestRequest, then the party must abort the session with a Logout message.


Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: 4.0 Schema_TestRequest


Diagrams with the same name were found on the following pages:



Logout

The recipient of a Logout message must echo it with a LogoutResponse (using it's next sequence number).

  • It is the responsibility of the Logout initiator to terminate the socket connection on receipt of the LogoutResponse.
  • If no LogoutResponse is received within HeartBtInt + MaxTx seconds of the issuance of the Logout, then the session and associated TCP socket connection must be dropped.


All messages received by the Whisperer Feed Handler (from either the Client or the Venue) between the exchange of Logout and LogoutResponse messages will result in ErrorReport messages being sent to the Client.

ErrorReport

The ErrorReport is a custom, user-defined, message used by the Whisperer Feed Handler to notify the Client when erroneous messages are received:

From Client

  • At an invalid lifecycle phase (e.g. QuoteRequest sent before the connection to the Maker Venue is established, or after the Whisperer Feed Handler has disconnected from the Venue).
  • Message is not supported by the Venue (e.g. sending a Quote to a Maker Venue).
  • Message contains invalid data.

From Venue

  • A FIX Reject or BusinessMessageReject message


Since there are scenarios where ErrorReport messages may not be delivered (e.g. during session abort sequences), these messages are persisted and will be delivered on reconnection.


Venue Connection Management

Whisperer is solely responsible for the management and correct handling of Venue-side FIX Session Synchronisation, including the necessary logic relating to End of Day Resets etc.


Venue Logon

Session startup behaviour is standardised across Taker, Maker and CLOB Venue types as follows:

  • The Client first establishes connection to the Feed Handler with Logon & LogonResponse,
  • The Client then instructs the Feed Handler to establish a connection to the Venue via a UserRequest (UserRequestType=LogOnUser) message.
  • The Feed Handler will attempt to establish connectivity to the Venue
  • Once connectivity is established, FIX Session-level messages are exchanged as necessary to  address any synchronisation issues.
  • The Feed Handler then notifies the client of a successful connection via a  UserNotification (UserStatus=LoggedOn) message.
  • Any Client pricing/trading requests sent before this will be rejected by Whisperer via ErrorReport messages.

FIX Session Reset

For those Venues which reset FIX sessions on a weekly basis, no special action is required, as this matches the Feed Handler schedule described above.

For persisted (non-Pricing) session types where Venues reset FIX sessions on a daily basis, the Feed Handler will apply the necessary reset logic for the first successful FIX Session Logon only, at Start of Day. 

For non-persisted Pricing sessions, the Feed Handler will typically reset the session on every FIX Session Logon.

FIX Session Establishment

Once instructed to do so by the Client User, the Feed Handler will attempt to logon to the Venue. Should a connection not be established immediately, it will periodically retry as follows:

  • On a failed logon attempt the Feed Handler will wait RetryInterval seconds (> 0), and repeat.
  • Once MaxAttempts (> 0) failed logons occur in a row, the Feed Handler will
  • wait BackoffInterval seconds (>= 0) and restart the cycle.


This behaviour applies across all Feed Handlers, irrespective of line protocol, Maker/Taker perspective, or trading model.

MarketFactory will apply appropriate values to each of these three properties, based on individual Venue requirements. No Customer involvement is required.


Should the Client User wish to instruct the Feed Handler to cease attempting to connect to the Venue at any time during this cycle, then it may issue a UserRequest (UserRequestType=LogOffUser) message.


Venue Connection - FIX Session Synchronisation

In order to ensure that Venue-side session synchronisation issues are avoided, Whisperer implements the following policy:


Feed Handler Detection of Venue Sequence Number Gaps

If a sequence number gap is detected on receipt of the Venue's logon response, then a ResendRequest will be issued.

Whilst a sequence gap exists, no other Venue messages will be processed until the sequence gap is resolved - via SequenceResetGapFill(s) and message resends, as the Venue deems necessary.

Once the sequence gap is resolved, Whisperer will formally Logout from the Venue and then re-Logon. Standard Logon processing will thus only progress when complete, clean session synchronisation is guaranteed.

As a final verification, the Feed Handler will issue a TestRequest against the Venue; receipt of the Heartbeat response triggers Whisperer to notify the Client of successful session establishment via the UserNotification(UserStatus=LoggedOn).

The Client User must therefore be capable of receiving and processing resent Venue messages relating to it's previous session (marked as PossResend) in the interval between the UserRequest and the UserNotification.


Venue Detection of Feed Handler Sequence Number Gaps

If the sequence number associated with Venue Logon message issued by the Feed Handler indicates a gap, the Venue will typically respond with a Logon response, followed by a ResendRequest.

Whisperer will respond to this via SequenceResetGapFill(s) and/or message resends, as mandated by the Venue. Immediately after resolution of the sequence gap, Whisperer will formally Logout from the Venue and then re-Logon.


Client Session Synchronisation

Any Client User messages that were delivered to the Feed Handler during Client Session synchronisation will be assigned message sequence numbers that follow sequentially from the end of the previous session. delivered to the Venue  immediately on successful completion of the standard FIX Session Synchronisation.

This is not technically a FIX session synchronisation event and whilst the PossDupFlag will be set to mark it as a resend,  the sequence number used will be new.

The Venue may possibly respond with a Reject or BusinessMessageReject, in which case the User will receive an ErrorReport as notification.


Venue Logoff

Venue logoff may be initiated as a result of any of the following:

  • A request from the Client via UserRequest (UserRequestType=LogOffUser).
  • The Venue initiates a Logout (e.g. End of Day).
  • Whisperer detects a dropped connection
  • Whisperer shutdown

In all scenarios, the Client is notified of the event via UserNotification (UserStatus=LoggedOff).


Gliffy Macro Error

Cannot find a diagram with these parameters:

  • Name: 4.0 Schema_Heartbeat.03


Diagrams with the same name were found on the following pages:



TODO

user sends initiates a transaction after after receiving a loggedout user notification


Session Sharing (User Multiplexing)

Multiplexing Guidelines

Whisperer Enterprise requires the configuration of at least one 'User' to be used for a given Session. In general a single User should be associated with a single Venue/Session, although there is some flexibility as set out below. 



Venue Type
SessionTypeCLOBMakerTaker
Pricing

The Client may organise subscriptions across Users as it deems fit.

Venues may reject multiple identical requests, so care should be taken to ensure that there is a clear demarcation of responsibility across Users.

Only the last user to logout from a venue will cause Whisperer to logout from the Venue. It follows then that when multiple users are configured, when logging off prior users, it is the responsibility of the Whisperer Client to ensure that the user session is cleaned up correctly prior to logout.

The Client may organise subscriptions across Users as it deems fit.

Venues may reject multiple identical requests, so care should be taken to ensure that there is a clear demarcation of responsibility across Users.

Only the last user to logout from a venue will cause Whisperer to logout from the Venue. It follows then that when multiple users are configured, when logging off prior users, it is the responsibility of the Whisperer Client to ensure that the user session is cleaned up correctly prior to logout.

A single User must be defined.

This avoids the need for configuration and logic to be maintained within MarketFactory to route each Venue ESP QuoteRequest to specific individual Users.

OrdersThe Whisperer Client may distribute Orders across Users as it deems fit.The Whisperer Client may distribute Orders across Users as it deems fit.

A single User must be defined.

This avoids the need for configuration and logic to be maintained within MarketFactory to route each Venue ESP Order to specific individual Users.

RFS-

The Whisperer Client may distribute RFQ and/or RFS across Users as it deems fit.

A single User must be defined.

This avoids the need for configuration and logic to be maintained within MarketFactory to route each Venue RFS/RFQ QuoteRequest to specific individual Users.

DropCopy

This is a single feed per Venue, delivering trade notifications from the Venue to to the Customer.

A single User is defined.

This avoids the need for configuration and logic to be maintained within MarketFactory to route trade notifications from the Venue to specific individual users.


Logon

TODO

Illustrate Multiplexing - multiple users connecting to Venue. First user triggers logon, last user triggers logout.

A single user connection failure triggers logout, which in turn triggers graceful logout of all other users. Associated order cancellation message may be generated by venue. Whilst most users will receive these during their logout cycle, the failed user will receive these on next session synchronisation.

FIX Session Synchronisation with Multiplexed Users

In the event of a Venue FIX  Session failure, session synchronisation will be triggered when the first Client User reconnects. Specific implications relating to this are discussed below. 

Feed Handler Detection of Venue Sequence Number Gaps

In this case any resent messages will only be forwarded to the Client when the correct Client User finally reconnects. This implies that state should be persisted across Venue Connections.

Venue Detection of Feed Handler Sequence Number Gaps

The first Client User to reconnect will trigger FIX message resends from the Feed Handler to the Venue for all affected Client User Sessions. Any messages sent by the Venue in response will only be forwarded to the Client when the correct Client User finally reconnects. 

Client Session Synchronisation

Any Client User messages delivered during Client Session synchronisation will only be forwarded when that User finally reconnects to the Venue. This may be some considerable period after the FIX session has been established, from the Venues perspective. This scenario is thus subject to the same caveats as outlined above.

  • No labels