Data Availability Status

Retrieving updates for ledgerized and normalized source data ingestion status.

BridgeFT’s WealthTech Platform receives and processes data from data feeds overnight, delayed by a day. We receive data drops Tuesday through Saturday and begin processing it when it’s made available by the source.

BridgeFT provides both Ledgerized Data and Normalized Source Data. Each has its availability tracked separately.

Ledgerized Data Status

The status of BridgeFT's daily ledgerized data ingestions can be found at https://atlas.bridgeft.com/status.

The status page outlines each data feed ingestion status, the start and end time, as well as the duration of each stage of the ledgerization ingestion process.

Source Data Status

Upon arrival, new data will be normalized into models called "Source Data". This includes Lots, Positions, Balances,
and Realized Gain Loss.

Users can use the BridgeFT WealthTech API to get a live status of source data normalization for each custodian data
source.

Fetching the Status

Documentation for the Source Data Status endpoint can be found here:
https://docs.bridgeft.com/reference/getsourcedatastatus

Simply POST to https://api.bridgeft.com/v2/status/source-data with a given market date.
For example, here is a curl command that would return the source data normalization status for data with the reported date 2006-01-02.

curl --request POST \
     --url https://api.bridgeft.com/v2/status/source-data \
     --header 'accept: application/json' \
     --header 'content-type: application/json' \
     --data '
{
  "as_of_date": "2006-01-02"
}

Note: source data status reporting is only live as of 2023-05-26. Attempting to get status for any date prior will return an empty response.

Understanding the Response

Source Identification

Each relevant accessible source will be included in the response as a top level key. An accessible source is any
source that delivers data for at least one account accessible to the user.

In the below example, the only accessible sources are Fidelity Investments - ("NFS") and Charles Schwab ("SWB").

The available custodian source options are enumerated as follows:

  • APX: Apex Fintech Solutions
  • DST: DST Systems
  • EGB: Eaglebrook Advisors
  • FPR: Fidelity 401k
  • IBK: Interactive Brokers
  • MLT: Millennium Trust Company
  • NFS: Fidelity Investments
  • PER: Pershing
  • SWB: Charles Schwab
  • TDA: TD Ameritrade

Data Type Availability

In either case, we break down the source's data availability by data type. As described above, there are four distinct
types of source data:

  • Lots: lots
  • Positions: positions
  • Balances: balances
  • Realized Gain Loss: realized_gain_losses

Note that not every source delivers all of these types of data. Positions and Balances are guaranteed whereas the
existence of lot and realized gain loss data is source dependent.

Each data type includes a boolean field "available" which will denote whether all accessible feed codes for that data
type are fully normalized and ready to access.

Example Response

{
  "object": "status.source_data",
  "NFS": {
    "lots": {
      "available": true
    },
    "positions": {
      "available": true
    },
    "realized_gain_losses": {
      "available": true
    },
    "balances": {
      "available": true
    }
  },
  "SWB": {
    "lots": {
      "available": false
    },
    "positions": {
      "available": true
    },
    "realized_gain_losses": {
      "available": false
    },
    "balances": {
      "available": false
    }
  }
}

RSS Feed

In addition to the above, BridgeFT also publishes RSS Feeds to notify consumers in real-time as custodian source data is received and data has been normalized/ledgerized. We update the RSS feed as new custodian data is received and processed. There may be multiple data drops for a single day's data per custodian, therefore multiple notifications per custodian a day will appear in a day.

The general BridgeFT ingestion notification feed can be found at https://api.bridgeft.com/v2/status/rss. This feed simply reports when data has been received and processed.

Alternatively, BridgeFT Wealthtech API consumer's can use their application's client_id to view a tailored ingestion status feed with high level information about the custodian data that has been provided and normalized.

An application specific ingestion status feed can be found by providing your application's client_id to the following URL: https://api.bridgeft.com/v2/status/<YOUR_CLIENT_ID>.

Subscribing to the RSS Feed

There are a variety of tools to subscribe to RSS feeds. BridgeFT recommends for organizations using Slack, to use the /rss command in a dedicated Slack channel. You can subscribe to an RSS feed in any Slack channel by simply using the command /rss {YOUR_RSS_FEED_URL}. The Slack channel will then automatically report new updates to the feed, notifying your organization when data has been normalized.

Future Notifications

As BridgeFT expands the Developer Platform, more types of notifications will be coming online. Developers can expect notifications for ingestion starts, completions, errors, as well as a final digest indicating that all data for a custodian has been reported and is ready to be consumed. Additional notification avenues like email and webhooks are on the horizon as well.

Updated 5 days ago