top of page
Image by Hunter Harritt

Data Engineering

Transforming Data, Empowering Decisions.

In today's data-driven world, effective data management is crucial for organizations aiming to support advanced analytics and data science initiatives to leverage insights for strategic decision-making.

Our Data Engineering services help structured finance organizations get access to the data they need, when then need it and how they need it.  Our two primary data sources that clients most request are INTEX Data and Bloomberg Data.  We also provide 3rd Party Data Integration and a variety of Data Warehousing solutions.

INTEX Data Solutions

Intex Data Solutions

As Intex Specialists, we provide solutions to meet your specific needs including: INTEX Data solutions, Intex API, pre-built Intex Custom Analytics, or tools to support your own internal analytics to run INTEX cashflows and automate your complex workflows.  

Our INTEX Data Solutions are designed to meet your specific data needs from providing on-prem databases to a fully customized hosted solution.

Our INTEX Data Processes

01

Data Extraction

Working under your INTEX Wrapper license, we extract INTEX data from new CDI/CDU files daily and store it in database. Our INTEX data sets include Deal, Tranche, Collateral Detail, Collateral Stats, Optional Redemption, and Tests/Trigger data. 

02

Custom Calculations & Analysis

Utilizing the extracted INTEX data we can create any number of custom calculations. Other 3rd party data, including your own data like credit views or Manager Rankings can be integrated to the extracted Intex Data to customize and enhance the results. Once we've coded those calculations, percentiles can be calculated for key fields compared to it's cohort and universe.

Some clients analyze the extracted INTEX data to build their own prepay or default curves.

03

Data Refinement and Enhancements

We have internal processes to refine and enhance the data.  As an example, we've created a BSCID to identify all the unique collateral in the CLO universe.  This makes it easier to apply asset level overrides globally to all securities that you run. 

04

Data Science & Visualizations

We excel in presenting vast amounts of complex data in a visually appealing manner through graphs, charts, and reports. Our strategic consulting services leverage the power of Tableau or Power BI to provide new actionable insights and help you make informed decisions to drive business growth.

INTEX Data - Asset Class Coverage

We support all INTEX asset classes in multiple regions including North America, EMEA and APAC

ABS     CLO     CDO     CMBS     CMO

CRE     CRT     HECM     RMBS     TruPS

Bloomberg Data Solutions

As Bloomberg API specialists, we developed a framework to schedule and monitor Bloomberg Data extractions and pause extractions when approaching the daily data hit limits. 

Our Bloomberg Data Solutions are designed to meet your specific data needs and provide comprehensive financial data to power your decisions.



Our support covers 3 key data categories:

01.

Bloomberg
Real-Time Data

Stay ahead of the market with up-to-the-second Bloomberg Real-time financial data.

02.

Bloomberg
Reference Data

Timely and accurate Bloomberg Reference data to power your operational workflows.

03.

Bloomberg
Historical Data

Analyze trends and develop long-term strategies with Bloomberg’s deep historical datasets.

Bloomberg Data - Security Coverage

GOVT (Government Bonds)
CORP (Corporate Bonds)
MTGE (Mortgage Bonds)
M-MKT (Money Market Instruments)
MUNI (Municipal Bonds)

PFD (Preferred Securities)
Equity (Equity)
CMDT (Commodity)
INDEX (Equity and Other Indicies)
CRNCY (Foreign Exchange

Data Vendor
Integrations

In addition our INTEX data and Bloomberg data solutions, we also integrate your licensed 3rd party data through API, FTP or upload. We can also incorporate your own proprietary data such as Manager Rankings or other credit views. 

Below are a few notable data sources requested from clients.

Intex Soloutions Logo
Bloomberg Logo
Excel-Logo
Solve Fixed Income Logo
S&P Global Maret Intelligence Logo
Reuters-Logo.png
Empirasign Logo
IHS Markit Logo
European Datawarehouse Logo

E T L

Clean, structured, and timely data are essential for financial modeling, forecasting, and compliance.  Our team specializes in creating efficient ETL processes that transform raw data into valuable insights. We help you clean, enrich, and organize your data for analysis.

Extract

We extract data from multiple sources such as APIs, CSVs, databases and external partners.
 

Support for structured and unstructured data formats (e.g., Excel, SQL, JSON)

Extractions are done on multiple time-frames including scheduled data deliveries, overnight and real-time data ingestion.

Transform

We will create any number of custom calculations to support your processes and analysis.

 

In addition, we have steps for data cleansing, validation, enrichment, and mapping to financial models.

 

We also address key securitized product finance challenges like standardizing collateral and portfolio aggregation.

Load

We provide efficient delivery into database warehouses, BI tools, or reporting platforms.

We support solutions for client on-premises storage and cloud services like AWS, Azure, Snowflake and Google storage.

Data Warehousing Solutions

We develop and optimize data warehousing solutions that allow for efficient data storage and retrieval, enabling your team to make informed decisions quickly.  We support both cloud and on-premises solutions to meet your needs.

Microsoft-Azure-logo.png
AmazonWebservices_Logo.svg.png

Key Benefits

Automation

Reduce manual effort through scheduled and automated processes.

Historical Data Analysis

Analyze trends over time, facilitate better forecasting and benchmarking

Scalability

Handle complex and growing data volumes with ease.

Accuracy & Compliance

Ensure data quality for regulatory requirements.

Real-Time Data Availability

For timely insights and decision-making.

© 2025 by Black Swan Consulting

bottom of page