Building on our Data Engineering expertise, today Sakura Sky announces that our ETL Monitoring Dashboard Framework has entered General Availability.
Many organizations struggle with visualizing data pipelines and their status. Our new Framework simplifies monitoring, reporting, and transparency for all business users.
Why have we released this tool:
- Business Users often find it painful to monitor thousands of ETL jobs, from daily, hourly, or even near real time, our Framework provides a status update at a glance.
- A visual ETL Monitoring Framework removes the need to read and interpret logs and cryptic Slack messages and allows for any user to understand where their data pipelines are at.
- Many pipeline monitoring tools in the market today are binary in their reporting, but our Framework can intercept and highlight pipeline problems such as:
- underlying data dictionary changes, such as when a vendor adds new fields to your data sources unexpectedly,
- automated filtering of Slack and email alerts to target specific issues (we can all do without more message spam),
- plus it can inform you of which workloads have failed and which were successful.
The features we announce today includes:
- Automated and configurable notifications in Slack, email, SMS.
- Full end to end pipeline execution status monitoring across Clouds, across data sources, during transit, and at rest.
- Pipeline errors are captured and available to view on a per run basis.
- Configurable pipeline status update intervals.
As a data engineer, it makes my life easier and peaceful to just open this dashboard at any given point in time and see the pipeline execution status in real time. It's especially helpful for engineers who switch multiple projects or work in parallel.
About
Sakura Sky provides cloud, data, and security services to the world’s leading brands.
With innovation at our core, Sakura serves enterprise clients and thousands of other businesses around the world. Our global team provides cloud strategy, implementation and integration support, machine learning and data science, Cybersecurity, and training services.
Sakura Sky is headquartered in San Francisco with a delivery footprint across Asia, North America, Europe, and Australia.
Learn More
Contact us to learn more.
