Billie's Innovative Use of Apache Airflow and Fivetran for Cost-Effective Warehousing
Technology Category
- Functional Applications - Warehouse Management Systems (WMS)
- Sensors - Airflow Sensors
Applicable Industries
- Buildings
Applicable Functions
- Warehouse & Inventory Management
Use Cases
- Leasing Finance Automation
- Picking, Sorting & Positioning
About The Customer
Billie.io is a fintech startup based in Berlin that is reinventing the way businesses handle payments. Through Billie, Small and Medium Enterprises (SMEs) can get instant financing for each invoice, eliminating the need to wait 90 days to get paid by their customers. Billie.io also outsources the collections process and coverage of default risk, providing a comprehensive financial solution for businesses. The company is built on the speed of its innovation, with a data architecture that is just as innovative as its business model. Since its founding in February 2017, Billie.io has been building an archetype for data-driven businesses to emulate.
The Challenge
Billie.io, a Berlin-based fintech startup, is revolutionizing the way businesses handle payments by providing instant financing for invoices and outsourcing the collections process and default risk coverage. However, the company faced a significant challenge in managing its data architecture. The company needed a solution that could handle the Extract, Load, and Transformation (ELT) process of their production database to the data warehouse efficiently and cost-effectively. The company also needed to avoid latency problems or Service Level Agreement (SLA) issues and prevent transformations from occurring too early. Furthermore, the company wanted to have fine-grain control over when things happen and awareness on tasks that comprise pipelines, their dependencies, and their execution.
The Solution
To address these challenges, Billie.io implemented Apache Airflow, a community-managed platform that allows for complex orchestration and automation of workflows. The platform gave Billie's team fine-grain control over when things happen and awareness on tasks that comprise pipelines, their dependencies, and their execution. The company also used Fivetran to ingest data to Snowflake. The Fivetran connectors were used as-is, but Airflow was essential in the ELT process of their production database to the data warehouse. The company treated each of the steps as 'segments', which could then be dynamically scheduled or managed through Airflow. For example, the Fivetran segment, or 'Extract' and 'Load', could be scheduled and run independently of the transformation layer. This approach allowed the company to avoid latency problems or SLA issues, or even to prevent transformations from occurring too early. Additionally, Billie.io used Airflow and Fivetran’s Operators, Sensors, and Hooks to create complex and valuable workflows for the business.
Operational Impact
Quantitative Benefit
Case Study missing?
Start adding your own!
Register with your work email and create a new case study profile for your business.
Related Case Studies.
Case Study
Energy Saving & Power Monitoring System
Recently a university in Taiwan was experiencing dramatic power usage increases due to its growing number of campus buildings and students. Aiming to analyze their power consumption and increase their power efficiency across 52 buildings, the university wanted to build a power management system utilizing web-based hardware and software. With these goals in mind, they contacted Advantech to help them develop their system and provide them with the means to save energy in the years to come.
Case Study
Intelligent Building Automation System and Energy Saving Solution
One of the most difficult problems facing the world is conserving energy in buildings. However, it is not easy to have a cost-effective solution to reduce energy usage in a building. One solution for saving energy is to implement an intelligent building automation system (BAS) which can be controlled according to its schedule. In Indonesia a large university with a five floor building and 22 classrooms wanted to save the amount of energy being used.
Case Study
Powering Smart Home Automation solutions with IoT for Energy conservation
Many industry leaders that offer Smart Energy Management products & solutions face challenges including:How to build a scalable platform that can automatically scale-up to on-board ‘n’ number of Smart home devicesData security, solution availability, and reliability are the other critical factors to deal withHow to create a robust common IoT platform that handles any kind of smart devicesHow to enable data management capabilities that would help in intelligent decision-making
Case Study
Commercial Building Automation Boosts Energy Efficiency
One of the challenges to building automation is the multitude of non-interoperable communications protocols that have evolved over the years. Buildings have several islands of automation. Bridging the islands of different automation without losing the considerable investment in each specialized control network is the main focus in this solution.
Case Study
Protecting a Stadium from Hazardous Materials Using IoT2cell's Mobility Platform
There was a need for higher security at the AT&T Stadium during the NFL draft. There was a need to ensure that nuclear radiation material was not smuggled inside the stadium. Hazmat materials could often be missed in a standard checkpoint when gaining entry into a stadium.
