Flowlets is a new feature introduced in Azure Data Factory and Azure Synapse Analytics that allows users to extract portions of an existing data flow and save them as separate “Flowlet” objects. This feature enables the reuse of implemented logical blocks, making data flow design more efficient and streamlined.

Adding Flowlets as a Source

With Flowlets, you can now add them as a source within the data flow design surface. This means that you can use a Flowlet as the starting point for your data flow, extracting the necessary data from it.

Using Flowlets as a Transformation

Flowlets can also be used as a transformation in the data flow. This allows you to apply specific operations or manipulations to the data within the Flowlet, enhancing its functionality and flexibility.

Creating New Flowlets from Existing Dataflows

If you have an existing data flow and want to create a new Flowlet from it, you can easily do so. By selecting the desired objects within the data flow design surface and choosing the “create a new Flowlet” option, a new Flowlet will be created. This allows you to encapsulate complex logic into reusable components.

Debugging Flowlets

Debugging a Flowlet is slightly different from debugging a regular data flow. Since Flowlets do not have any input data, you need to provide the data manually for testing purposes. This can be done by configuring the debug settings and adding input data manually. Once the Flowlet is debugged successfully, you can preview the output data.

Reusing Flowlets

One of the key advantages of Flowlets is the ability to reuse them multiple times without having to recreate them. This saves time and effort, especially when dealing with complex data flow logic. To use a Flowlet in another data flow, simply add it as a component and configure it accordingly.

Conclusion

Flowlets are a valuable addition to Azure Data Factory and Azure Synapse Analytics, allowing users to reuse complex data flow logic multiple times without the need for duplication. By encapsulating logical blocks into Flowlets, data flow design becomes more efficient and manageable. Although Flowlets are currently in public preview, they are expected to become generally available in the coming months.