mercredi 10 février 2021

Is there a design pattern to aggregate asynchronous file processing

A file hits the system. The file contains multiple entities, each of which are processed individually and asynchronously by a multi-node Service Fabric stateless service.

The system needs to know when the final entity processes so the file can be marked as fully completed processing.

For example, a received file contains 150 entities. Each entity is queued in an Azure storage queue and picked up by a stateless service instance and processed. When the final entity processes the file should be marked as "processing complete."

Is there a concrete pattern or an abstract that defines this sort of process? Or perhaps a common design available?

Aucun commentaire:

Enregistrer un commentaire