Storage Queue
  • 12 Feb 2024
  • 4 Minutes to read
  • Dark
    Light
  • PDF

Storage Queue

  • Dark
    Light
  • PDF

Article Summary

Introduction

Storage Queue is a service for storing over 80 GB of messages that can be accessed from anywhere in the world via authenticated calls using HTTP or HTTPS.

It provides cloud messaging between application components. In designing applications for scale, application components are often decoupled, so that they can scale independently.

Storage Queue delivers asynchronous messaging for communication between application components.

A single queue message can be up to 64 KB in size, and a queue can contain millions of messages, up to the total capacity limit of a storage account.

image.png

Challenges in processing messages

Azure portal offers limited capability for processing the messages in storage queue like enqueue, dequeue and view the message through the Storage Explorer.

Below are more useful capabilities not addressed in the portal:

  • updating the message content along with its properties

  • resubmitting the messages to the Storage queue

  • downloading the messages

  • uploading messages from a file into the Storage Queue

Users will have to either manually process or use custom code to achieve the above mentioned critical tasks.

That would turn out to be a tedious process, considering there is a high number of Storage queues with each containing a huge number of messages.

Solutions provided by Turbo360

  • Turbo360 now intends to fix the above-mentioned gap in the Azure portal by extending its support to process the messages in Storage Queue.

Retrieve messages from Storage Queue

  • In Turbo360, users can retrieve the messages from Storage Queues in read-only mode. This will not remove the message from the Storage Queue.

  • Each time when a message is retrieved, its dequeue count will get increased by one.

  • Along with the message content, properties of the message can also be viewed

image.png

Update message in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform an update operation on them.

  • In this process, the same message will be updated with the new content and visibility timeout. It should be noted that this will not remove the message from the Storage Queue.

Update message action will not remove the message from the Storage Queue. It will only retain the message with the modified content.

image.png

Resubmit messages in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform a resubmit operation on them.

  • In this process, a new message will be submitted with the same content into the destination Storage Queue.

  • The user is also provided with a list of Storage Queues to which the messages can be resubmitted. This operation can be carried out on one or more messages.

Resubmit action will remove the original messages being resubmitted from the source Storage Queue

image.png

Repair and Resubmit message in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform a repair and resubmit operation on them.

  • In this process, a new message will be submitted with the updated content, visibility timeout and time to live into the destination Storage Queue.

  • The user is also provided with a list of Storage Queues to which the messages can be resubmitted. It should be noted that this will remove the resubmitted message from the source Storage Queue.

Resubmit action will remove the original messages being resubmitted from the source Storage Queue.

image.png

Delete Messages in Storage Queue

  • Once the messages are received from the Storage Queue, users can perform delete operation on them.

  • The delete operation can be carried out on one or more messages.

  • The delete operation can be also be automated in the Automated Tasks section.

turbo360.png

View Properties

  • Users can view the properties of the Storage Queue in the Properties section.

image.png

Execute Queries

  • Customers can now use queries to easily view the log details stored in the Storage table. The query execution process works similarly to that of Cosmos Table. The Log information will be displayed when a specific record is selected.

  • The Saved queries option in the Execute Queries section allows users to access all the saved queries and easily generate query data. Customers can also edit their saved queries and update the favorite query.

  • A Favorite query is one that is available by default in the Execute Queries section. A query can be marked as favorite by editing any one of the saved queries or by saving a query.

Inline task

  • In Storage Queue section, users can create a really quick task to purge messages from the source queue that is being explored.

  • The configuration created to run immediately can also be saved for future use in Automated Tasks section.

Inline task to purge messages

This feature allows users to quickly purge messages from the queue by providing the following inputs:

  • Message count (can be all or a specified number)
  • Message Enqueued At time
  • Configuration name (if Save configuration is enabled)

The following illustration shows purging messages from the storage queue at or before the specified date and time.

image.png

Task status can be viewed by navigating to Automated Tasks section and switching to Task history tab.

  • Users can use this feature to quickly create a task that runs immediately.

  • Navigate to the Automated Tasks section in Turbo360 to create a task with a more detailed configuration, schedule tasks to run at a specific time, or automate the task to run on the specified hours, days, and more.

Automated task

  • Manually processing Storage queue messages in large applications is not a suggested approach as it is a very time consuming process and sometimes requires users to set up a separate application to perform this purging process.

  • The Automated Task feature of Turbo360 makes it possible to overcome all these drawbacks.

The following is the illustration to purge messages from the storage queue using automated task:

image.png

Monitoring

  • Users can monitor their Storage Queue resources by configuring the rules available for monitoring.

  • Navigate to the Monitoring section of the resource to configure the monitoring rules for Storage Queue.

  • Users can specify monitoring threshold values based on their needs.
    image.png


Was this article helpful?