How to add category to reusable blocks / patterns in WordPress?

I would like to add categories to reusable blocks / patterns without any plugins. My goal is categorise these blocks patterns in modal.

I've tried to create custom taxonomy for wp_block post type but I stuck how to assign them as block pattern category.