Term Meta values not outputting properly?

I have a Taxonomy Meta field on "Categories" called "Category Color Primary" which is a Color Picker. It has the ID 'category_color_primary'

I'm trying to use this on a Post Single template with Bricks Builder. But I'm getting an empty value.

I have tried the generated Bricks token {mb_category_category_color_primary} and PHP rwmb_meta( 'category_color_primary', [ 'object_type' => 'term' ], get_queried_object_id() ); - Both ouput an empty value.

I suspect it is because the current get_queried_object_id() is the Post ID.

So if the Post has only one category I could use:

rwmb_meta( 'category_color_primary', [ 'object_type' => 'term' ], get_the_category()[0]->term_id);

Ideally, the token {mb_category_category_color_primary} would do this automatically.

So am I on the right track, or am I missing something here?