You can use the option "Hide from frontend" to hide a specific field on the frontend. If some users need to have the field, then you will need to create a group for a specific user (you) or user role. Please use the option "Advanced location rules" (MB Include Exclude) in the field group settings.
Refer to the documentation https://docs.metabox.io/extensions/meta-box-include-exclude/
For this, if you create a separate field group with advanced location rules but then embedded those fields into the same form (eg in a php file), under a different field group ID, then would the advanced location rules still apply?