As per https://github.com/minio/console/issues/2539 , the websocket behavior integrated as part of Console 0.22.1 (https://github.com/minio/console/pull/2419) seems to break port-forwarding behavior. There's no easy fix for this. NodePorts are a workaround, but slightly kludgy. Ingress is the better long-term solution, but requires more work. This is a stopgap: - For Operator, point users towards NodePorts if port-forwarding fails - For Tenant Console, simply drop port-forwarding entirely and point only at Ingress/LB Out of scope but in progress is Ingress guidance for Nginx and Traefik so we can close the loop on this.
11 KiB
Deploy a MinIO Tenant using the Command Line
The kubectl minio tenant create
command supports creating a
MinIO Tenant in your Kubernetes cluster. The command requires
that the cluster have a functional MinIO Operator installation.
To deploy a tenant from the command line, complete the following steps:
create-tenant-cli-determine-settings-required-options
create-tenant-cli-determine-additional-options
create-tenant-cli-enter-command
create-tenant-cli-record-access-info
create-tenant-cli-access-tenant-console
1) Determine Values for Required Settings
The kubectl minio tenant create
command requires several
configuration settings. Determine the values for all required
settings.
Required Settings
The command requires values for each of the items in this table.
Setting | Description |
---|---|
~kubectl minio tenant create TENANT_NAME |
The name to use for the new tenant. |
|
The total raw storage size for the Tenant across all volumes.
Specify both the total storage size and the For example, 16 Ti for 16 Tebibytes. |
|
The total number of MinIO server pods to deploy in the Tenant. The Operator by default uses pod anti-affinity, such that the Kubernetes cluster must have at least one worker node per MinIO server pod. |
|
The total number of storage volumes (Persistent Volume Claims). The Operator generates an equal number of PVC plus one for supporting logging. The total number of persistent volume claims ( The generated claims have pod selectors so that claims are only made for volumes attached to node running the pod. If the number of volumes exceeds the numnber of persistent volumes
available on the cluster, |
|
Each MinIO tenant requires its own Specify a namespace with the The namespace must already exist in the Kubernetes cluster. Run
|
|
Specify the storage class to use. New MinIO tenants use the The specified MinIO strongly recommends creating a Storage Class that corresponds to locally-attached volumes on the host machines on which the Tenant deploys. This ensures each pod can use locally-attached storage for maximum performance and throughput. |
Example
For example, the following command creates a new tenant with the following settings:
- Name
-
miniotenant
- Capacity
-
16 Tebibytes
- Servers
-
4
- Volumes
-
16
- Namespace
-
minio
- Storage Class
-
warm
kubectl minio tenant create miniotenant \
--capacity 16Ti \
--servers 4 \
--volumes 16 \
--namespace minio \
--storage-class warm
2) Determine Values for Optional Settings
You can further customize your tenant by including any or all of the
following optional flags when running the kubectl minio tenant create
command:
Setting | Description |
---|---|
|
Customize the By default, the Operator uses the release image available at the time
of the Operator's release. To specify a different MinIO version for the
tenant, such as the latest available, use the See the MinIO Quay or the MinIO DockerHub repositories for a list of valid tags. |
|
If using a custom container registry, specify the secret to use
when pulling the Use |
|
Configure a Use the Enabling Server Side Encryption (SSE) also deploys a MinIO For more, see the Github documentation. |
Note
Generate a YAML File for Further Customizations
The MinIO Operator installs a Custom Resource Definition (CRD) to describe tenants. Advanced users can generate a YAML file from the command line and customize the tenant based on the CRD.
Do a dry run of a tenant creation process to generate a YAML file
using the ~kubectl minio tenant create --output
flag.
When using this flag, the operator does not create
the tenant. Modify the generated YAML file as desired, then use
kubectl apply -f <FILE>
to manually create the MinIO
tenant using the file.
3) Run the Command with Required and Optional Settings
At the command line, enter the full command with all Required and any Optional flags.
Consider a tenant we want to create:
- Tenant Name
-
minio1
- Capacity
-
16 Tebibytes
- Servers
-
4
- Volumes
-
16 (four per node)
- Namespace
-
miniotenantspace
- MinIO Image
-
Latest version,
- Key ecnryption file
-
minio-secret
- Storage class
-
warm
kubectl minio tenant create \
minio1 \
--capacity 16Ti \
--servers 4 \
--volumes 16 \
--namespace miniotenantspace \
--image |minio-latest| \
--kes-config minio-kes-secret \
--storage-class warm
4) Record the Access Credentials
When generating the tenant, the MinIO Operator displays the access credentials to use for the tenant.
Important
This is the only time the credentials display. Copy the credentials to a secure location. MinIO does not show these credentials again.
In addition to access credentials, the output shows the service name and service ports to use for accessing the tenant.
5) Access the Tenant's MinIO Console
The MinIO Operator creates services for the MinIO Tenant.
openshift
Use the oc get svc -n TENANT-PROJECT
command to review
the deployed services:
oc get svc -n minio-tenant-1
k8s and not openshift
Use the kubectl get svc -n NAMESPACE
command to review
the deployed services:
kubectl get svc -n minio-tenant-1
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
minio LoadBalancer 10.97.114.60 <pending> 443:30979/TCP 2d3h
minio-tenant-1-console LoadBalancer 10.106.103.247 <pending> 9443:32095/TCP 2d3h
minio-tenant-1-hl ClusterIP None <none> 9000/TCP 2d3h
minio-tenant-1-log-hl-svc ClusterIP None <none> 5432/TCP 2d3h
minio-tenant-1-log-search-api ClusterIP 10.103.5.235 <none> 8080/TCP 2d3h
minio-tenant-1-prometheus-hl-svc ClusterIP None <none> 9090/TCP 7h39m
- The
minio
service corresponds to the MinIO Tenant service. Applications should use this service for performing operations against the MinIO Tenant. - The
*-console
service corresponds to theMinIO Console <console>
. Administrators should use this service for accessing the MinIO Console and performing administrative operations on the MinIO Tenant.
The remaining services support Tenant operations and are not intended for consumption by users or administrators.
By default each service is visible only within the Kubernetes
cluster. Applications deployed inside the cluster can access the
services using the CLUSTER-IP
.
Applications external to the Kubernetes cluster can access the
services using the EXTERNAL-IP
. This value is only
populated for Kubernetes clusters configured for Ingress or a similar
network access service. Kubernetes provides multiple options for
configuring external access to services.
k8s and not openshift
See the Kubernetes documentation on Publishing Services (ServiceTypes) <concepts/services-networking/service/#publishing-services-service-types>
and Ingress <concepts/services-networking/ingress/>
for more complete information on configuring external access to
services.
openshift
See the OpenShift documentation on Route or Ingress <networking/understanding-networking.html#nw-ne-comparing-ingress-route_understanding-networking>
for more complete information on configuring external access to
services.