Setup MongoDB statefulset on AWS Fargate

-
Hi everyone I am Manshu Sharma and today we will see how can we deploy the mongoDB on AWS fargate as a statefulset with help of the mongoDB community operator but before we start let's have a quick overview of two important terms statefulset, stateful application.

What actually statefulset is in Kubernetes?
StatefulSet is a Kubernetes resource used to manage stateful applications and It manages the scaling, ordering and uniqueness of each pod. It requires headless service and we are responsible for creating this service.

What actually is stateful applications?
Stateful applications are those programs that save client data from the activities of one session for use in the next session. Consider it as an ongoing periodic conversation with the same person. Some examples of stateful applications are MySQL,  MongoDB, FTP server,  Redis Cache, Kafka and any Login service that stores client authentication data on the server, labelling clients as having a “connected” or “disconnected” state. It also stores information about previous requests from the same client.

A diagrammatical representation of Kubernetes statefulset resource.
In the above diagram, we can see that there is one headless service for routing and two statefulset pods with different PVC and PV resources. Each resource has its own different session and has a completely different isolated environment.

Overview completed. Now let's see the setup of the mongoDB application as a statefulset using MongoDB community operator.

Installation
The MongoDB Community Kubernetes Operator allows you to deploy secure MongoDB Replica Sets in your Kubernetes cluster.
  • Before we can deploy MongoDB, we need to ensure that we have created the required CustomResourceDefinition.
    • kubectl apply -f https://raw.githubusercontent.com/mongodb/mongodb-kubernetes-operator/master/config/crd/bases/mongodbcommunity.mongodb.com_mongodbcommunity.yaml
  • Create a namespace for our deployment.
    • kubectl create namespace mongodb
  • Install the latest version of the operator.
    • kubectl apply -f https://raw.githubusercontent.com/mongodb/mongodb-kubernetes-operator/master/config/crd/bases/mongodbcommunity.mongodb.com_mongodbcommunity.yaml
  • Add authorizations.

    • kubectl apply -f https://raw.githubusercontent.com/mongodb/mongodb-kubernetes-operator/master/config/rbac/role_binding.yaml 
    • kubectl apply -f https://raw.githubusercontent.com/mongodb/mongodb-kubernetes-operator/master/config/rbac/service_account.yaml
    • kubectl apply -f https://raw.githubusercontent.com/mongodb/mongodb-kubernetes-operator/master/config/rbac/role.yaml
Congratulation we have successfully set up our mongoDB community operator.
Note: This above operation requires cluster-admin permissions.
    Deploying a SCRAM Enabled Replica Set

    MongoDB community operator creates secure SCRAM-SHA-256 enabled deployments by default. This means that we need to define our users and what roles we want them to have, alongside a set of credentials for the user to use.
    We can create the user's credentials in the form of a Kubernetes Secret
    • kubectl create secret generic my-mongodb-user-password -n mongodb --from-literal="admin-password=TXs3ZsuIqT-pQFvwxOec"
    Once we have created the secret, we can deploy a MongoDB replica set but wait✋ without persistent volumes the data will not be retained permanently and so as fargate supports efs csi driver we are going to use it as our persistent volume support. For this, we going to create two resources multiple times which are persistent volume and persistent volume claim. We also need to install AWS EFS CSI DRIVER in our eks and storage class. Here below is the full code which will deploy storage class, PV and PVC.

    Once we have created our PV and PVC we are now ready to deploy MongoDBCommunity statefulset



    Comments

    Post a Comment

    Please give us your valuable feedback

    Popular posts from this blog

    How to pass parameters in webhook?

    -
    Image
    Hey everyone 😊, Today I want to share another interesting thing which I found in StackOverflow and that is how to pass parameters in webhook. Those who don't know about webhook I advise you to google about it before going further reading.  So for demonstration purpose, I am going to use Jenkins and Generic Webhook plugin . I created a job and called it testing  and select Generic Webhook  Trigger . Thereafter I add Request Parameter   and in the request parameter I added the name of the request which is name Thereafter I added a token to specify that this job can only be triggered. After this, I select Execute Shell from Build  and write the following code  After doing this add webhook URL in bitbucket repository or  GitHub repository with the parameter. The URL is look something like this  Webhook URL:- https://[YOUR_JENKINS_URL]/generic-webhook-trigger/invoke?token=trigger&name=Svastikkka  The configuration will something like this After saving my webhook configuration I
    Read more

    Access and modify all the resources of our Wiki.js using WikiJS API

    -
    Image
    Hi everyone 😎 , Today we are going to see how to access or modify WikiJS resources using WikiJS API. WikiJS exposes GraphQL API to access and modify the stuff according to our requirements. So In this blog post, we going to see  How to set up WikiJS's local environment using docker. How to generate an API token in Wikijs. Using API tokens how to access WikiJS resources and how to modify them. First Local Setup using docker Here I am using docker to set up my local isolated WikiJS environment. Below is my docker-compose.yml file written by WikiJS contributors. To build the WikiJS environment we just need to run the following command  docker-compose up -df  [PATH_OF_DOCKER_COMPOSE_YML_FILE] To check the environment is in a running state run the following command docker ps Second Generate API token After setup our local environment we are ready to create our initial Administrator account in our WikiJS. 1. On the browser type localhost:80 2. Create an Administrator account  Email: loc
    Read more

    Fahrenheit to Celsius

    -
    Level EASY Given three values - Start Fahrenheit Value (S), End Fahrenheit value (E) and Step Size (W), you need to convert all Fahrenheit values from Start to End at the gap of W, into their corresponding Celsius values and print the table. Input Format : 3 integers - S, E and W respectively Output Format : Fahrenheit to Celsius conversion table. One line for every Fahrenheit and corresponding Celsius value. On Fahrenheit value and its corresponding Celsius value should be separate by tab ("\t") Constraints : 0 <= S <= 80 S <= E <= 900 0 <= W <= 40 Sample Input 1: 0 100 20 Sample Output 1: 0 -17 20 -6 40 4 60 15 80 26 100 37 Sample Input 2: 20 119 13 Sample Output 2: 20 -6 33 0 46 7 59 15 72 22 85 29 98 36 111 43 Explanation For Input 2: We need need to start calculating the Celsius values for each of the Fahrenheit Value which starts from 20. So starting from 20 which is the given Fahrenheit start
    Read more