Publishing Microservices into Google Kubernetes Engine (GKE)
I’ll cover here the Google Cloud configuration that I made to run my project as cheap as possible.
5 min read
Originally published at renanfranca.github.io
I will show you how to publish the Mamazinha Baby Care Web App - Open Source Project on Google Kubernetes Engine (GKE)
Before we start
I used JHipster to build the web app, everything you need to know about how to generate the Kubernetes (k8s) yml files to publish on GKE is detailed step by step in this tutorial (I strongly recommend watching the video first before getting your hand dirty 😁) created by @mraible
Publishing on GKE
I open source the yaml files that i used to publish on GKE:
I’ll cover here the Google Cloud configuration that I made to run my project as cheap as possible. My goal is to keep the cost below or near the Always Free tiers:
The GKE free tier provides $74.40 in monthly credits per billing account that are applied to zonal and Autopilot clusters. If you only use a single Zonal or Autopilot cluster, this credit will at least cover the complete cost of that cluster each month. Unused free tier credits are not rolled over, and cannot be applied to any other SKUs (for example, they cannot be applied to compute charges, or the cluster fee for Regional clusters).
So I made this pricing simulation (I choose São Paulo as my Region because I am from Brazil):
After logging in at Google Cloud Console, Let’s create the Cluster Zone and the first Node Pool
Open GKE Standar Option
Choose those options. Only edit the cluster name and the cluster zone (choose the nearest zone from your location or your client location)
You will end up with something like this
Now you have to connect to your cluster. Install google cloud SDK and install Google kubectl (I'm using windows)
gcloud components install kubectl
On git bash:
- confirm that the installation was successful
wich kubectland the response should be something like
- execute the following command to connect to your cluster, change
mamazinhato your cluster name and change
southamerica-east1-ato your zone
gcloud container clusters get-credentials mamazinha -zone=southamerica-east1-a
You can now publish the yml files to GKE:
- clone the repository
git clone firstname.lastname@example.org:renanfranca/mamazinha-k8s.git
- Switch to google-cloud branch
git checkout google-cloud
- On git bash go to the root of the cloned project folder and run the command
Install the amazing k9s k9scli.io/topics/install and type the command to connect to your cluster
k9s -n mamazinha
k9s home screen
As you can see only 3 nodes weren't enough for my project, after digging around I discovered the preemptible VM option 😆! The registry/baby microservice both are stateless, so I don't care if after 24h the VM will be destroyed and they will be initialized at another VM.
Let’s create a new node pool with a preemptible VM which costs less than the regular machine type.
Go to Cluster Kubernetes Engine > Clusters > Clique on your cluster > clique on ADD NODE POOL
Only one node number
You must mark the node as preemptible! Then click on CREATE! 🤩
Now we can see 4 nodes and only one preemptible
That’s what happened after 24h! Shutdown the preemptible VM 😜
The cluster is ready! But how to choose the place to deploy each component of my project? The Postgres database can’t be deployed at the preemptible node, because the data will be lost every 24hrs!
The answer is NodeAffinity, let’s take the gateway as an example. I want to always deploy the gateway on the node
- Create a label for the node
kubectl label nodes gke-mamazinha-pool-small-cost-03fa0890-zqn0 app=gateway
- Add this nodeAffinity property to my yml file
replicas: 0and apply the deployment yml to terminate every gateway running instances
kubectl apply -f gateway-k8s/gateway-deployment.yml -n mamazinha
Change back to
replicas: 1and apply again
kubectl apply -f gateway-k8s/gateway-deployment.yml -n mamazinha
Repeat this for the other components if you want to deploy at a specific node.
Here is the real cost of this configuration. I am from Brazil, so the costs are in my country's currency. You can do the conversion by knowing that $1 Dollar was R$5,40 Reais when I capture the print screen from the following billing report.
Mamazinha Google Cloud Project billing report
The preemptible VM cost 80% less than the regular machine, so my goal was to use only preemptible. The only way I figured it out to do this is to create persistent volume on my kubernetes cluster for each Postgres database because after 24h even the Postgres could be shut down without losing data.
First I port-forward the Postgres pods to backup the data using pgAdmin then I defined the persistence volume in the yml file:
The next step was to delete the regular machine-type node pool then I resize the preemptible node pool to have 4 nodes.
After that, I apply both yml files (
kubectl apply -f baby-k8s/baby-postgresql.yml -n mamazinha and
kubectl apply -f gateway-k8s/gateway-postgresql.yml -n mamazinha) and restore the backup using pgAdmin that will be stored at the persistent volume.
With this approach, my web app is going to have downtime every 24hrs. To mitigate that I decided to deploy everything simultaneously so after 24h everything will be shut down and going up in 2 minutes.
All pods running on preemptible nodes at the same time
The final cost
According to Google Pricing, the cluster manager fee will be free.
After using only preemptible nodes the cost was reduced a lot.
Mamazinha billing report after using only preemptible nodes
The invoice from January 2022 was R$844,09 (~$162.14), I don’t think it is too expensive. But I can’t afford this value by myself.
The cost from January 2022
So I couldn't keep the web app online on Google Cloud.
The cost until I shut down the web app
How was my experience with Google Cloud?
Google cloud platform is easy to use and I set things up quickly. I could learn while I was using it, I could undo, destroyed and build easily 😆
I think Google Cloud should have a real free plan for small microservices applications, so the user will pay when the product gain traction and started to be used ☺
Now it's your turn! How was your experience with Google Cloud?
I will enjoy to read your comments 🤗
If you have any question feel free to ask me anything here or Direct Message (DM) me on Twitter @renan_afranca (follow me and I will follow you back to unlock the DM option).
Did you find this article valuable?
Support Renan Franca by becoming a sponsor. Any amount is appreciated!