Introduction
Alternatives of Cloudera QuickStart VM
There can be many alternatives possible for Cloudera QuickStart VM. We are highlighting key ones as below:
- SYOC (Spin up Your Own Big Data Cluster)
- Install CDP on Single Node from Scratch
- Use Docker image of Cloudera
You can follow one of the above mentioned paths and work in Big Data development.
BYOC (Bring Your Own Big Data Cluster)
One of the best options is to set up your own Big Data cluster. For doing so, one can create a cluster using Dataproc on Google Cloud Platform(GCP). Here is a video to set up your GCP trial account. GCP provides worth $ 300 free credits. On the Dataproc cluster you will get Spark, HDFS, YARN, Hive, HBase, etc pre-installed. For creating a Dataproc cluster on GCP follow this tutorial.
This is a way better option than conventional Cloudera VM. The advantage of this approach is you can even create a multi-node cluster. The downside of the approach is it doesn’t have all open source technologies pre-installed therefore you need to install those additional explicitly like Confluent Kafka, NiFi, Splunk, etc on top of it. You can visit our DataCouch YouTube channel, over there you will find tutorials for the same.
This option is not having Cloudera Distribution, but definitely you will find some common big data technologies here.
Install CDP on Single Node from Scratch
Secondly, what you can do is that you can install Cloudera Distribution Platform from scratch on any VM Instance. You can use VM Instance on Google Cloud Platform(GCP) and leverage its $ 300 free credits. If you want to know how to set up Cloudera Data Platform(CDP) then you may go through our free Udemy course. It is having a step by step guide to give you exposure how to set up this on GCP. It will also give you a nice user interface to work with the Virtual machine.
Use Docker image of Cloudera
Lastly, you can use the Docker image of Cloudera. Cloudera QuickStart VMs and this Docker image are Single-node deployments of Cloudera distribution including Apache Hadoop, Spark etc. They are ideal environments for learning about Hadoop, trying out new ideas, testing and demoing your application. You can follow this tutorial for doing the same.
Conclusion
As Cloudera stopped releasing QuickStart VM for Big Data developers. There are three viable alternatives for Cloudera QuickStart VM i.e. SYOC(Spin up Your Own Big Data Cluster), Install CDP on Single Node from scratch and Use Docker Image of Cloudera. By choosing one of the above three options, you can easily perform Big Data Development.
