SlideShare a Scribd company logo

Cloudera cluster setup and configuration

Sudheer Kondla
Sudheer Kondla

The document provides steps for setting up a Hadoop cluster using Cloudera Manager, including downloading and running the Cloudera Manager installer, logging into the Cloudera Manager Admin Console, using Cloudera Manager to automate the installation and configuration of CDH, specifying cluster node and repository information, installing software components on cluster nodes, reviewing installation logs, installing parcels, setting up the cluster and roles, configuring databases and clients, and completing the Cloudera cluster installation process.

Data & Analytics
1 of 36
Downloaded 85 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
HADOOP CLUSTER SETUP USING CLOUDERA MANAGER By Sudheer Kondla Solutions Architect
LOGIN TO CLOUDERA MANAGER  Step 1: Download and Run the Cloudera Manager Installer  Step 2: Start the Cloudera Manager Admin Console  Step 3: Use Cloudera Manager for Automated CDH Installation and Configuration  Step 4: Change the Default Administrator Password  Step 5: Test the Installation  For example:  Once you downloaded cloudera-manager-installer.bin run the installation  chmod u+x cloudera-manager-installer.bin  sudo setforce 0  sudo ./cloudera-manager-installer.bin  when completed. Start the service  sudo service clouder-scm-server restart (or manually start Cloudera-manager if it not running)  Optionally add service to start automatically at boot  chkconfig --list | grep –i Cloudera-scm-server  chkconfig clouder-scm-server on  Now access Cloudera http://servername:7180/  Log into Cloudera Manager. The default credentials are: Username: admin Password: admin
LOGIN TO CLOUDERA MANAGER
ENTER LIST OF CLUSTER NODES
SEARCH CLUSTER NODES ON CLOUDERA MANAGER
SPECIFY REPOSITORY INFORMATION CLOUDERA MANAGER
SPECIFY REPOSITORY INFORMATION CONTD..
SPECIFY JDK AND ENCRYPTION OPTIONS
SPECIFY SINGLE OR MULTI-USER MODE
SPECIFY SSH LOGIN CREDENTIALS FOR THE USER
INSTALL SOFTWARE COMPONENTS ON CLUSTER NODES
INSTALL SOFTWARE COMPONENTS ON CLUSTER NODES
INSTALL SOFTWARE COMPONENTS ON CLUSTER NODES – CONTD..
REVIEW INSTALLATION LOGS
CLOUDERA CLUSTER INSTALLATION COMPLETE
CLOUDERA CLUSTER INSTALLATION – INSTALL PARCELS
CLOUDERA CLUSTER INSTALLATION – INSTALL PARCELS
CLOUDERA CLUSTER INSTALLATION – INSTALL PARCELS
CLOUDERA CLUSTER INSTALLATION – INSPECT DEPENDENCIES
CLOUDERA CLUSTER INSTALLATION – CLUSTER SETUP
CLOUDERA CLUSTER INSTALLATION – INSTALLED COMPONENT LIST
CLOUDERA CLUSTER INSTALLATION – COMPONENT LIST
CLOUDERA CLUSTER INSTALLATION – ROLE CUSTOMIZATION
CLOUDERA CLUSTER INSTALLATION – ROLE CUSTOMIZATION
CLOUDERA CLUSTER INSTALLATION – DATABASE SETUP
CLOUDERA CLUSTER INSTALLATION – CONFIGURATION CONTD..
CLOUDERA CLUSTER INSTALLATION – CONFIGURATION CONTD..
CLOUDERA CLUSTER INSTALLATION – CONFIGURATION CONTD..
CLOUDERA CLUSTER INSTALLATION – CLIENT CONFIGURATION
CLOUDERA CLUSTER INSTALLATION – CLIENT CONFIGURATION
CLOUDERA CLUSTER INSTALLATION COMPLETE
CLOUDERA MANAGER CONSOLE
HADOOP COMPONENTS ON CLOUDERA HADOOP CLUSTER
CLOUDERA HADOOP CLUSTER – POST DEPLOYMENT
CLOUDERA HADOOP CLUSTER – POST DEPLOYMENT CONTD
CLOUDERA HADOOP CLUSTER – VSPHERE CONSOLE

More Related Content

Viewers also liked (10)

PPTX
Build your own 4 node virtualized hadoop cluster
Peter Avakian
 
PDF
Ask Bigger Questions with Cloudera and Apache Hadoop - Big Data Day Paris 2013
Publicis Sapient Engineering
 
PDF
Power Hadoop Cluster with AWS Cloud
Edureka!
 
PDF
Cloudera Impala: A modern SQL Query Engine for Hadoop
Cloudera, Inc.
 
PDF
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
iwrigley
 
PDF
Architectural considerations for Hadoop Applications
hadooparchbook
 
PPTX
Hadoop AWS infrastructure cost evaluation
mattlieber
 
PPTX
Gartner Data and Analytics Summit: Bringing Self-Service BI & SQL Analytics ...
Cloudera, Inc.
 
PPT
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
Cloudera, Inc.
 
PDF
Cloudera Impala technical deep dive
huguk
 
Build your own 4 node virtualized hadoop cluster
Peter Avakian
 
Ask Bigger Questions with Cloudera and Apache Hadoop - Big Data Day Paris 2013
Publicis Sapient Engineering
 
Power Hadoop Cluster with AWS Cloud
Edureka!
 
Cloudera Impala: A modern SQL Query Engine for Hadoop
Cloudera, Inc.
 
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
iwrigley
 
Architectural considerations for Hadoop Applications
hadooparchbook
 
Hadoop AWS infrastructure cost evaluation
mattlieber
 
Gartner Data and Analytics Summit: Bringing Self-Service BI & SQL Analytics ...
Cloudera, Inc.
 
The Business Advantage of Hadoop: Lessons from the Field – Cloudera Summer We...
Cloudera, Inc.
 
Cloudera Impala technical deep dive
huguk
 

Similar to Cloudera cluster setup and configuration (20)

PPTX
Hadoop cluster setup by using cloudera manager
Co-graph Inc.
 
PPTX
How to create a secured cloudera cluster
Tiago Simões
 
PDF
Cloudera hadoop installation
Sumitra Pundlik
 
PPTX
Cloudera amazon-ec2
Randy Zwitch
 
PPTX
Instant hadoop of your own
Jack (Yaakov) Bezalel
 
PPTX
Upgrade Without the Headache: Best Practices for Upgrading Hadoop in Production
Cloudera, Inc.
 
PDF
Hadoop installation and Running KMeans Clustering with MapReduce Program on H...
Titus Damaiyanti
 
PDF
Cluster management and automation with cloudera manager
Chris Westin
 
PDF
Hadoop Admin role & Hive Data Warehouse support
mdcdwh
 
PPTX
Distro-independent Hadoop cluster management
DataWorks Summit
 
PDF
Clouldera Implementation Guide for Production Deployments
Ahmed Mekawy
 
PDF
Extending and Automating Cloudera Manager via API
ClouderaUserGroups
 
PDF
Cloudera Hadoop Administrator Content - ReadyNerd
ReadyNerd Computer Academy
 
PDF
Cloudera User Group SF - Cloudera Manager: APIs & Extensibility
ClouderaUserGroups
 
PDF
Technix-Pro Cloudera Certified Admin for Hadoop Exam Prep.
Technix-Pro Systems Consulting Ltd
 
PPT
July 2010 Triangle Hadoop Users Group - Chad Vawter Slides
ryancox
 
PDF
Set up Hadoop Cluster on Amazon EC2
IMC Institute
 
PPTX
Hadoop Operations
Cloudera, Inc.
 
PDF
Cloudera User Group Chicago - Cloudera Manager: APIs & Extensibility
ClouderaUserGroups
 
PDF
Hadoop Operations for Production Systems (Strata NYC)
Kathleen Ting
 
Hadoop cluster setup by using cloudera manager
Co-graph Inc.
 
How to create a secured cloudera cluster
Tiago Simões
 
Cloudera hadoop installation
Sumitra Pundlik
 
Cloudera amazon-ec2
Randy Zwitch
 
Instant hadoop of your own
Jack (Yaakov) Bezalel
 
Upgrade Without the Headache: Best Practices for Upgrading Hadoop in Production
Cloudera, Inc.
 
Hadoop installation and Running KMeans Clustering with MapReduce Program on H...
Titus Damaiyanti
 
Cluster management and automation with cloudera manager
Chris Westin
 
Hadoop Admin role & Hive Data Warehouse support
mdcdwh
 
Distro-independent Hadoop cluster management
DataWorks Summit
 
Clouldera Implementation Guide for Production Deployments
Ahmed Mekawy
 
Extending and Automating Cloudera Manager via API
ClouderaUserGroups
 
Cloudera Hadoop Administrator Content - ReadyNerd
ReadyNerd Computer Academy
 
Cloudera User Group SF - Cloudera Manager: APIs & Extensibility
ClouderaUserGroups
 
Technix-Pro Cloudera Certified Admin for Hadoop Exam Prep.
Technix-Pro Systems Consulting Ltd
 
July 2010 Triangle Hadoop Users Group - Chad Vawter Slides
ryancox
 
Set up Hadoop Cluster on Amazon EC2
IMC Institute
 
Hadoop Operations
Cloudera, Inc.
 
Cloudera User Group Chicago - Cloudera Manager: APIs & Extensibility
ClouderaUserGroups
 
Hadoop Operations for Production Systems (Strata NYC)
Kathleen Ting
 
Ad

More from Sudheer Kondla (8)

PDF
MongoDB cluster_on_aws_example
Sudheer Kondla
 
PDF
No sql
Sudheer Kondla
 
PDF
AWS multi-region DB design and deployment
Sudheer Kondla
 
PDF
Aws aurora scaling
Sudheer Kondla
 
PDF
Data platform architecture
Sudheer Kondla
 
PDF
Digital transformation is not about technology
Sudheer Kondla
 
PDF
Setting up mongodb sharded cluster in 30 minutes
Sudheer Kondla
 
PDF
Setting up mongo replica set
Sudheer Kondla
 
MongoDB cluster_on_aws_example
Sudheer Kondla
 
No sql
Sudheer Kondla
 
AWS multi-region DB design and deployment
Sudheer Kondla
 
Aws aurora scaling
Sudheer Kondla
 
Data platform architecture
Sudheer Kondla
 
Digital transformation is not about technology
Sudheer Kondla
 
Setting up mongodb sharded cluster in 30 minutes
Sudheer Kondla
 
Setting up mongo replica set
Sudheer Kondla
 
Ad

Recently uploaded (20)

PPTX
apidays Munich 2025 - Building an AWS Serverless Application with Terraform, ...
apidays
 
PPTX
b6057ea5-8e8c-4415-90c0-ed8e9666ffcd.pptx
Anees487379
 
PDF
How to Connect Your On-Premises Site to AWS Using Site-to-Site VPN.pdf
Tamanna
 
PPTX
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
PDF
apidays Helsinki & North 2025 - API-Powered Journeys: Mobility in an API-Driv...
apidays
 
PPTX
Numbers of a nation: how we estimate population statistics | Accessible slides
Office for National Statistics
 
PPTX
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
PDF
apidays Helsinki & North 2025 - APIs in the healthcare sector: hospitals inte...
apidays
 
PPTX
ER_Model_with_Diagrams_Presentation.pptx
dharaadhvaryu1992
 
PDF
apidays Helsinki & North 2025 - REST in Peace? Hunting the Dominant Design fo...
apidays
 
PDF
Early_Diabetes_Detection_using_Machine_L.pdf
maria879693
 
PDF
Merits and Demerits of DBMS over File System & 3-Tier Architecture in DBMS
MD RIZWAN MOLLA
 
PPT
deep dive data management sharepoint apps.ppt
novaprofk
 
PPTX
GenAI-Introduction-to-Copilot-for-Bing-March-2025-FOR-HUB.pptx
cleydsonborges1
 
PPTX
ER_Model_Relationship_in_DBMS_Presentation.pptx
dharaadhvaryu1992
 
PPTX
The _Operations_on_Functions_Addition subtruction Multiplication and Division...
mdregaspi24
 
PDF
AUDITABILITY & COMPLIANCE OF AI SYSTEMS IN HEALTHCARE
GAHI Youssef
 
PDF
WEF_Future_of_Global_Fintech_Second_Edition_2025.pdf
AproximacionAlFuturo
 
PDF
What does good look like - CRAP Brighton 8 July 2025
Jan Kierzyk
 
PDF
apidays Helsinki & North 2025 - How (not) to run a Graphql Stewardship Group,...
apidays
 
apidays Munich 2025 - Building an AWS Serverless Application with Terraform, ...
apidays
 
b6057ea5-8e8c-4415-90c0-ed8e9666ffcd.pptx
Anees487379
 
How to Connect Your On-Premises Site to AWS Using Site-to-Site VPN.pdf
Tamanna
 
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
apidays Helsinki & North 2025 - API-Powered Journeys: Mobility in an API-Driv...
apidays
 
Numbers of a nation: how we estimate population statistics | Accessible slides
Office for National Statistics
 
apidays Helsinki & North 2025 - API access control strategies beyond JWT bear...
apidays
 
apidays Helsinki & North 2025 - APIs in the healthcare sector: hospitals inte...
apidays
 
ER_Model_with_Diagrams_Presentation.pptx
dharaadhvaryu1992
 
apidays Helsinki & North 2025 - REST in Peace? Hunting the Dominant Design fo...
apidays
 
Early_Diabetes_Detection_using_Machine_L.pdf
maria879693
 
Merits and Demerits of DBMS over File System & 3-Tier Architecture in DBMS
MD RIZWAN MOLLA
 
deep dive data management sharepoint apps.ppt
novaprofk
 
GenAI-Introduction-to-Copilot-for-Bing-March-2025-FOR-HUB.pptx
cleydsonborges1
 
ER_Model_Relationship_in_DBMS_Presentation.pptx
dharaadhvaryu1992
 
The _Operations_on_Functions_Addition subtruction Multiplication and Division...
mdregaspi24
 
AUDITABILITY & COMPLIANCE OF AI SYSTEMS IN HEALTHCARE
GAHI Youssef
 
WEF_Future_of_Global_Fintech_Second_Edition_2025.pdf
AproximacionAlFuturo
 
What does good look like - CRAP Brighton 8 July 2025
Jan Kierzyk
 
apidays Helsinki & North 2025 - How (not) to run a Graphql Stewardship Group,...
apidays
 

Cloudera cluster setup and configuration