Hadoop HDFS cluster

start master

as cassandra user:

/opt/hadoop/sbin/start-all.sh

as root user:

su - cassandra -c "/opt/hadoop/sbin/start-all.sh"

stop master

as cassandra user:

/opt/hadoop/sbin/stop-all.sh

start data node

as cassandra user:

/opt/hadoop/sbin/hadoop-daemon.sh start datanode
/opt/hadoop/sbin/start-balancer.sh

as root user:

su - cassandra -c "/opt/hadoop/sbin/hadoop-daemon.sh start datanode"
su - cassandra -c "/opt/hadoop/sbin/start-balancer.sh"

stop data node

as cassandra user:

/opt/hadoop/sbin/hadoop-daemon.sh stop datanode

Reference

• Apache Spark Download - https://spark.apache.org/downloads.html
• Apache Hadoop Download - https://hadoop.apache.org/releases.html
• S3 Support in Apache Hadoop - https://wiki.apache.org/hadoop/AmazonS3
• Hadoop-AWS module - https://hadoop.apache.org/docs/r2.7.3/hadoop-aws/tools/hadoop-aws/