[PacktPub] Master Big Data Ingestion and Analytics with Flume, Sqoop, Hive and Spark [Video]

• Explore the Hadoop Distributed File System (HDFS) and commands
• Get to grips with the lifecycle of the Sqoop command
• Use the Sqoop Import command to migrate data from MySQL to HDFS and Hive
• Understand split-by and boundary queries
• Use the incremental mode to migrate data from MySQL to HDFS
• Employ Sqoop Export to migrate data from HDFS to MySQL
• Discover Spark DataFrames and gain insights into working with different file formats and compression

In addition to this, you will get up to speed with Sqoop Export for migrating data effectively, along with using Apache Flume to ingest data. As you progress, you will delve into Apache Hive, external and managed tables, working with different files, and Parquet and Avro. Toward the concluding section, you will focus on Spark DataFrames and Spark SQL.

By the end of this course, you will have gained comprehensive insights into big data ingestion and analytics with Flume, Sqoop, Hive, and Spark.

All code and supporting files are available at – https://github.com/PacktPublishing/Master-Big-Data-Ingestion-and-Analytics-with-Flume-Sqoop-Hive-and-Spark

• Learn Sqoop, Flume, and Hive and successfully achieve CCA175 and Hortonworks Spark Certification
• Understand the Hadoop Distributed File System (HDFS), along with exploring Hadoop commands to work effectively with HDFS