BI Midterm Review

What is considered to be part of the Apache Basic Hadoop Modules? A. HDFS B. Yarn C. MapReduce D. Impala

A & C

What are the two major components of the MapReduce layer? A. TaskManager B. JobTracker C. NameNode D. DataNode

A. B. ``

_________ can best be described as a programming model used to develop Hadoop-based applications that can process massive amounts of data. a) MapReduce b) Mahout c) Oozie d) All of the mentioned

Answer: a Explanation: MapReduce is a programming model and an associated implementation for processing and generating large data sets with a parallel, distributed algorithm.

________ is general-purpose computing model and runtime system for distributed data analytics. a) Mapreduce b) Drill c) Oozie d) None of the mentioned

Answer: a Explanation: Mapreduce provides a flexible and scalable foundation for analytics, from traditional reporting to leading-edge machine learning algorithms.

e Pig Latin scripting language is not only a higher-level data flow language but also has operators similar to : a) SQL b) JSON c) XML d) All of the mentioned

Answer: a Explanation: Pig Latin, in essence, is designed to fill the gap between the declarative style of SQL and the low-level procedural style of MapReduce.

All of the following accurately describe Hadoop, EXCEPT: a) Open source b) Real-time c) Java-based d) Distributed computing approach

Answer: b Explanation: Apache Hadoop is an open-source software framework for distributed storage and distributed processing of Big Data on clusters of commodity hardware.

Hive also support custom extensions written in : a) C# b) Java c) C d) C++

Answer: b Explanation: Hive also support custom extensions written in Java, including user-defined functions (UDFs) and serializer-deserializers for reading and optionally writing custom formats.

Point out the wrong statement : a) Hardtop's processing capabilities are huge and its real advantage lies in the ability to process terabytes & petabytes of data b) Hadoop uses a programming model called "MapReduce", all the programs should confirms to this model in order to work on Hadoop platform c) The programming model, MapReduce, used by Hadoop is difficult to write and test d) All of the mentioned

Answer: c Explanation: The programming model, MapReduce, used by Hadoop is simple to write and test.

______ jobs are optimized for scalability but not latency. a) Mapreduce b) Drill c) Oozie d) Hive

Answer: d Explanation: Hive Queries are translated to MapReduce jobs to exploit the scalability of MapReduce.

What are the two majority types of nodes in HDFS? A. MetaNode B. NameNode C. RackNode D. BlockNode E. DataNode

B & E

What is Yarn used as an alternative to in Hadoop 2.0 and higher versions of Hadoop? A. Pig B. Hive C. ZooKeeper D.MapReduce E. HDFS

D

Hadoop is written in what language? Why?

Java for distribted storage processing

For the following command, we could tell the current user is () [cloudera@quickstart Downloads]$ mkdir ISDS7511 Select one: a. Cloudera b. Quickstart c. Root d. hdfs

a

The following command will do: [cloudera@quickstart Downloads]$ su root Select one: a. Change the user from cloudera to root b. change the working directory from current to "/root" c. set up the java enviroment

a

What are Hadoop advantages over a traditional platform? A. Scalability B. Reliability C. Flexibility D. Cost

a b c d

What are the two basic layers comprising the Hadoop Architecture? A. ZooKeeper and MapReduce B. HDFS and Hive C. MapReduce and HDFS D.Impala and HDFS

c

Which service is not necessary for the following command? hadoop jar anagram.jar AnagramDriver /user/cloudera/DSIS7511_Peter_hdfs /user/cloudera/output Select one: a. HDFS b. Mapreduce c. Zookeeper

c

Hadoop was named after what?

toy elephant of Cuttings son

Hadoop is : 1. 2. 3. 4.

1. Framework rather than a single solution 2. Scalable and distributed framework 3. Data pipeline of massive amounts of data 4. Both structured and unstructured data

Point out the correct statement : a) Hive is not a relational database, but a query engine that supports the parts of SQL specific to querying data b) Hive is a relational database with SQL support c) Pig is a relational database with SQL support d) All of the mentioned

Answer: a Explanation: Hive is a SQL-based data warehouse system for Hadoop that facilitates data summarization, ad hoc queries, and the analysis of large datasets stored in Hadoop-compatible file systems.

Hadoop is a framework that works with a variety of related tools. Common cohorts include: a) MapReduce, Hive and HBase b) MapReduce, MySQL and Google Apps c) MapReduce, Hummer and Iguana d) MapReduce, Heron and Trumpet

Answer: a Explanation: To use Hive with HBase you'll typically want to launch two clusters, one to run HBase and the other to run Hive.

______ is a platform for constructing data flows for extract, transform, and load (ETL) processing and analysis of large datasets. a) Pig Latin b) Oozie c) Pig d) Hive

Answer: c Explanation: Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs.

Who created Hadoop?

Doug Cutting Mike Cafarella in 2005 for the Yahoo search engine

In Amazon Web service(AWS), you could pay for different types of instance to run the Data Node and Name Node for the hadoop distributed file system. Also, Amazon web service allows its customer to apply two types of instances: 1. reserved instance, which once you start, it will not end until you terminated it. 2. Spot instance, which is way cheaper, because it is using idle resources in AWS. But it might be reclaimed by AWS when the computing resources become unavailable. If we want to decrease our cost of using AWS for our Hadoop deployment, we should use the reserved instance for our data node and spot instance for name node because we always need name node to maintain the file thus this will help us keep with the budget. Select one: True False

False

Hadoop is not: 1. 2.

an alternative for SQL always fast and efficient

What does HDFS stand for? A. Hadoop Data File System B. Hadoop Distributed File System C. Hadoop Data File Scalability D. Hadoop Datanode File Security

b

Which of the following service(s) is(are) required to execute the following command? hadoop fs -mkdir ISDS7511 Select one: a. MapReduce b. HDFS c. Yarn d. Zookeeper

b

For the following command, we could tell the current working directory's name is ISDS7511. [cloudera@quickstart Downloads]$ mkdir ISDS7511 Select one: True False

f