Big Data Test 1
A ________ serves as the master and there is only one NameNode per cluster.
nameNode
Which of the following stores metadata? 1. NameNode 2. datanode 3. Secondary Datanode 4 All of the above
namenode
What are the two majority types of nodes in HDFS?
namenode DataNode
The ____________ is the ultimate authority that arbitrates resources among all the applications in the system.
ResourceManager
Volume
Data is huge, need clustered or distributed system
Velocity
Data is often streaming. Constantly updated
6 Vs of Big Data
Volume, Velocity, Variety, Veracity, Value,Valence
What are the two basic layers comprising the Hadoop Architecture?
MapReduce and HDFS
What is the following command to upload a file into HDFS?
hdfs dfs -put FILENAME HDFS_PATH
Pig operates in mainly how many mode:
2
How many blocks in HDFS by giving a file of 10GB, with the default block size of 64MB, and 3 replications.
480
What is the organizing data structure for map/reduce programs?
A list of identification keys and some value associated with that identifier
The __________ is a framework-specific entity that negotiates resources from the ResourceManager
ApplicationMaster
In counting the total word count example, the algorithm is: 1. Cascading Map/Reduce and re-using wordcount result 2. No cascading allows in Map/Reduce 3. Cascading Map/Reduce and re-using word daily count result
Cascading Map/Reduce and re-using wordcount result
What are Hadoop advantages over a traditional distributed computing platform?
Cost, Flexibility, Scalability
Value
Data can add value to an organization
Point out the wrong statement : 1. DataNode is aware of the files to which the blocks stored on it belong to 2. Replication Factor can be configured at a cluster level (Default is set to 3) and also at a file level 3. Block Report from each DataNode contains a list of all the blocks that are stored on that DataNode 4. User data is stored on the local file system of DataNodes
DataNode is aware of the files to which the blocks stored on it belong to
Point out the correct statement : 1. DataNode is the slave/worker node and holds the user data in the form of Data Blocks 2. Each incoming file is broken into 32 MB by default 3. Data blocks are replicated across different nodes in the cluster to ensure a low degree of fault tolerance 4. none of the above
DataNode is the slave/worker node and holds the user data in the form of Data Blocks
In map/reduce framework, which of these logistics does Map/Reduce do with the map function? 1. Gather data distributed across a cluster to the user's computer and run map 2.Distribute map to cluster nodes, run map on the data partitions at the same time 3.Distribute map to cluster nodes, run map at one node, wait for it to finish, then run map at the next node, etc,
Distribute map to cluster nodes, run map on the data partitions at the same time
The PIG starts to compile the pig logical plan into physical plan and executed when using the command ______
Dump
HDFS provides a command line interface called __________ used to interact with HDFS.
FS Shell
The client reading the data from HDFS filesystem in Hadoop does which of the following? 1. Gets only the block locations form the namenode 2. Gets the data from the namenode 3. Gets both the data and block location from the namenode 4. Gets the block location from the datanode
Gets the block location from the datanode AND Gets only the block locations form the namenode
You can run Pig in interactive mode using the ______ shell. Grunt FS HDFS None of the mentioned
Grunt
Which of the following feature overcomes the limited single namenode namespace? HDFS Federation HDFS NameNode High Availability Speculative execution
HDFS Federation
Which of the following scenario may not be a good fit for HDFS ? 1. HDFS is not suitable for scenarios requiring multiple/simultaneous writes to the same file 2. HDFS is suitable for storing data related to applications requiring low latency data access 3. HDFS is suitable for storing data related to applications requiring low latency data access 4. none of the above
HDFS is not suitable for scenarios requiring multiple/simultaneous writes to the same file
What does HDFS stand for?
Hadoop Distributed File System
The namenode knows that the datanode is active using a mechanism known as-
Hearbeats
What is not part of the basic Hadoop Stack 'Zoo'? Horse pig Hive Elephant
Horse
What is NOT considered to be part of the Apache Basic Hadoop Modules? HDFS Impala MapReduce Yarn
Impala
When you design a map/reduce algorithm, you are in charge of designing: 1. Input Key/Value 2. Mapper function 3. Reducer function 4. the logistics including shuffles and groupings
Input Key/Value AND Mapper function AND Reducer function
When the user initiates a Map/Reduce task, the master node will create a
Jobtracker
___________ schedules, monitors, and re-executes failed tasks
Jobtracker
Which of the following function is used to read data in PIG ? Write Read Load none of the mentioned
LOAD
Which of these kinds of data motivated the Map/Reduce framework? 1.Large number of customer internet transactions that are often retrieved by a billing id. 2.Large number of internet documents that need to be indexed for searching by words. 3. Large number of patient records that are updated immediately after each patient visit.
Large number of internet documents that need to be indexed for searching by words.
The basic MapReduce program includes
Map() and Reduce()
What is Yarn used as an alternative to in Hadoop 2.0 and higher versions of Hadoop?
MapReduce
Which of the following statement is WRONG? 1. Pig development cycle is shorter than MapReduce 2. Pig is higher level programming than MapReduce 3. Pig is much slower than MapReduce 4. Performing data set joint is much easier in Pig than MapReduce
Pig is much slower than MapReduce
Streaming map/reduce allows mappers and reducers to be written in what languages: 1. R 2. Java 3. Unix shell commands 4. RUBY 5. Python
R, Unix shell commands, ruby, python
Map/Reduce performs a 'shuffle' and grouping. That means it... 1. Shuffles <key,value> pairs into random bins and then within a bin it groups keys. 2. Shuffles <key,value> pairs into different partitions according to the key value, and then aggregates all pairs in 1 partition into 1 group. 3. Shuffles <key,value> pairs into different partitions according to the key value, and sorts within the partitions by key.
Shuffles <key,value> pairs into different partitions according to the key value, and sorts within the partitions by key.
Pig: Point out the correct statement 1. The PIg interpreter builds a logical plan for every relational operation. 2. Invoke the Grunt shell using the "enter" command 3. Pig does not support jar files 4. All of the mentioned
The PIg interpreter builds a logical plan for every relational operation.
You can run Map/Reduce in the following way: WebRestAPI commandline streaming API calling
Streaming AND API calling
Valence
THICC. Interconnected
Point out the wrong statement : 1. To run Pig in local mode, you need access to a single machine 2. The DISPLAY operator will display the results to your terminal screen 3. To run Pig in mapreduce mode, you need access to a Hadoop cluster and HDFS installation 4. all of the mentioned
The DISPLAY operator will display the results to your terminal screen
Apache Hadoop YARN stands for : 1. Yet Another Resource Negotiator 2. Yet Another Resource Network 3. Yet Another Reserve Negotiator
Yet Another Resource Negotiator
Point out the correct statement : 1. You can run Pig in either mode using the "pig" command 2.You can run Pig in batch mode using the Grunt shell 3. You can run Pig in interactive mode using the FS shell 4. none of the above
You can run Pig in either mode using the "pig" command
The need for data replication can arise in various scenarios like : 1.Data Blocks get corrupted 2.DataNode goes down 3.DataNode goes down 4.All of the above
all of the above
Which of the following is the true about metadata? 1. Metadata contain information like number of blocks, their location, replicas 2. FsImage & EditLogs are metadata file 3. Metadata shows the structure of HDFS directories/files 4. all of the above
all of the above
Pig Latin statements are generally organized in one of the following ways : 1. A LOAD statement to read data from the file system 2. A series of "transformation" statements to process the data 3. A DUMP statement to view results or a STORE statement to save the results 4. all of the mentioned
all of the mentioned
_______ is the slave/worker node and holds the user data in the form of Data Blocks.
datanode
In the word count by day example, what is the key?
date-word
In the MapReduce framework, Hadoop does NOT handle: 1. producing the intermediate results 2. communicating intermediate results to the reducers 3. parallel execution 4. designing the key/value pair
designing the key/value pair
Which of the following is used to adjust the size of HDFS block?
dfs.blocksize AND dis.block.size
Which utility is used for checking the health of a HDFS file system? fsck fiche fiche fcks
fsck
The number of blocks 1. is limited by the name node memory 2. is limited by the name node cpu 3. is limited by the bandwidth 4. affects the number of map tasks
is limited by the NameNode memory AND is limited by the Bandwidth AND affects the number of Map tasks
HDFS is implemented in _____________ programming language.
java
Variety
many different forms, pictures, videos, text
HDFS works in a __________ fashion.
master-worker
You can run Pig in batch using __________ Pig scripts Pig shell command Pig options All of the mentioned
pig scripts
The __________ is responsible for allocating resources to the various running applications subject to familiar constraints of capacities, queues etc.
scheduler
In the MapReduce framework, Hadoop will do: shuffle sort group extract
shuffle and group
In the word count example, what is the key in both Map and Reduce?
the word itself
Veracity
truth of the data. Be aware of bias
In the Join operation example, the key is ...
word
