data science - final
How is data arranged in a pivot table?
- All related data is in the same column allowing you to aggregate data by column value - Tableau uses this file format
Sentence level sentiment analysis
- Document may have multiple views - Finer - Issues with question, sarcastic sentences
Aspect-based sentiment analysis
- Entities with many aspects - ex - choosing an iphone
What is analytics?
- Extracting information from data - Discovering meaningful patterns
Document-level sentiment analysis
- Simplest - Supervised and Unsupervised learning - Subjective vs objective
How does Hadoop and Map Reduce facilitate the analysis of Big Data?
- The Hadoop ecosystem provides the furnishings that turn the framework into a comfortable home for big data activity
In a database table there are...
- columns - rows - characters
Comparative sentiment analysis
- comparing one brand or product to another - ex - apple vs. android
What are the benefits of sentiment analysis?
- help your brand create better products/services - understand consumers
How is data stored?
- in a database. - as lots of binary numbers, by magnetism, electronics or optics.
What factors influence the confidence interval of a trend line (i.e., the Tableau exercise)?
- increasing/decreasing sample size
What is the difference between relational databases and data formatted for Pivot Table analysis?
A relational database is a structured database used to recognize relations among stored items of information. While data formatted for a Pivot Table allows you to extract significance from a large, detailed data set.
What is sentiment analysis?
A technique used to detect favorable and unfavorable opinions toward specific products and services using large numbers of textual data sources
A basic rule of the Pivot Table data structure is that
All values of the same type need to be in one column
The most detailed type of sentiment analysis is:
Aspect-based sentiment analysis
How is analytics related to Big Data?
Big data analytics is the often complex process of examining large and varied data sets -- or big data -- to uncover information including hidden patterns, unknown correlations, market trends and customer preferences that can help organizations make informed business decisions
What is Map Reduce?
Breaks up the task and gives each connected computer a small piece to work on.
What is the most appropriate technique to analyze the statement "Coke tastes better than Pepsi"?
Comparative sentiment analysis
How is it different from Big Data?
Data analytics is generally more focused than big data because instead of gathering huge piles of unstructured data, data analysts have a specific goal in mind and sort through relevant data to look for ways to gain support
According to Bertolucci, the simplest type of analytics is:
Descriptive
What is the difference between descriptive, predictive, and prescriptive analytics?
Descriptive - Summarizes past data Predictive - Forecast of what may happen in the future Prescriptive - Helps facilitate decision-making
According to Wohlsen, Facebook's recent study of its users revealed:
Exposure to fewer positive messages led to fewer positive posts
What is the difference between Hadoop and Map Reduce?
Hadoop = storage Map Reduce = analysis
According to Peck, the use of analytics to determine workers' potential is most widely used in
Hourly work, where the jobs are standardized
What to do to widen or shrink the shaded area (margin of error) of forecasts in a time-trend forecasting analysis?
Increase time
What is the purpose of Database
Keep track of things with more than one theme
Hadoop is often paired with another piece of software called
MapReduce
What is association mining and where is it used?
Most Used: Shopping habits What is it: data analysis to determin patterns in data, if shopper buys X how likely to buy Y
According to Feldman, the most common application of sentiment analysis is:
Reviews of consumer products and services
What is NOT a type of unstructured data:
Stock prices
What is Hadoop?
Stores big databases in smaller pieces across a network of connected computers
According to Peck, "people analytics" is
The application of predictive analytics to people's careers
According to Paine, an analysis found that a team's probability of scoring increases as:
They string together more successful passes
How is data arranged in a relational database?
This model organizes data into one or more tables (or "relations") of columns and rows, with a unique key identifying each row. Generally, each table/relation represents one "entity type" (such as customer or product).
How do the tables of data become associated in a relational database?
With the use of unique and foreign keys
In a database table, another name for a character is
a byte
In a database table, another name for a column is
a field
What are the uses of association mining?
a procedure which is meant to find frequent patterns, correlations, associations, or causal structures from data sets found in various kinds of databases such as relational databases, transactional databases, and other forms of data repositories.
In a database table, another name for a row is
a record
What is a database?
a self-describing collection of integrated records
What are the uses of forecasting?
a technique that uses historical data as inputs to make informed estimates that are predictive in determining the direction of future trends.
How does sentiment analysis software determine a positive/negative score for a block of text?
analyzing words used and their conotation
Example of descriptive analytics.
company reports
Example of prescriptive analytics.
decision trees
Hadoop is a platform that:
makes big data easier to manage
Bertolucci claims an ongoing problem with Hadoop for companies is that
managers and executives don't really understand what it does
What are some examples of unstructured data?
often include text and multimedia content. some examples for email and social media
According to Paine, people have been tracking soccer data for:
over 60 years
What are some examples of structured data?
refers to information with a high degree of organization. some examples are census and federal records.
Explain the difference between structured and unstructured data.
structured data is easily searchable by basic algorithms whereas unstructured data is more like human language. It doesn't fit nicely into relational databases like SQL, and searching it based on the old algorithms ranges from difficult to completely impossible.
In a database table, a group of similar records are
tables or files
How does sentiment analysis work?
the process of computationally identifying and categorizing opinions expressed in a piece of text, especially in order to determine whether the writer's attitude towards a particular topic, product, etc., is positive, negative, or neutral.
Relational databases follow to a set of practices called
the rules of normalization
T/F - According to Hurwitz, Hadoop is capable of handling unstructured data:
true
Example of predictive analytics.
weather forecasting
In what situations can sentiment analysis be inaccurate?
wording can be misleading and often misunderstood by computer programs.
