(Answered) Question 1 hive or pig programming build a table to be used

Programming

QUESTION 1. HIVE OR PIG PROGRAMMING

Build a table to be used as the basis for a directed weighted graph (network) that shows which stations are connected. Use the trip count between those stations as the weights. Save this table in ‘/user/lab/q1' in HDFS.

Include the directory listing of the output directory and first five lines of the output file in your submission.

QUESTION 2. HIVE OR PIG PROGRAMMING

Load the data from ‘/user/lab/q1' you created in the previous question. For each route, calculate a ‘traffic index' where

Save the results in ‘/user/lab/q2' in HDFS. Include the directory listing of the output directory and first five lines of the output file in your submission.

QUESTION 3. SPARK PROGRAMMING

Load the data from ‘/user/lab/q2' you created in the previous question.

a) Find the 3 stations with the highest in-degree. What does that mean in real life?

b) Find the 3 stations with the highest out-degree. What does that mean in real life?

Submit scripts/queries (Pig, Hive, Spark, Hadoop) and final output (screen copy or screen shot as appropriate).

Attachment:- Trip and station data.rar

View complete question

Python, Programming

Category:- Python
Reference No.:- M92861469
Price:- $60

Verified Expert

Priced at $120 Now at $60, Verified Solution

Have any Question?Write your Review or question?

Related Questions in Python

Homework -this homework will have both a short written and

Homework - This homework will have, both a short written and coding assignment. The problems that are supposed to be written are clearly marked. 1) (Written) Make heuristics Describe two heuristics for the slide problem ...

Simple python traffic lightswrite a program that simulates

Simple Python (Traffic lights) Write a program that simulates a traffic light. The program lets the user select one of three lights: red, yellow, or green. When a radio button is selected, the light is turned on, and onl ...

Sieve of eratosthenes in pythonthe goal is to find all the

Sieve of Eratosthenes (in Python) The goal is to find all the prime numbers less than or equal to some natural number maxn. We have a list that tells us if any of the numbers 0..maxn are "marked". It can be an array of b ...

Environment setupthe first mini project will be based on

Environment Setup The first mini project will be based on Ladder Logic programming. We will be using Schneider Electric's IDE called SoMachine Basic to do the programming. The latest ver- sion of SoMachine Basic for Wind ...

Question write a python program with a graphical user

Question: Write a python program with a graphical user interface that will allow a user to create a custom pizza which they wish to order. At minimum, the user should be able to choose the size of the pizza, the type of ...

Question why is software configuration management

Question : Why is software configuration management considered an umbrella activity in software engineering? Please include examples and supporting discussion. The response must be typed, single spaced, must be in times ...

Below zero - ice cream storethe local ice-cream store needs

Below Zero - ice cream store The local ice-cream store needs a new ordering system to improve customer service by streamlining the ordering process. The manager of the store has found that many orders are incorrect and s ...

Question a software company sells a package that retails

Question : A software company sells a package that retails for $99. Quantity discounts are given according to the following table: Quantity Discount 10 - 19 20% 20 - 49 30% 50 - 99 40% 100 or more 50% Write a program usi ...

Question write a simple python program that takes use

Question: Write a simple python program that takes use inputs as non-zero digits and converts them into binary form. The response must be typed, single spaced, must be in times new roman font (size 12) and must follow th ...

Quesiton write a python script that counts occurrences of

Quesiton: Write a python script that counts occurrences of words in a file. • The script expects two command-line arguments: the name of an input file and a threshold (an integer). Here is an example of how to run the sc ...

4,153,160 Questions Asked
13,132 Experts
2,558,936 Questions Answered

Ask Experts for help!!

Looking for Assignment Help?

Start excelling in your Courses, Get help with Assignment

Write us your full requirement for evaluation and you will receive response within 20 minutes turnaround time.

Ask Now Help with Problems, Get a Best Answer

Recent Questions

Ask Python Expert