Assignment - Develop technical documentation, including the development of the code & detailing the results.
Provide a report on the findings that includes research into the ethics & security ramifications of your ability to data scrape, and any suggested mitigations (if required).
During the process of development of this code, the following functions were developed:
lexical_diversity - It returns the lexical diversity of the tokens passed to it
average_words - It returns the average number of words per tweet of the array passed to it
plotGraph - It makes the graph i.e. A line based on the arguments passed to t
Get_all_tweets - It returns the following arguments:
- Set of tokens of the text of all the tweets of the person given as a parameter
- Sensitive tweets by the person
- Retweet Count of the person
- Favourite Count of the person
- TextArr of the person
The Number of tweets is given as a constant.
For the analysis, I have taken the number of tweets to be 100
Steps undertaken:
First our application is authenticated using twitter's modules
Then get_all_tweets is passed
- Donald Trump's Twitter handle
- Barack Obama's Twitter Handle
Their parameters are extracted
Then Favourite Count and Retweet Count is plotted for both of them
The average of the following attributes is also printed
- Number of retweets
- Number of Sensitive Tweets
- Favourite Count of their tweets
- Lexical Diversity
- Words used in the tweet
Then tokens used by both people are plotted
Inferences -
- It can be inferred comfortably that Obama is much more famous than Trump
- The lexical diversity of Obama is greater than Trump
- The number of words used by Trump is greater than Obama in his tweets
- The number of retweets and favourite count of Obama is almost 10x of that of Trump
- Both the leaders have 0 sensitive tweets
Ethics and Security Ramifications
- It is said that a tool can be used both for helping the humanity as well as destroying it.
- For example, a knife can be used for both cutting vegetables as well as harming humans
- Similar is this tool developed above
- Using this tool, we can search for patterns in the tweets, analyse them , generate useful conclusion etc but the same program can be used to take out patterns which can potentially harm the person
- In addition to this, though some people complain about privacy regarding this program but people must understand that twitter is an online public platform thus your tweets are already in public domain just program parsing it and analysing it does no harm.
Attachment:- Assignment File.rar