Skip to content

Commit

Permalink
Move cloud quiz to assignment4
Browse files Browse the repository at this point in the history
minor changes to instructions

Fix some out of date instructions on assignment4
  • Loading branch information
billhowe committed Jul 22, 2014
1 parent b365bb5 commit eaf3f87
Show file tree
Hide file tree
Showing 20 changed files with 208 additions and 14 deletions.
37 changes: 24 additions & 13 deletions assignment1/README.html
Original file line number Diff line number Diff line change
@@ -1,6 +1,4 @@



About twitterstream.py:

Used to fetch live stream data from twitter.
Expand All @@ -14,20 +12,33 @@

To get credentials:

<ul>
<ol>
<li>Create a twitter account if you do not already have one.</li>
<li>Go to https://dev.twitter.com/apps and log in with your twitter credentials.</li>
<li>Click "create an application"</li>
<li>Fill out the form and agree to the terms. Put in a dummy website if you don't have one you want to use.</li>
<li>On the next page, scroll down and click "Create my access token"</li>
<li>Copy your "Consumer key" and your "Consumer secret" into twitterstream.py</li>
<li>Click "Create my access token." You can <a href="https://dev.twitter.com/docs/auth">Read more about Oauth authorization.</a></li>
<li>Open twitterstream.py and set the variables corresponding to the consumer key, consumer secret, access token, and access secret</li>
<li>Run the following and make sure you see data flowing.</li>

<li>Go to <a href="https://dev.twitter.com/apps"><strong>https://dev.twitter.com/apps</strong></a> and log in with your twitter credentials.</li>

<li>Click &quot;Create New App&quot;</li>

<li>Fill out the form and agree to the terms. Put in a dummy website if you don't have one you want to use.</li>

<li>On the next page, click the &quot;API Keys&quot; tab along the top, then scroll all the way down until you see the section &quot;Your Access Token&quot;</li>

<li>Click the button &quot;Create My Access Token&quot;. You can <a href="https://dev.twitter.com/docs/auth"><strong>Read more about Oauth authorization.</strong></a></li>

<li>You will now copy four values into twitterstream.py. These values are your &quot;API Key&quot;, your &quot;API secret&quot;, your &quot;Access token&quot; and your &quot;Access token secret&quot;. All four should now be visible on the API Keys page. (You may see &quot;API Key&quot; referred to as &quot;Consumer key&quot; in some places in the code or on the web; they are synonyms.) Open twitterstream.py and set the variables corresponding to the api key, api secret, access token, and access secret. You will see code like the below:

<pre>
$ python twitterstream.py
api_key = "&lt;Enter api key&gt;"
api_secret = "&lt;Enter api secret&gt;"
access_token_key = "&lt;Enter your access token key here&gt;"
access_token_secret = "&lt;Enter your access token secret here&gt;"
</pre>
</li>

</ul>
<li>Run the following and make sure you see data flowing and that no errors occur. 

<pre>$ python twitterstream.py > output.txt</pre>

This command pipes the output to a file. Stop the program with Ctrl-C, but wait at least <strong>3 minutes</strong> for data to accumulate. Keep the file output.txt for the duration of the assignment; we will be reusing it in later problems. Don’t use someone else’s file; we will check for uniqueness in other parts of the assignment.
</li>
</ol>
2 changes: 2 additions & 0 deletions assignment1/assignment1.html
Original file line number Diff line number Diff line change
Expand Up @@ -282,6 +282,8 @@ <h3>Problem 5: Which State is happiest?</h3>
<p>You are free to develop your own strategy for determining the state that each tweet
originates from.</p>

<p>You may find it useful to use this <a href="http://code.activestate.com/recipes/577305-python-dictionary-of-us-states-and-territories/">python dictionary of state abbreviations</a>.</p>

<p>You can ignore any tweets for which you cannot assign a location in the United States.</p>

<p>In this file, each line is a Tweet object, as<a
Expand Down
2 changes: 1 addition & 1 deletion cloud_quiz/README.txt → assignment4/README.txt
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ Master Node (see hw6-awsusage.html).
STEP2

Start an AWS Cluster (see hw6-awsusage.html), start pig interactively,
and cut and paste the content of example.pig.
and cut and paste the content of example.pig. I prefer to do this line by line


Note: The program may appear to hang with a 0% completion time... go check the job tracker. Scroll down. You should see a MapReduce job running with some non-zero progress.
Expand Down
181 changes: 181 additions & 0 deletions assignment4/assignment4.html

Large diffs are not rendered by default.

File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 comments on commit eaf3f87

Please sign in to comment.