notebooks/11-Information_retrieval.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 11 - Web Information Retrieval \n",
    "\n",
    "by [Alejandro Correa Bahnsen](albahnsen.com/)\n",
    "\n",
    "version 0.1, Apr 2016\n",
    "\n",
    "## Part of the class [Practical Machine Learning](https://github.com/albahnsen/PracticalMachineLearningClass)\n",
    "\n",
    "\n",
    "\n",
    "This notebook is licensed under a [Creative Commons Attribution-ShareAlike 3.0 Unported License](http://creativecommons.org/licenses/by-sa/3.0/deed.en_US). "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction\n",
    "\n",
    "Information retrieval (IR) is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches can be based on metadata or on full-text (or other content-based) indexing. (Wikipedia)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "url_ = 'http://mashable.com/2016/03/07/apple-ebook-case/#6KXWVluVqmqg'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"600\"\n",
       "            height=\"600\"\n",
       "            src=\"http://mashable.com/2016/03/07/apple-ebook-case/#6KXWVluVqmqg\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.IFrame at 0x7fb39d894940>"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import IFrame\n",
    "IFrame(url_, 600, 600)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get the webpage into a python object\n",
    "\n",
    "If we want to collect information on hundreds or twosands of webpages doing it manually is a no go. Instead, lets get the information of the webpage into python using web scraping"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Download the HTML code of the webpage"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "import urllib.request\n",
    "response = urllib.request.urlopen(url_)\n",
    "html = response.read()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "b'<!DOCTYPE html>\\n<!--\\no o     o     +              o\\n+   +     +             o     +       +\\n            +\\no  +    +        o  +           +        +\\n     __  __           _           _     _\\n~_,-|  \\\\/  | __ _ ___| |__   __ _| |__ | | ___\\n    | |\\\\/| |/ _` / __| \\'_ \\\\ / _` | \\'_ \\\\| |/ _ \\\\,-~_,- - - ,\\n~_,-| |  | | (_| \\\\__ \\\\ | | | (_| | |_) | |  __/    |   /\\\\_/\\\\\\n    |_|  |_|\\\\__,_|___/_| |_|\\\\__,_|_.__/|_|\\\\___|  ~=|__( ^ .^)\\n~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,\"\"   \"\"\\no o     o     +              o\\n+   +     +             o     +       +\\n            +\\no  +    +        o  +           +        +\\n-->\\n<html data-env=\\'production\\' lang=\\'en\\' xml:lang=\\'en\\'>\\n<head>\\n<script>\\n  window.__o = {\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h'"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "html[0:800]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Lets parse the input to a more readable one"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<!DOCTYPE html>\n",
      "<!--\n",
      "o o     o     +              o\n",
      "+   +     +             o     +       +\n",
      "            +\n",
      "o  +    +        o  +           +        +\n",
      "     __  __           _           _     _\n",
      "~_,-|  \\/  | __ _ ___| |__   __ _| |__ | | ___\n",
      "    | |\\/| |/ _` / __| '_ \\ / _` | '_ \\| |/ _ \\,-~_,- - - ,\n",
      "~_,-| |  | | (_| \\__ \\ | | | (_| | |_) | |  __/    |   /\\_/\\\n",
      "    |_|  |_|\\__,_|___/_| |_|\\__,_|_.__/|_|\\___|  ~=|__( ^ .^)\n",
      "~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,-~_,\"\"   \"\"\n",
      "o o     o     +              o\n",
      "+   +     +             o     +       +\n",
      "            +\n",
      "o  +    +        o  +           +        +\n",
      "-->\n",
      "<html data-env=\"production\" lang=\"en\" xml:lang=\"en\">\n",
      " <head>\n",
      "  <script>\n",
      "   window.__o = {\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true};\n",
      "  window._gaq = window._gaq || [];\n",
      "  window._gaq.push(['_setAccount', 'UA-92124-1']);\n",
      "  window._geo = \"US\";\n",
      "  window.__domStart = (new Date().getTime())\n",
      "  </script>\n",
      "  <title>\n",
      "   The Supreme Court smacked down Apple today\n",
      "  </title>\n",
      "  <link href=\"http://rack.3.mshcdn.com/assets/app-105409f8969e79e421fd4a2e84721dad.css\" media=\"screen\" rel=\"stylesheet\" type=\"text/css\"/>\n",
      "  <link href=\"http://rack.0.mshcdn.com/assets/posts-c254e869452e4d1aa0c266cf22d8a613.css\" media=\"all\" rel=\"stylesheet\" type=\"text/css\"/>\n",
      "  <!--[if lte IE 8]>\n",
      "<link href=\"http://rack.3.mshcdn.com/assets/iehax-a92ea2679dfac0fd022bcbffb7a40eeb.css\" media=\"screen\" rel=\"stylesheet\" type=\"text/css\" />\n",
      "<![endif]-->\n",
      "  <meta content=\"no\" name=\"apple-mobile-web-app-capable\">\n",
      "   <meta content=\"width=device-width, initial-scale=1.0\" name=\"viewport\">\n",
      "    <link href=\"https://plus.google.com/113493854651753327245\" rel=\"publisher\">\n",
      "     <link href=\"http://feeds.mashable.com/Mashable\" rel=\"alternate\" title=\"Mashable\" type=\"application/rss+xml\">\n",
      "      <link href=\"/apple-touch-icon-57x57.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"57x57\">\n",
      "       <link href=\"/apple-touch-icon-60x60.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"60x60\">\n",
      "        <link href=\"/apple-touch-icon-72x72.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"72x72\">\n",
      "         <link href=\"/apple-touch-icon-76x76.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"76x76\">\n",
      "          <link href=\"/apple-touch-icon-114x114.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"114x114\">\n",
      "           <link href=\"/apple-touch-icon-120x120.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"120x120\">\n",
      "            <link href=\"/apple-touch-icon-144x144.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"144x144\">\n",
      "             <link href=\"/apple-touch-icon-152x152.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"152x152\">\n",
      "              <link href=\"/apple-touch-icon-180x180.png?v=m2Pmw8zNwl\" rel=\"apple-touch-icon\" sizes=\"180x180\">\n",
      "               <link href=\"/favicon-32x32.png?v=m2Pmw8zNwl\" rel=\"icon\" sizes=\"32x32\" type=\"image/png\">\n",
      "                <link href=\"/android-chrome-192x192.png?v=m2Pmw8zNwl\" rel=\"icon\" sizes=\"192x192\" type=\"image/png\">\n",
      "                 <link href=\"/favicon-96x96.png?v=m2Pmw8zNwl\" rel=\"icon\" sizes=\"96x96\" type=\"image/png\">\n",
      "                  <link href=\"/favicon-16x16.png?v=m2Pmw8zNwl\" rel=\"icon\" sizes=\"16x16\" type=\"image/png\">\n",
      "                   <link href=\"/manifest.json?v=m2Pmw8zNwl\" rel=\"manifest\">\n",
      "                    <link href=\"/favicon.ico?v=m2Pmw8zNwl\" rel=\"shortcut icon\">\n",
      "                     <meta content=\"#da532c\" name=\"msapplication-TileColor\">\n",
      "                      <meta content=\"/mstile-144x144.png?v=m2Pmw8zNwl\" name=\"msapplication-TileImage\">\n",
      "                       <meta content=\"#ffffff\" name=\"theme-color\">\n",
      "                        <meta content=\"mid:12105681\" name=\"linkedin:owner\">\n",
      "                         <meta content=\"122071082108\" property=\"fb:app_id\">\n",
      "                          <meta content=\"18807449704\" property=\"fb:page_id\">\n",
      "                           <meta content=\"nYmtX7H2sSCkK8gHpQGxr7Es2526DgUaqb6PGYSX\" name=\"readability-verification\">\n",
      "                            <meta content=\"YfjJNAwfOEsk9gCpEyro9wrDs3yzGlkO1w2tJ7GdxDo\" name=\"google-site-verification\">\n",
      "                             <meta content=\"app-id=910775754\" name=\"apple-itunes-app\">\n",
      "                              <link href=\"http://rack.0.mshcdn.com/assets/mashable.touchicon-fef1d080d993d3b95408f12ab39b03f0.png\" rel=\"apple-touch-icon-precomposed\">\n",
      "                               <link data-page-subject=\"true\" href=\"http://mashable.com/2016/03/07/apple-ebook-case/\" rel=\"canonical\"/>\n",
      "                               <link data-page-subject=\"true\" href=\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/0637f519/fe9/steve_jobs.jpg\" rel=\"image_src\"/>\n",
      "                               <meta content=\"http://mashable.com/2016/03/07/apple-ebook-case/\" data-page-subject=\"true\" property=\"og:url\"/>\n",
      "                               <meta content=\"The Supreme Court smacked down Apple today\" data-page-subject=\"true\" property=\"og:title\"/>\n",
      "                               <meta content=\"article\" data-page-subject=\"true\" property=\"og:type\"/>\n",
      "                               <meta content=\"Mashable\" data-page-subject=\"true\" property=\"og:site_name\"/>\n",
      "                               <meta content=\"The courts have thrown the book at Apple.\" data-page-subject=\"true\" property=\"og:description\"/>\n",
      "                               <meta content=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-page-subject=\"true\" property=\"og:image\"/>\n",
      "                               <meta content=\"2016-03-07T16:36:45Z\" data-page-subject=\"true\" property=\"og:article:published_time\"/>\n",
      "                               <meta content=\"2016-03-26T01:15:00Z\" data-page-subject=\"true\" property=\"og:article:modified_time\"/>\n",
      "                               <meta content=\"https://www.facebook.com/mashable\" data-page-subject=\"true\" property=\"og:article:publisher\"/>\n",
      "                               <meta content=\"The courts have thrown the book at Apple.\" data-page-subject=\"true\" name=\"description\"/>\n",
      "                               <meta content=\"business\" data-page-subject=\"true\" name=\"keywords\"/>\n",
      "                               <meta content=\"The Supreme Court smacked down Apple today\" data-page-subject=\"true\" name=\"twitter:title\"/>\n",
      "                               <meta content=\"The courts have thrown the book at Apple.\" data-page-subject=\"true\" name=\"twitter:description\"/>\n",
      "                               <meta content=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/86e9c4e4/fe9/steve_jobs.jpg\" data-page-subject=\"true\" name=\"twitter:image\"/>\n",
      "                               <meta content=\"@mashable\" data-page-subject=\"true\" name=\"twitter:site\"/>\n",
      "                               <meta content=\"mashable\" data-page-subject=\"true\" name=\"twitter:via\"/>\n",
      "                               <meta content=\"http://mashable.com/2016/03/07/apple-ebook-case/\" data-page-subject=\"true\" name=\"twitter:url\"/>\n",
      "                               <meta content=\"@mashable\" data-page-subject=\"true\" name=\"twitter:creator\"/>\n",
      "                               <meta content=\"photo\" data-page-subject=\"true\" name=\"twitter:card\"/>\n",
      "                               <meta content=\"560\" data-page-subject=\"true\" name=\"twitter:image:width\"/>\n",
      "                               <meta content=\"750\" data-page-subject=\"true\" name=\"twitter:image:height\"/>\n",
      "                               <meta content=\"2016-03-07 16:36:45 UTC\" data-page-subject=\"true\" name=\"date\"/>\n",
      "                               <meta content=\"Seth Fiegerman\" data-page-subject=\"true\" name=\"sailthru.author\"/>\n",
      "                               <meta content=\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/0aa6585a/d86/steve_jobs.jpg\" data-page-subject=\"true\" name=\"sailthru.image.thumb\"/>\n",
      "                               <meta content=\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/540eb111/d86/steve_jobs.jpg\" data-page-subject=\"true\" name=\"sailthru.image.full\"/>\n",
      "                               <meta content=\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/b032d381/d86/steve_jobs.jpg\" data-page-subject=\"true\" name=\"sailthru.lead_image\"/>\n",
      "                               <meta content=\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/911cba2d/d86/steve_jobs.jpg\" data-page-subject=\"true\" name=\"sailthru.secondary_image\"/>\n",
      "                               <meta content=\"false\" data-page-subject=\"true\" name=\"sailthru.exclude_homepage\"/>\n",
      "                               <meta content=\"false\" data-page-subject=\"true\" name=\"sailthru.exclude_uk\"/>\n",
      "                               <meta content=\"false\" data-page-subject=\"true\" name=\"sailthru.exclude_australia\"/>\n",
      "                               <meta content=\"false\" data-page-subject=\"true\" name=\"sailthru.exclude_india\"/>\n",
      "                               <meta content=\"Seth Fiegerman\" data-page-subject=\"true\" name=\"author\"/>\n",
      "                               <meta content=\"http://on.mash.to/1U7CZrk\" data-page-subject=\"true\" name=\"short_url\"/>\n",
      "                               <script type=\"application/ld+json\">\n",
      "                                {\"@context\":\"http://schema.org\",\"headline\":\"The Supreme Court smacked down Apple today\",\"url\":\"http://mashable.com/2016/03/07/apple-ebook-case/\",\"image\":\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/0637f519/fe9/steve_jobs.jpg\",\"keywords\":[\"business\"],\"@type\":\"Article\",\"dateCreated\":\"2016-03-07T16:36:45Z\",\"datePublished\":\"2016-03-07T16:36:45Z\",\"articleSection\":\"business\",\"creator\":\"Seth Fiegerman\",\"author\":\"Seth Fiegerman\",\"mainEntityOfPage\":\"True\",\"metadata\":{\"page\":1,\"omnitureData\":{\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true},\"postId\":null}}\n",
      "                               </script>\n",
      "                               <script src=\"//cdn.optimizely.com/js/58011369.js\">\n",
      "                               </script>\n",
      "                               <script async=\"async\" src=\"http://widgets.outbrain.com/outbrain.js\">\n",
      "                               </script>\n",
      "                               <script async=\"async\" src=\"//cdn.connatix.com/min/connatix.handler.dfp.min.js\">\n",
      "                               </script>\n",
      "                               <script src=\"http://rack.2.mshcdn.com/assets/advertisement-060f46eaa4b4b7eb4cfc22a60aa890ba.js\" type=\"text/javascript\">\n",
      "                               </script>\n",
      "                               <script src=\"http://rack.1.mshcdn.com/assets/app-e00dc2a7876ac17076ba0e96a8c95779.js\" type=\"text/javascript\">\n",
      "                               </script>\n",
      "                               <!--[if lte IE 8]>\n",
      "<script src=\"http://rack.1.mshcdn.com/assets/polyfill-dbcc2a2d7d3822e949277216824a7e49.js\" type=\"text/javascript\"></script>\n",
      "<![endif]-->\n",
      "                               <script>\n",
      "                                !function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function(){n.callMethod?\n",
      "n.callMethod.apply(n,arguments):n.queue.push(arguments)};if(!f._fbq)f._fbq=n;\n",
      "n.push=n;n.loaded=!0;n.version='2.0';n.queue=[];t=b.createElement(e);t.async=!0;\n",
      "t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window,\n",
      "document,'script','//connect.facebook.net/en_US/fbevents.js');\n",
      "fbq('init', '1453039084979896');\n",
      "fbq('track', \"PageView\");\n",
      "                               </script>\n",
      "                               <noscript>\n",
      "                                <img height=\"1\" src=\"https://www.facebook.com/tr?id=1453039084979896&amp;ev=PageView&amp;noscript=1\" style=\"display:none\" width=\"1\">\n",
      "                                </img>\n",
      "                               </noscript>\n",
      "                              </link>\n",
      "                             </meta>\n",
      "                            </meta>\n",
      "                           </meta>\n",
      "                          </meta>\n",
      "                         </meta>\n",
      "                        </meta>\n",
      "                       </meta>\n",
      "                      </meta>\n",
      "                     </meta>\n",
      "                    </link>\n",
      "                   </link>\n",
      "                  </link>\n",
      "                 </link>\n",
      "                </link>\n",
      "               </link>\n",
      "              </link>\n",
      "             </link>\n",
      "            </link>\n",
      "           </link>\n",
      "          </link>\n",
      "         </link>\n",
      "        </link>\n",
      "       </link>\n",
      "      </link>\n",
      "     </link>\n",
      "    </link>\n",
      "   </meta>\n",
      "  </meta>\n",
      " </head>\n",
      " <body class=\"body_posts body_show\" data-gvcfv=\"true\" data-gvmfv=\"true\" data-jsid=\"posts/show\" data-sec0=\"bus\" data-sec1=\"\" data-sec2=\"posts\" viewport=\"fixed\">\n",
      "  <h1 class=\"semantic\">\n",
      "   Mashable\n",
      "  </h1>\n",
      "  <header id=\"flyout-container\">\n",
      "  </header>\n",
      "  <div id=\"peek\">\n",
      "   <div id=\"sticky\">\n",
      "    <div class=\"cookie-notice\">\n",
      "     <div class=\"wrap\">\n",
      "      We're using cookies to improve your experience.\n",
      "      <a class=\"cta\" href=\"/cookie-policy/\">\n",
      "       Click Here to find out more.\n",
      "      </a>\n",
      "      <div class=\"dismiss\">\n",
      "      </div>\n",
      "     </div>\n",
      "    </div>\n",
      "    <header id=\"site-header\">\n",
      "     <div class=\"navbar\">\n",
      "      <div class=\"navbar-inner\">\n",
      "       <ul class=\"inline main-menu nav us\">\n",
      "        <li class=\"menu\">\n",
      "         <a class=\"icon-reorder\" href=\"#\">\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"logo us\">\n",
      "         <a class=\"brand\" data-turbo-target=\"body-container\" href=\"/\">\n",
      "          <span>\n",
      "           Mashable\n",
      "          </span>\n",
      "          <img alt=\"Header_logo.v2.us\" class=\"light\" src=\"http://rack.3.mshcdn.com/assets/header_logo.v2.us-52e68666fbc19a6f91648a6aec2a4209.png\"/>\n",
      "          <img alt=\"Header_logo.v2.us.dark\" class=\"dark\" src=\"http://rack.1.mshcdn.com/assets/header_logo.v2.us.dark-9f775fba3e1140cab3876dac5399dd28.png\"/>\n",
      "         </a>\n",
      "         <div class=\"geos-content\">\n",
      "          <a class=\"geo\" href=\"?geo=AS&amp;utm_cid=mash-prod-nav-geo\" onclick='$.cookie(\"geo\",\"AS\")'>\n",
      "           Mashable Asia\n",
      "          </a>\n",
      "          <a class=\"geo\" href=\"?geo=AU&amp;utm_cid=mash-prod-nav-geo\" onclick='$.cookie(\"geo\",\"AU\")'>\n",
      "           Mashable Australia\n",
      "          </a>\n",
      "          <a class=\"geo\" href=\"http://mashable.france24.com/?ns_campaign=mashablefr&amp;ns_source=mashnav\">\n",
      "           Mashable France\n",
      "          </a>\n",
      "          <a class=\"geo\" href=\"?geo=IN&amp;utm_cid=mash-prod-nav-geo\" onclick='$.cookie(\"geo\",\"IN\")'>\n",
      "           Mashable India\n",
      "          </a>\n",
      "          <a class=\"geo\" href=\"?geo=GB&amp;utm_cid=mash-prod-nav-geo\" onclick='$.cookie(\"geo\",\"GB\")'>\n",
      "           Mashable UK\n",
      "          </a>\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"submenu collapsable pull-right\" id=\"sign-in\">\n",
      "         <a href=\"/login/\">\n",
      "          <span>\n",
      "           Sign in\n",
      "          </span>\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"follow submenu follow-menu pull-right\">\n",
      "         <a class=\"follow-trigger\" href=\"/follow-mashable/\">\n",
      "          <span class=\"fb\">\n",
      "          </span>\n",
      "          <span class=\"tw\">\n",
      "          </span>\n",
      "          <span class=\"gp\">\n",
      "          </span>\n",
      "         </a>\n",
      "         <div class=\"dropdown-menu pull-right social-badges\">\n",
      "          <ul>\n",
      "           <li class=\"facebook-container\">\n",
      "            <a class=\"social-stub social-share facebook like\" data-default=\"1\" data-href=\"http://facebook.com/mashable\" data-shares=\"2.4m\">\n",
      "             Like\n",
      "            </a>\n",
      "           </li>\n",
      "           <li>\n",
      "            <a class=\"twitter-follow-button\" data-dnt=\"true\" data-show-count=\"true\" data-show-screen-name=\"false\" href=\"https://twitter.com/mashable\">\n",
      "             Follow\n",
      "            </a>\n",
      "           </li>\n",
      "           <li class=\"linked-in\">\n",
      "            <script data-counter=\"right\" data-id=\"200000\" type=\"IN/FollowCompany\">\n",
      "            </script>\n",
      "           </li>\n",
      "           <li>\n",
      "            <a class=\"social-stub social-share google_plus follow\" data-shares=\"7.1m\" href=\"https://plus.google.com/+Mashable/auto\" target=\"_blank\">\n",
      "             Follow\n",
      "            </a>\n",
      "           </li>\n",
      "           <li>\n",
      "            <iframe allowtransparency=\"true\" border=\"0\" frameborder=\"0\" height=\"20\" id=\"tmblrFollowBtn\" scrolling=\"no\" width=\"100\">\n",
      "            </iframe>\n",
      "           </li>\n",
      "           <li>\n",
      "            <div class=\"pinterest\">\n",
      "             <a data-pin-do=\"buttonFollow\" href=\"http://www.pinterest.com/Mashable/\">\n",
      "              Mashable\n",
      "             </a>\n",
      "            </div>\n",
      "           </li>\n",
      "           <li>\n",
      "            <iframe id=\"mkFollowBtn\" scrolling=\"no\" seamless=\"seamless\" style=\"border:none; height: 26px\" width=\"145\">\n",
      "            </iframe>\n",
      "           </li>\n",
      "           <li>\n",
      "            <a alt=\"RSS Feed\" class=\"rss\" href=\"http://feeds.mashable.com/Mashable\" title=\"RSS Feed\">\n",
      "            </a>\n",
      "            <a alt=\"Email Subscriptions\" class=\"email\" href=\"/subscriptions\" title=\"Email Subscriptions\">\n",
      "            </a>\n",
      "            <div class=\"more\">\n",
      "             <a href=\"/follow-mashable\">\n",
      "              see more  &gt;\n",
      "             </a>\n",
      "            </div>\n",
      "           </li>\n",
      "          </ul>\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"nav-search submenu pull-right\">\n",
      "         <a class=\"search-trigger\" href=\"/search/\">\n",
      "          Search\n",
      "         </a>\n",
      "         <div class=\"dropdown-content\">\n",
      "          <div class=\"page-container\">\n",
      "           <div class=\"header-search-form\">\n",
      "            <form accept-charset=\"UTF-8\" action=\"/search/\" method=\"get\">\n",
      "             <div style=\"margin:0;padding:0;display:inline\">\n",
      "              <input name=\"utf8\" type=\"hidden\" value=\"✓\"/>\n",
      "             </div>\n",
      "             <div class=\"ie-search-wrapper\">\n",
      "              <input autocomplete=\"off\" class=\"header-search\" id=\"q\" name=\"q\" type=\"text\" value=\"\"/>\n",
      "             </div>\n",
      "             <input class=\"btn btn-primary header-search-submit\" name=\"commit\" type=\"submit\" value=\"Search\"/>\n",
      "            </form>\n",
      "            <div class=\"header-search-results\">\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel\" data-channel=\"Videos\" data-tags=\"\">\n",
      "         <a href=\"/videos/?utm_cid=mash-prod-nav-ch\">\n",
      "          Videos\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Social Media\" data-tags=\"how-to,facebook,twitter,youtube,google-plus\">\n",
      "         <a href=\"/social-media/?utm_cid=mash-prod-nav-ch\">\n",
      "          Social Media\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Tech\" data-tags=\"apps-software,dev-design,gadgets,mobile,cars\">\n",
      "         <a href=\"/tech/?utm_cid=mash-prod-nav-ch\">\n",
      "          Tech\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Business\" data-tags=\"advertising,marketing,media,small-business,startups,jobs\">\n",
      "         <a href=\"/business/?utm_cid=mash-prod-nav-ch\">\n",
      "          Business\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Entertainment\" data-tags=\"film,gaming,music,sports,television\">\n",
      "         <a href=\"/entertainment/?utm_cid=mash-prod-nav-ch\">\n",
      "          Entertainment\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"World\" data-tags=\"us,climate,retronaut,space,australia,uk,social-good\">\n",
      "         <a href=\"/world/?utm_cid=mash-prod-nav-ch\">\n",
      "          World\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Lifestyle\" data-tags=\"family-parenting,fashion,health-fitness,home,travel,work-and-play,food\">\n",
      "         <a href=\"/lifestyle/?utm_cid=mash-prod-nav-ch\">\n",
      "          Lifestyle\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel submenu\" data-channel=\"Watercooler\" data-tags=\"pics,memes,comics,conversations,videos-watercooler\">\n",
      "         <a href=\"/watercooler/?utm_cid=mash-prod-nav-ch\">\n",
      "          Watercooler\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "         </div>\n",
      "        </li>\n",
      "        <li class=\"collapsable channel\" data-channel=\"Shop\" data-tags=\"\">\n",
      "         <a href=\"http://shop.mashable.com?utm_source=mashable&amp;utm_medium=nav\">\n",
      "          Shop\n",
      "         </a>\n",
      "        </li>\n",
      "        <li class=\"submenu more\">\n",
      "         <a href=\"#\">\n",
      "          <!-- %span=t \"header.nav.more\" -->\n",
      "          <span>\n",
      "           More\n",
      "          </span>\n",
      "         </a>\n",
      "         <div class=\"submenu-content\">\n",
      "          <div class=\"page-container\">\n",
      "           <ul class=\"columns\">\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Channels\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/videos/\">\n",
      "                Videos\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/social-media/\">\n",
      "                Social Media\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/tech/\">\n",
      "                Tech\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/business/\">\n",
      "                Business\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/entertainment/\">\n",
      "                Entertainment\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/world/\">\n",
      "                World\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/lifestyle/\">\n",
      "                Lifestyle\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/watercooler/\">\n",
      "                Watercooler\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://shop.mashable.com?utm_source=mashable&amp;utm_medium=nav\">\n",
      "                Shop\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Company\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/about/\">\n",
      "                About Us\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://www.wrightsmedia.com/sites/mashable/\">\n",
      "                Licensing &amp; Reprints\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://mashable.com/2014/\">\n",
      "                Archive\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://mashable.theresumator.com/\">\n",
      "                Mashable Careers\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Contact\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/contact-us/\">\n",
      "                Contact Us\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/submit/\">\n",
      "                Submit News\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Advertise\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/advertise/\">\n",
      "                Advertise\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Legal\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/privacy/\">\n",
      "                Privacy Policy\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/terms/\">\n",
      "                Terms of Use\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/cookie-policy/\">\n",
      "                Cookie Policy\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Apps\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"https://itunes.apple.com/us/app/mashable/id910775754?mt=8\">\n",
      "                iPhone / iPad\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"https://play.google.com/store/apps/details?id=com.mashable.android.phoenix\">\n",
      "                Android\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Resources\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"/follow-mashable/\">\n",
      "                Subscriptions\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "            <li>\n",
      "             <ul class=\"column-list\">\n",
      "              <li class=\"header\">\n",
      "               Sites\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://shop.mashable.com?utm_source=mashable&amp;utm_medium=nav\">\n",
      "                Mashable Shop\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://findjobs.mashable.com\">\n",
      "                Job Board\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://mashable.com/sgs/\">\n",
      "                Social Good Summit\n",
      "               </a>\n",
      "              </li>\n",
      "              <li>\n",
      "               <a href=\"http://mashable.com/media-summit/\">\n",
      "                Media Summit\n",
      "               </a>\n",
      "              </li>\n",
      "             </ul>\n",
      "            </li>\n",
      "           </ul>\n",
      "          </div>\n",
      "         </div>\n",
      "        </li>\n",
      "       </ul>\n",
      "      </div>\n",
      "     </div>\n",
      "    </header>\n",
      "   </div>\n",
      "   <div id=\"scrollable\">\n",
      "    <div class=\"loader\">\n",
      "    </div>\n",
      "    <div class=\"ad_container ad-slot\" data-overrides='{\"targeting\":{\"tile\":3,\"adnum\":3,\"sec0\":\"bus\",\"sec1\":\"\",\"sec2\":\"posts\",\"gvcfv\":\"true\",\"gvmfv\":\"true\"}}' data-type=\"survey\">\n",
      "    </div>\n",
      "    <header class=\"box970\">\n",
      "     <div class=\"page-container\">\n",
      "      <center class=\"visible-desktop\">\n",
      "       <div class=\"ad_container ad-slot\" data-overrides='{\"targeting\":{\"tile\":4,\"adnum\":1,\"sec0\":\"bus\",\"sec1\":\"\",\"sec2\":\"posts\",\"gvcfv\":\"true\",\"gvmfv\":\"true\"}}' data-type=\"banner\">\n",
      "       </div>\n",
      "      </center>\n",
      "     </div>\n",
      "    </header>\n",
      "    <div class=\"posts show\" id=\"body-container\">\n",
      "     <div id=\"main\">\n",
      "      <div class=\"page-container\">\n",
      "       <div id=\"body\">\n",
      "        <img height=\"0\" id=\"bluekai-test-img\" src=\"http://mashable.com/favicon-16x16.png?bk_uuid=$_BK_UUID&amp;BK_SWAP_DEST=19275\" width=\"0\">\n",
      "         <hgroup class=\"page-header channel\" data-channel=\"business\" data-section=\"sec0=bus&amp;sec1=index&amp;sec2=\" id=\"post-head\">\n",
      "          <h2>\n",
      "           Business\n",
      "          </h2>\n",
      "          <div class=\"follow-channel\">\n",
      "           <div class=\"follow-buttons\">\n",
      "            <a class=\"social-stub social-share facebook like\" data-default=\"1\" data-href=\"http://facebook.com/mashable\" data-shares=\"1.7m\">\n",
      "             Like\n",
      "            </a>\n",
      "            <a class=\"social-stub social-share twitter follow\" data-shares=\"3.7m\" href=\"https://twitter.com/intent/follow?region=follow_link&amp;screen_name=mashable&amp;tw_p=followbutton&amp;variant=2.0\" target=\"_blank\">\n",
      "             Follow\n",
      "            </a>\n",
      "            <a class=\"social-stub social-share google_plus follow\" data-shares=\"7.1m\" href=\"https://plus.google.com/+Mashable/auto\" target=\"_blank\">\n",
      "             Follow\n",
      "            </a>\n",
      "           </div>\n",
      "          </div>\n",
      "         </hgroup>\n",
      "         <div class=\"flex-box\">\n",
      "          <div class=\"box-cell\">\n",
      "           <div class=\"above_960 adsense outside_post\">\n",
      "            <script>\n",
      "             if(typeof(google_num_ads) != \"undefined\") google_skip = google_num_ads;\n",
      "  google_ad_client = \"pub-9942038924324175\";\n",
      "  if($('.adsense').last().filter('.above_960').length > 0 && $(document).width() < 960){\n",
      "    var hideAd = true;\n",
      "  }else{\n",
      "    var hideAd = false;\n",
      "  }\n",
      "            </script>\n",
      "            <script>\n",
      "             if(!hideAd) google_ad_slot = \"3991492827\";\n",
      "            </script>\n",
      "            <script>\n",
      "             if(!hideAd) google_ad_width = 728;\n",
      "            </script>\n",
      "            <script>\n",
      "             if(!hideAd) google_ad_height = 15;\n",
      "            </script>\n",
      "            <script src=\"http://pagead2.googlesyndication.com/pagead/show_ads.js\">\n",
      "            </script>\n",
      "           </div>\n",
      "           <div id=\"post-content\">\n",
      "            <div id=\"post-slider\">\n",
      "             <article class=\"blueprint full post\" data-bp-id=\"1701\" data-channel=\"bus\" data-id=\"56ddae2c97b2f85d280011f7\" data-subchannels=\"\" data-topic=\"\" data-velocity=\"906,904,903,901,899,897,896,893,891,890,888,887,886,884,883,882,881,879,878,877,876,875,874,873,872,871,870,869,868,867,866,865,864,863,862,861,861,860,859,858,857,857,856,855,854,854,853,852,852,851\" id=\"story\">\n",
      "              <header class=\"article-header\">\n",
      "               <h1 class=\"title\" href=\"http://mashable.com/2016/03/07/apple-ebook-case/\">\n",
      "                The Supreme Court smacked down Apple today\n",
      "               </h1>\n",
      "               <aside class=\"shares social\">\n",
      "                <div class=\"total-shares\" data-index=\"0\">\n",
      "                 <em>\n",
      "                  4.9k\n",
      "                 </em>\n",
      "                 <div class=\"caption\">\n",
      "                  Shares\n",
      "                 </div>\n",
      "                </div>\n",
      "                <div class=\"share-buttons\">\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share facebook\" data-image=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-shares=\"1134\" data-title=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"#\">\n",
      "                   Share\n",
      "                  </a>\n",
      "                 </div>\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share twitter\" data-shares=\"1062\" data-tweet-text=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"https://twitter.com/intent/tweet?original_referer=http://mashable.com/&amp;source=tweetbutton&amp;text=The+Supreme+Court+smacked+down+Apple+today&amp;url=http%3A%2F%2Fmashable.com%2F2016%2F03%2F07%2Fapple-ebook-case%2F&amp;via=mashable\">\n",
      "                   Tweet\n",
      "                  </a>\n",
      "                 </div>\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share google_plus\" data-image=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-shares=\"16\" data-title=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"#\">\n",
      "                   Share\n",
      "                  </a>\n",
      "                 </div>\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share linked_in\" data-image=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-shares=\"1579\" data-title=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"#\">\n",
      "                  </a>\n",
      "                 </div>\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share stumble_upon\" data-image=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-shares=\"1145\" data-title=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"#\">\n",
      "                  </a>\n",
      "                 </div>\n",
      "                 <div class=\"share-button-boxy\">\n",
      "                  <a class=\"social-stub social-share pinterest\" data-image=\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\" data-shares=\"1\" data-title=\"The Supreme Court smacked down Apple today\" data-uid=\"rr\" href=\"#\">\n",
      "                  </a>\n",
      "                 </div>\n",
      "                </div>\n",
      "                <div class=\"velocity-graph tooltip-trigger\" title=\"The Mashable Velocity graph shows how quickly people are sharing this article on the social Web.\">\n",
      "                 <canvas class=\"velocity\">\n",
      "                 </canvas>\n",
      "                 <div class=\"caption\">\n",
      "                  What's This?\n",
      "                 </div>\n",
      "                </div>\n",
      "               </aside>\n",
      "               <div class=\"above_960 adsense\">\n",
      "                <script>\n",
      "                 if(typeof(google_num_ads) != \"undefined\") google_skip = google_num_ads;\n",
      "  google_ad_client = \"pub-9942038924324175\";\n",
      "  if($('.adsense').last().filter('.above_960').length > 0 && $(document).width() < 960){\n",
      "    var hideAd = true;\n",
      "  }else{\n",
      "    var hideAd = false;\n",
      "  }\n",
      "                </script>\n",
      "                <script>\n",
      "                 if(!hideAd) google_ad_channel = \"9077376301\";\n",
      "                </script>\n",
      "                <script>\n",
      "                 if(!hideAd) google_ad_output = \"js\";\n",
      "                </script>\n",
      "                <script>\n",
      "                 if(!hideAd) google_max_num_ads = \"3\";\n",
      "                </script>\n",
      "                <script>\n",
      "                 if(!hideAd) google_ad_type = \"text\";\n",
      "                </script>\n",
      "                <script>\n",
      "                 if(!hideAd) google_feedback = \"on\";\n",
      "                </script>\n",
      "                <script src=\"http://pagead2.googlesyndication.com/pagead/show_ads.js\">\n",
      "                </script>\n",
      "               </div>\n",
      "               <figure class=\"article-image\">\n",
      "                <img alt=\"Steve_jobs\" class=\"microcontent\" data-fragment=\"lead-image\" data-image=\"/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNDkwZjQuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/e59645b9/bf2/steve_jobs.jpg\" data-micro=\"1\" data-url=\"null\" src=\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNDkwZjQuanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/e59645b9/bf2/steve_jobs.jpg\"/>\n",
      "                <figcaption class=\"image-caption\">\n",
      "                 Apple Inc. Chairman and CEO Steve Jobs stands under images of the iPad 2, left, and the iPad at an Apple event at the Yerba Buena Center for the Arts Theater in San Francisco, Wednesday, March 2, 2011.\n",
      "                </figcaption>\n",
      "                <div class=\"image-credit\">\n",
      "                 Image:  Jeff Chiu/AP Photo\n",
      "                </div>\n",
      "               </figure>\n",
      "               <div class=\"article-info\">\n",
      "                <a class=\"byline \" href=\"/people/seth-fiegerman/\">\n",
      "                 <img alt=\"Headshot_2015_sethfiegerman_1\" class=\"author_image\" src=\"http://rack.3.mshcdn.com/media/ZgkyMDE1LzA2LzE2LzBjL0hlYWRzaG90XzIwLjkzNDQxLmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/43e49f19/5ff/Headshot_2015_SethFiegerman_1.jpg\"/>\n",
      "                 <div class=\"author_and_date\">\n",
      "                  <span class=\"author_name\">\n",
      "                   By Seth Fiegerman\n",
      "                  </span>\n",
      "                  <time datetime=\"Mon, 07 Mar 2016 16:36:45 +0000\">\n",
      "                   2016-03-07 16:36:45 UTC\n",
      "                  </time>\n",
      "                 </div>\n",
      "                </a>\n",
      "               </div>\n",
      "              </header>\n",
      "              <section class=\"article-content blueprint\">\n",
      "               <div class=\"post-text\">\n",
      "                <p>\n",
      "                 Apple's long and controversial ebook case has reached its final chapter — and it's not the happy ending the company wanted.\n",
      "                </p>\n",
      "                <p>\n",
      "                 The Supreme Court on Monday\n",
      "                 <a href=\"http://www.supremecourt.gov/orders/courtorders/030716zor_5h26.pdf\" target=\"_blank\">\n",
      "                  rejected\n",
      "                 </a>\n",
      "                 an appeal filed by Apple to overturn a stinging ruling that it led a broad conspiracy with several major publishers to\n",
      "                 <a href=\"http://mashable.com/2013/07/10/apple-ebooks-antitrust-trial-ruling/\">\n",
      "                  fix the price of e-books\n",
      "                 </a>\n",
      "                 sold through its online bookstore.\n",
      "                </p>\n",
      "                <p>\n",
      "                 The court's decision means Apple now has no choice but to pay out $400 million to consumers and an additional $50 million in legal fees, according to the original settlement in 2014.\n",
      "                </p>\n",
      "                <div class=\"see-also move-option\" contenteditable=\"false\">\n",
      "                 <p>\n",
      "                  SEE ALSO:\n",
      "                  <a data-crackerjax=\"#post-slider\" href=\"http://mashable.com/2016/03/07/apple-fbi-tech-backers/\">\n",
      "                   Here's how Apple marshalled the entire tech industry in its fight with the FBI\n",
      "                  </a>\n",
      "                 </p>\n",
      "                </div>\n",
      "                <p>\n",
      "                 For Apple, the final verdict is more damaging to its reputation as a consumer-friendly brand, not to mention t\n",
      "                 <span style=\"line-height: 1.5;\">\n",
      "                  he legacy of its beloved founder Steve Jobs, than to its actual bottom line.\n",
      "                 </span>\n",
      "                </p>\n",
      "                <p>\n",
      "                 To put the fine in context, the total $450 million payout is equal to about a little more than half the sales Apple generates on average each day, based on the $75.9 billion in revenue it reported in the most recent quarter.\n",
      "                </p>\n",
      "                <p>\n",
      "                 The price-fixing episode dates back to late 2009, just ahead of the original iPad launch. Apple and its founder, recognizing that books would likely be a big selling point of the tablet, began courting what were then the big five book publishers.\n",
      "                </p>\n",
      "                <p>\n",
      "                 In a series of e-mails, later\n",
      "                 <a href=\"https://www.documentcloud.org/documents/702951-email-exchange-between-steve-jobs-and-james.html\" target=\"_blank\">\n",
      "                  released\n",
      "                 </a>\n",
      "                 by the U.S. government, Jobs personally persuaded publishing industry executives to re-think the flat $9.99 e-book pricing previously imposed by Amazon, then (and now) the giant of the e-book world.\n",
      "                </p>\n",
      "                <p>\n",
      "                 \"All the major publishers tell us that Amazon’s $9.99 price for new releases is eroding the value perception of their products in customer’s minds, and they do not want this practice to continue for new releases.\" Jobs wrote in one email to James Murdoch, an executive at News Corp, which owns Harper Collins.\n",
      "                </p>\n",
      "                <figure class=\"image\">\n",
      "                 <p>\n",
      "                  <img class=\"\" data-caption=\"An email Apple CEO Steve Jobs sent to News Corp exec James Murdoch.\" data-credit-name=\"screengrab, mashable\" data-credit-provider=\"custom type\" data-width=\"413\" src=\"http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzA3L2RiL1NjcmVlbl9TaG90Ljc3YjJmLnBuZwpwCXRodW1iCTEyMDB4OTYwMD4/efaa3b47/5e7/Screen_Shot_2016-03-07_at_10.58.38_AM.png\"/>\n",
      "                 </p>\n",
      "                 <figcaption class=\"image-caption\">\n",
      "                  <p>\n",
      "                   An email Apple CEO Steve Jobs sent to News Corp exec James Murdoch.\n",
      "                  </p>\n",
      "                 </figcaption>\n",
      "                 <div class=\"image-credit\">\n",
      "                  <p>\n",
      "                   Image:  screengrab,  mashable\n",
      "                  </p>\n",
      "                 </div>\n",
      "                </figure>\n",
      "                <p>\n",
      "                 The major publishers, unhappy about the unfavorable terms they'd agreed to with Amazon, signed on to Apple's plan and later used the new competition to pressure Amazon into changing its own pricing structure.\n",
      "                </p>\n",
      "                <p>\n",
      "                 While some in the publishing industry argued this move helped break up Amazon's potential monopoly on the market, the U.S. government accused Apple and the five publishers of colluding to keep prices high.\n",
      "                </p>\n",
      "                <p>\n",
      "                 The publishers — Hachette, HarperCollins, Macmillan, Penguin and Simon &amp; Schuster — all settled with the Department of Justice before going to trial.\n",
      "                </p>\n",
      "                <p>\n",
      "                 Only Apple, armed with the unwavering belief in its own rightness, argued the case in the courts.\n",
      "                </p>\n",
      "                <p>\n",
      "                 \"We are ready to distribute the court-mandated settlement funds to Kindle customers as soon as we’re instructed to move forward,\" a spokesperson for Amazon said in a statement provided to\n",
      "                 <i>\n",
      "                  Mashable\n",
      "                 </i>\n",
      "                 .\n",
      "                </p>\n",
      "                <p>\n",
      "                 Reps for Apple did not immediately respond to our request for comment on the Supreme Court decision. However, a company statement after its big loss in court in 2013 says it all.\n",
      "                </p>\n",
      "                <p>\n",
      "                 \"When we introduced the iBookstore in 2010, we gave customers more choice, injecting much needed innovation and competition into the market, breaking Amazon's monopolistic grip on the publishing industry,\" Apple said in\n",
      "                 <a data-crackerjax=\"#post-slider\" href=\"http://mashable.com/2013/07/10/apple-ebooks-antitrust-trial-ruling/\">\n",
      "                  a statement\n",
      "                 </a>\n",
      "                 at the time. \"We've done nothing wrong.\"\n",
      "                </p>\n",
      "                <p>\n",
      "                 The U.S. courts have once again determined otherwise.\n",
      "                </p>\n",
      "                <p contenteditable=\"false\">\n",
      "                 <em>\n",
      "                  Have something to add to this story? Share it in the comments.\n",
      "                 </em>\n",
      "                </p>\n",
      "               </div>\n",
      "              </section>\n",
      "              <div class=\"fb-quote\">\n",
      "              </div>\n",
      "              <section class=\"branded-content\">\n",
      "              </section>\n",
      "              <footer class=\"article-topics\">\n",
      "               Topics:\n",
      "               <a href=\"/category/business/\">\n",
      "                Business\n",
      "               </a>\n",
      "              </footer>\n",
      "              <footer>\n",
      "               <div class=\"image-credit\">\n",
      "                Image:  Jeff Chiu/AP Photo\n",
      "               </div>\n",
      "              </footer>\n",
      "              <div id=\"outbrain-container\">\n",
      "               <div class=\"OUTBRAIN\" data-ob-template=\"mashable\" data-src=\"http://mashable.com/2016/03/07/apple-ebook-case/\" data-widget-id=\"AR_5\">\n",
      "               </div>\n",
      "              </div>\n",
      "              <div data-display-daily-newsletter=\"show\" id=\"newsletter-signup\">\n",
      "              </div>\n",
      "              <script>\n",
      "               if(window.pageChanged)\n",
      "    window.omni({\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true});\n",
      "    metaData = {\"link\":[[\"canonical\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"image_src\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/0637f519/fe9/steve_jobs.jpg\"]],\"meta_property\":[[\"og:url\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"og:title\",\"The Supreme Court smacked down Apple today\"],[\"og:type\",\"article\"],[\"og:site_name\",\"Mashable\"],[\"og:description\",\"The courts have thrown the book at Apple.\"],[\"og:image\",\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\"],[\"og:article:published_time\",\"2016-03-07T16:36:45Z\"],[\"og:article:modified_time\",\"2016-03-26T01:15:00Z\"],[\"og:article:publisher\",\"https://www.facebook.com/mashable\"]],\"meta_name\":[[\"description\",\"The courts have thrown the book at Apple.\"],[\"keywords\",\"business\"],[\"twitter:title\",\"The Supreme Court smacked down Apple today\"],[\"twitter:description\",\"The courts have thrown the book at Apple.\"],[\"twitter:image\",\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/86e9c4e4/fe9/steve_jobs.jpg\"],[\"twitter:site\",\"@mashable\"],[\"twitter:via\",\"mashable\"],[\"twitter:url\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"twitter:creator\",\"@mashable\"],[\"twitter:card\",\"photo\"],[\"twitter:image:width\",\"560\"],[\"twitter:image:height\",\"750\"],[\"date\",\"2016-03-07 16:36:45 UTC\"],[\"sailthru.author\",\"Seth Fiegerman\"],[\"sailthru.image.thumb\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/0aa6585a/d86/steve_jobs.jpg\"],[\"sailthru.image.full\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/540eb111/d86/steve_jobs.jpg\"],[\"sailthru.lead_image\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/b032d381/d86/steve_jobs.jpg\"],[\"sailthru.secondary_image\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/911cba2d/d86/steve_jobs.jpg\"],[\"sailthru.exclude_homepage\",false],[\"sailthru.exclude_uk\",false],[\"sailthru.exclude_australia\",false],[\"sailthru.exclude_india\",false],[\"author\",\"Seth Fiegerman\"]],\"short_url\":[[\"short_url\",\"http://on.mash.to/1U7CZrk\"]]};\n",
      "              </script>\n",
      "              <div class=\"right_rail_replace\">\n",
      "               <div class=\"ad_container ad-slot\" data-overrides='{\"targeting\":{\"tile\":1,\"adnum\":1,\"sec0\":\"bus\",\"sec1\":\"\",\"sec2\":\"posts\",\"gvcfv\":\"true\",\"gvmfv\":\"true\"}}' data-type=\"no_right_rail\">\n",
      "               </div>\n",
      "              </div>\n",
      "             </article>\n",
      "            </div>\n",
      "            <div class=\"article-comments limit-comments\">\n",
      "             <div data-article-id=\"56ddae2c97b2f85d280011f7\" data-checksum=\"8005f9801e392d59d950f072dbd26637\" data-collection-meta=\"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJ0aXRsZSI6IlRoZSBTdXByZW1lIENvdXJ0IHNtYWNrZWQgZG93biBBcHBsZSB0b2RheSIsInVybCI6Imh0dHA6Ly9tYXNoYWJsZS5jb20vMjAxNi8wMy8wNy9hcHBsZS1lYm9vay1jYXNlLyIsInRhZ3MiOiJidXNpbmVzcyIsImNoZWNrc3VtIjoiODAwNWY5ODAxZTM5MmQ1OWQ5NTBmMDcyZGJkMjY2MzciLCJhcnRpY2xlSWQiOiI1NmRkYWUyYzk3YjJmODVkMjgwMDExZjcifQ.6AhYXcgmd252BHA0KRnlwgXERfODXXccpZ5hvZaP-Dg\" data-network=\"mashable.fyre.co\" data-root=\"zor.livefyre.com\" data-site-id=\"312274\" id=\"livefyre_comments\">\n",
      "             </div>\n",
      "             <a class=\"btn btn-light load-comments\" href=\"#\">\n",
      "              Load Comments\n",
      "             </a>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "          <aside class=\"box-cell sidebar\">\n",
      "           <div class=\"ad sidebar-inset sidebar-drop\">\n",
      "            <div class=\"ad_container ad-slot\" data-overrides='{\"targeting\":{\"tile\":2,\"adnum\":1,\"sec0\":\"bus\",\"sec1\":\"\",\"sec2\":\"posts\",\"gvcfv\":\"true\",\"gvmfv\":\"true\"}}' data-type=\"right_rail\">\n",
      "            </div>\n",
      "           </div>\n",
      "           <h1 class=\"ribbon hot\">\n",
      "            What's Hot\n",
      "           </h1>\n",
      "           <div class=\"sidebar-inset\" id=\"big-stories\">\n",
      "           </div>\n",
      "          </aside>\n",
      "         </div>\n",
      "         <div id=\"more-in-channel\">\n",
      "          <div class=\"page-header channel\" data-channel=\"business\" data-section=\"sec0=bus&amp;sec1=index&amp;sec2=\">\n",
      "           <h2>\n",
      "            More in Business\n",
      "           </h2>\n",
      "          </div>\n",
      "          <div class=\"fixable-wrapper\" id=\"column-headers\">\n",
      "           <div class=\"column-headers\">\n",
      "            <div class=\"headers\">\n",
      "             <div class=\"header column1 waypoint\" data-fixselector=\"header.fixable\">\n",
      "              <a data-short=\"New\" href=\"#\">\n",
      "               <em>\n",
      "                What's New\n",
      "               </em>\n",
      "              </a>\n",
      "             </div>\n",
      "             <div class=\"header column2 waypoint\" data-fixselector=\"header.fixable\">\n",
      "              <a data-short=\"Rising\" href=\"#\">\n",
      "               <em>\n",
      "                What's Rising\n",
      "               </em>\n",
      "              </a>\n",
      "             </div>\n",
      "             <div class=\"header column3 waypoint\" data-fixselector=\"header.fixable\">\n",
      "              <a data-short=\"Hot\" href=\"#\">\n",
      "               <em>\n",
      "                What's Hot\n",
      "               </em>\n",
      "              </a>\n",
      "             </div>\n",
      "            </div>\n",
      "           </div>\n",
      "          </div>\n",
      "          <div class=\"slide-window\">\n",
      "           <div class=\"flex-box columns\">\n",
      "            <section class=\"column box-cell new-stories\" id=\"column-new\">\n",
      "             <h1 class=\"semantic\">\n",
      "              What's New\n",
      "             </h1>\n",
      "             <div class=\"column-content\">\n",
      "             </div>\n",
      "            </section>\n",
      "            <section class=\"column box-cell hot-stories\" id=\"column-rising\">\n",
      "             <h1 class=\"semantic\">\n",
      "              What's Rising\n",
      "             </h1>\n",
      "             <div class=\"column-content\">\n",
      "             </div>\n",
      "            </section>\n",
      "            <section class=\"column box-cell big-stories\" id=\"column-hot\">\n",
      "             <h1 class=\"semantic\">\n",
      "              What's Hot\n",
      "             </h1>\n",
      "             <div class=\"column-content\">\n",
      "             </div>\n",
      "            </section>\n",
      "           </div>\n",
      "          </div>\n",
      "         </div>\n",
      "         <script>\n",
      "          (function(){\n",
      "    loadScriptAsync(\"//platform.twitter.com/oct.js\", \"twitteroct\")\n",
      "    var timer;\n",
      "    timer = every(500, function() {\n",
      "      if ((typeof twttr !== \"undefined\" && twttr !== null) && (twttr.conversion != null)) {\n",
      "        clearInterval(timer);\n",
      "        return twttr.conversion.trackPid('l4o6d');\n",
      "      }\n",
      "    });\n",
      "  }());\n",
      "         </script>\n",
      "         <noscript>\n",
      "          <img alt=\"\" height=\"1\" src=\"https://analytics.twitter.com/i/adsct?txn_id=l4o6d&amp;p_id=Twitter\" style=\"display:none;\" width=\"1\">\n",
      "           <img alt=\"\" height=\"1\" src=\"//t.co/i/adsct?txn_id=l4o6d&amp;p_id=Twitter\" style=\"display:none;\" width=\"1\">\n",
      "           </img>\n",
      "          </img>\n",
      "         </noscript>\n",
      "        </img>\n",
      "       </div>\n",
      "      </div>\n",
      "     </div>\n",
      "     <div id=\"fb-root\">\n",
      "     </div>\n",
      "     <script>\n",
      "      if(window.initPage) { window.initPage() }\n",
      "  else { $(function() { window.initPage(); })}\n",
      "     </script>\n",
      "    </div>\n",
      "    <footer id=\"site-footer-wrapper\">\n",
      "     <div class=\"page-container\" id=\"site-footer\">\n",
      "      <ul class=\"nav\">\n",
      "       <li>\n",
      "        <a href=\"/about/\">\n",
      "         About Us\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"http://findjobs.mashable.com\">\n",
      "         Jobs\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/advertise/\">\n",
      "         Advertise\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/2011/05/09/connect-with-mashable/\">\n",
      "         Subscribe\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/privacy/\">\n",
      "         Privacy\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a href=\"/terms/\">\n",
      "         Terms\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "      <ul class=\"social\">\n",
      "       <li>\n",
      "        <a class=\"facebook\" href=\"http://www.facebook.com/mashable/\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"twitter\" href=\"https://twitter.com/mashable\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"gplus\" href=\"https://plus.google.com/+Mashable\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"rss\" href=\"http://feeds.mashable.com/Mashable\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"pinterest\" href=\"http://pinterest.com/mashable/\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"youtube\" href=\"http://www.youtube.com/user/mashable\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"stumbleupon\" href=\"http://www.stumbleupon.com/channel/Mashable\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "       <li>\n",
      "        <a class=\"linkedin\" href=\"http://www.linkedin.com/today/mashable.com\" target=\"_social\">\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "      <div class=\"about\">\n",
      "       <a class=\"brand\" href=\"/\">\n",
      "        Mashable\n",
      "       </a>\n",
      "       <span class=\"blurb\">\n",
      "        is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its dedicated and influential audience around the globe.\n",
      "       </span>\n",
      "      </div>\n",
      "      <ul class=\"copyright-and-legal\">\n",
      "       <li>\n",
      "        ©2005-2016\n",
      "Mashable, Inc.\n",
      "       </li>\n",
      "       <li>\n",
      "        Reproduction without explicit permission is prohibited. All Rights Reserved.\n",
      "       </li>\n",
      "       <li>\n",
      "        Designed in collaboration with\n",
      "        <a href=\"http://www.codeandtheory.com\" rel=\"nofollow\">\n",
      "         Code &amp; Theory\n",
      "        </a>\n",
      "       </li>\n",
      "      </ul>\n",
      "     </div>\n",
      "    </footer>\n",
      "    <noscript>\n",
      "     <img src=\"http://b.scorecardresearch.com/p?c1=2&amp;c2=8750086&amp;cv=2.0&amp;cj=1\">\n",
      "     </img>\n",
      "    </noscript>\n",
      "   </div>\n",
      "  </div>\n",
      "  <script>\n",
      "   window.detectStaffEditableLink();\n",
      "  </script>\n",
      " </body>\n",
      "</html>\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from bs4 import BeautifulSoup\n",
    "soup = BeautifulSoup(html, 'html.parser')\n",
    "\n",
    "print(soup.prettify())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Page title"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'The Supreme Court smacked down Apple today'"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title = soup.title.string\n",
    "title"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Author name"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<span class=\"author_name\">By Seth Fiegerman</span>]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author = soup.find_all(\"span\", { \"class\" : \"author_name\"})\n",
    "author"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<span class=\"author_name\">By Seth Fiegerman</span>]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# If author is empty try this:\n",
    "if author == []:\n",
    "    author = soup.find_all(\"span\", { \"class\" : \"byline basic\"})\n",
    "author"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['[<span class=\"author_name\"', 'By Seth Fiegerman</span', ']']"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "str(author).split('>')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'By Seth Fiegerman</span'"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author = str(author).split('>')[1]\n",
    "author"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Seth Fiegerman</span'"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author = author.split('By ')[1]\n",
    "author"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Seth Fiegerman'"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author = author.split('<')[0]\n",
    "author"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Total ranks"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<div class=\"total-shares\" data-index=\"0\">\n",
       " <em>4.9k</em>\n",
       " <div class=\"caption\">Shares</div>\n",
       " </div>]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "shares = soup.find_all(\"div\", { \"class\" : \"total-shares\"})\n",
    "shares"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'4.9k'"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "shares = str(shares).split('<em>')[1].split('</em>')[0]\n",
    "shares"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'4900'"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "if 'k' in shares:\n",
    "    shares = shares[:-1]\n",
    "    shares = shares.replace('.', '') + '00'\n",
    "shares"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Author webpage"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<a class=\"byline \" href=\"/people/seth-fiegerman/\"><img alt=\"Headshot_2015_sethfiegerman_1\" class=\"author_image\" src=\"http://rack.3.mshcdn.com/media/ZgkyMDE1LzA2LzE2LzBjL0hlYWRzaG90XzIwLjkzNDQxLmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/43e49f19/5ff/Headshot_2015_SethFiegerman_1.jpg\"/><div class=\"author_and_date\"><span class=\"author_name\">By Seth Fiegerman</span><time datetime=\"Mon, 07 Mar 2016 16:36:45 +0000\">2016-03-07 16:36:45 UTC</time></div></a>]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author_web = soup.find_all(\"a\", { \"class\" : \"byline\"})\n",
    "author_web"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'/people/seth-fiegerman/\"><img alt=\"Headshot_2015_sethfiegerman_1\" class=\"author_image\" src=\"http://rack.3.mshcdn.com/media/ZgkyMDE1LzA2LzE2LzBjL0hlYWRzaG90XzIwLjkzNDQxLmpwZwpwCXRodW1iCTkweDkwIwplCWpwZw/43e49f19/5ff/Headshot_2015_SethFiegerman_1.jpg\"/><div class=\"author_and_date\"><span class=\"author_name\">By Seth Fiegerman</span><time datetime=\"Mon, 07 Mar 2016 16:36:45 +0000\">2016-03-07 16:36:45 UTC</time></div></a>]'"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "if author_web != []:\n",
    "    author_web = str(author_web).split('href=\"')[1]\n",
    "author_web"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'/people/seth-fiegerman/'"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "if author_web != []:\n",
    "    author_web = author_web.split('\">')[0]\n",
    "author_web"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'http://mashable.com/people/seth-fiegerman/'"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "if author_web != []:\n",
    "    author_web = 'http://mashable.com' + author_web\n",
    "author_web"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get news text"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  window.__o = {\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true};\n",
      "  window._gaq = window._gaq || [];\n",
      "  window._gaq.push(['_setAccount', 'UA-92124-1']);\n",
      "  window._geo = \"US\";\n",
      "  window.__domStart = (new Date().getTime())\n",
      "\n",
      "The Supreme Court smacked down Apple today\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "{\"@context\":\"http://schema.org\",\"headline\":\"The Supreme Court smacked down Apple today\",\"url\":\"http://mashable.com/2016/03/07/apple-ebook-case/\",\"image\":\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/0637f519/fe9/steve_jobs.jpg\",\"keywords\":[\"business\"],\"@type\":\"Article\",\"dateCreated\":\"2016-03-07T16:36:45Z\",\"datePublished\":\"2016-03-07T16:36:45Z\",\"articleSection\":\"business\",\"creator\":\"Seth Fiegerman\",\"author\":\"Seth Fiegerman\",\"mainEntityOfPage\":\"True\",\"metadata\":{\"page\":1,\"omnitureData\":{\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true},\"postId\":null}}\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "!function(f,b,e,v,n,t,s){if(f.fbq)return;n=f.fbq=function(){n.callMethod?\n",
      "n.callMethod.apply(n,arguments):n.queue.push(arguments)};if(!f._fbq)f._fbq=n;\n",
      "n.push=n;n.loaded=!0;n.version='2.0';n.queue=[];t=b.createElement(e);t.async=!0;\n",
      "t.src=v;s=b.getElementsByTagName(e)[0];s.parentNode.insertBefore(t,s)}(window,\n",
      "document,'script','//connect.facebook.net/en_US/fbevents.js');\n",
      "fbq('init', '1453039084979896');\n",
      "fbq('track', \"PageView\");\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Mashable\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "We're using cookies to improve your experience.\n",
      "Click Here to find out more.\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Mashable\n",
      "\n",
      "Mashable Asia\n",
      "Mashable Australia\n",
      "Mashable France\n",
      "Mashable India\n",
      "Mashable UK\n",
      "\n",
      "Sign in\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Like\n",
      "\n",
      "\n",
      "\n",
      "Follow\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Follow\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Mashable\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "see more  >\n",
      "\n",
      "\n",
      "\n",
      "Search\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Videos\n",
      "Social Media\n",
      "Tech\n",
      "Business\n",
      "Entertainment\n",
      "World\n",
      "Lifestyle\n",
      "Watercooler\n",
      "Shop\n",
      "\n",
      "More\n",
      "\n",
      "\n",
      "Channels\n",
      "Videos\n",
      "Social Media\n",
      "Tech\n",
      "Business\n",
      "Entertainment\n",
      "World\n",
      "Lifestyle\n",
      "Watercooler\n",
      "Shop\n",
      "CompanyAbout UsLicensing & ReprintsArchiveMashable Careers\n",
      "ContactContact UsSubmit News\n",
      "AdvertiseAdvertise\n",
      "LegalPrivacy PolicyTerms of UseCookie Policy\n",
      "AppsiPhone / iPadAndroid\n",
      "ResourcesSubscriptions\n",
      "SitesMashable ShopJob BoardSocial Good SummitMedia Summit\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Business\n",
      "\n",
      "\n",
      "Like\n",
      "Follow\n",
      "Follow\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  if(typeof(google_num_ads) != \"undefined\") google_skip = google_num_ads;\n",
      "  google_ad_client = \"pub-9942038924324175\";\n",
      "  if($('.adsense').last().filter('.above_960').length > 0 && $(document).width() < 960){\n",
      "    var hideAd = true;\n",
      "  }else{\n",
      "    var hideAd = false;\n",
      "  }\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_slot = \"3991492827\";\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_width = 728;\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_height = 15;\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "The Supreme Court smacked down Apple today\n",
      "\n",
      "\n",
      "4.9k\n",
      "Shares\n",
      "\n",
      "\n",
      "Share\n",
      "Tweet\n",
      "Share\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "What's This?\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  if(typeof(google_num_ads) != \"undefined\") google_skip = google_num_ads;\n",
      "  google_ad_client = \"pub-9942038924324175\";\n",
      "  if($('.adsense').last().filter('.above_960').length > 0 && $(document).width() < 960){\n",
      "    var hideAd = true;\n",
      "  }else{\n",
      "    var hideAd = false;\n",
      "  }\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_channel = \"9077376301\";\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_output = \"js\";\n",
      "\n",
      "\n",
      "  if(!hideAd) google_max_num_ads = \"3\";\n",
      "\n",
      "\n",
      "  if(!hideAd) google_ad_type = \"text\";\n",
      "\n",
      "\n",
      "  if(!hideAd) google_feedback = \"on\";\n",
      "\n",
      "\n",
      "\n",
      "Apple Inc. Chairman and CEO Steve Jobs stands under images of the iPad 2, left, and the iPad at an Apple event at the Yerba Buena Center for the Arts Theater in San Francisco, Wednesday, March 2, 2011.Image:  Jeff Chiu/AP Photo\n",
      "By Seth Fiegerman2016-03-07 16:36:45 UTC\n",
      "\n",
      "\n",
      "\n",
      "Apple's long and controversial ebook case has reached its final chapter — and it's not the happy ending the company wanted.\n",
      "The Supreme Court on Monday rejected an appeal filed by Apple to overturn a stinging ruling that it led a broad conspiracy with several major publishers to fix the price of e-books sold through its online bookstore.\n",
      "The court's decision means Apple now has no choice but to pay out $400 million to consumers and an additional $50 million in legal fees, according to the original settlement in 2014.\n",
      "SEE ALSO: Here's how Apple marshalled the entire tech industry in its fight with the FBI\n",
      "For Apple, the final verdict is more damaging to its reputation as a consumer-friendly brand, not to mention the legacy of its beloved founder Steve Jobs, than to its actual bottom line.\n",
      "To put the fine in context, the total $450 million payout is equal to about a little more than half the sales Apple generates on average each day, based on the $75.9 billion in revenue it reported in the most recent quarter.\n",
      "The price-fixing episode dates back to late 2009, just ahead of the original iPad launch. Apple and its founder, recognizing that books would likely be a big selling point of the tablet, began courting what were then the big five book publishers.\n",
      "In a series of e-mails, later released by the U.S. government, Jobs personally persuaded publishing industry executives to re-think the flat $9.99 e-book pricing previously imposed by Amazon, then (and now) the giant of the e-book world.\n",
      "\"All the major publishers tell us that Amazon’s $9.99 price for new releases is eroding the value perception of their products in customer’s minds, and they do not want this practice to continue for new releases.\" Jobs wrote in one email to James Murdoch, an executive at News Corp, which owns Harper Collins.\n",
      "\n",
      "An email Apple CEO Steve Jobs sent to News Corp exec James Murdoch.Image:  screengrab,  mashableThe major publishers, unhappy about the unfavorable terms they'd agreed to with Amazon, signed on to Apple's plan and later used the new competition to pressure Amazon into changing its own pricing structure.\n",
      "While some in the publishing industry argued this move helped break up Amazon's potential monopoly on the market, the U.S. government accused Apple and the five publishers of colluding to keep prices high.\n",
      "The publishers — Hachette, HarperCollins, Macmillan, Penguin and Simon & Schuster — all settled with the Department of Justice before going to trial. \n",
      "Only Apple, armed with the unwavering belief in its own rightness, argued the case in the courts. \n",
      "\"We are ready to distribute the court-mandated settlement funds to Kindle customers as soon as we’re instructed to move forward,\" a spokesperson for Amazon said in a statement provided to Mashable.\n",
      "Reps for Apple did not immediately respond to our request for comment on the Supreme Court decision. However, a company statement after its big loss in court in 2013 says it all. \n",
      "\"When we introduced the iBookstore in 2010, we gave customers more choice, injecting much needed innovation and competition into the market, breaking Amazon's monopolistic grip on the publishing industry,\" Apple said in a statement at the time. \"We've done nothing wrong.\"\n",
      "The U.S. courts have once again determined otherwise.\n",
      "Have something to add to this story? Share it in the comments.\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Topics:\n",
      "Business\n",
      "\n",
      "\n",
      "\n",
      "Image:  Jeff Chiu/AP Photo\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  if(window.pageChanged)\n",
      "    window.omni({\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":582.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.5,\"v_max\":1.8,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Seth Fiegerman\",\"age\":\"24\",\"pub_day\":7,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/07/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Alt Image Lead\",\"topics\":\"Business\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true});\n",
      "    metaData = {\"link\":[[\"canonical\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"image_src\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MjcjCmUJanBn/0637f519/fe9/steve_jobs.jpg\"]],\"meta_property\":[[\"og:url\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"og:title\",\"The Supreme Court smacked down Apple today\"],[\"og:type\",\"article\"],[\"og:site_name\",\"Mashable\"],[\"og:description\",\"The courts have thrown the book at Apple.\"],[\"og:image\",\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJMTIwMHg2MzAKZQlqcGc/fb6394a5/fe9/steve_jobs.jpg\"],[\"og:article:published_time\",\"2016-03-07T16:36:45Z\"],[\"og:article:modified_time\",\"2016-03-26T01:15:00Z\"],[\"og:article:publisher\",\"https://www.facebook.com/mashable\"]],\"meta_name\":[[\"description\",\"The courts have thrown the book at Apple.\"],[\"keywords\",\"business\"],[\"twitter:title\",\"The Supreme Court smacked down Apple today\"],[\"twitter:description\",\"The courts have thrown the book at Apple.\"],[\"twitter:image\",\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzI2LzY5L3N0ZXZlX2pvYnMuNmNmNjAuanBnCnAJdGh1bWIJNTYweDc1MAplCWpwZw/86e9c4e4/fe9/steve_jobs.jpg\"],[\"twitter:site\",\"@mashable\"],[\"twitter:via\",\"mashable\"],[\"twitter:url\",\"http://mashable.com/2016/03/07/apple-ebook-case/\"],[\"twitter:creator\",\"@mashable\"],[\"twitter:card\",\"photo\"],[\"twitter:image:width\",\"560\"],[\"twitter:image:height\",\"750\"],[\"date\",\"2016-03-07 16:36:45 UTC\"],[\"sailthru.author\",\"Seth Fiegerman\"],[\"sailthru.image.thumb\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMTE1eDExNSMKZQlqcGc/0aa6585a/d86/steve_jobs.jpg\"],[\"sailthru.image.full\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJOTUweDUzNCMKZQlqcGc/540eb111/d86/steve_jobs.jpg\"],[\"sailthru.lead_image\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJNjAweDMzOCMKZQlqcGc/b032d381/d86/steve_jobs.jpg\"],[\"sailthru.secondary_image\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzA3LzY5L3N0ZXZlX2pvYnMuMjRiMjguanBnCnAJdGh1bWIJMjg4eDE2MiMKZQlqcGc/911cba2d/d86/steve_jobs.jpg\"],[\"sailthru.exclude_homepage\",false],[\"sailthru.exclude_uk\",false],[\"sailthru.exclude_australia\",false],[\"sailthru.exclude_india\",false],[\"author\",\"Seth Fiegerman\"]],\"short_url\":[[\"short_url\",\"http://on.mash.to/1U7CZrk\"]]};\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Load Comments\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "What's Hot\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "More in Business\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "What's New\n",
      "\n",
      "\n",
      "What's Rising\n",
      "\n",
      "\n",
      "What's Hot\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "What's New\n",
      "What's Rising\n",
      "What's Hot\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  (function(){\n",
      "    loadScriptAsync(\"//platform.twitter.com/oct.js\", \"twitteroct\")\n",
      "    var timer;\n",
      "    timer = every(500, function() {\n",
      "      if ((typeof twttr !== \"undefined\" && twttr !== null) && (twttr.conversion != null)) {\n",
      "        clearInterval(timer);\n",
      "        return twttr.conversion.trackPid('l4o6d');\n",
      "      }\n",
      "    });\n",
      "  }());\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  if(window.initPage) { window.initPage() }\n",
      "  else { $(function() { window.initPage(); })}\n",
      "\n",
      "\n",
      "About UsJobsAdvertiseSubscribePrivacyTerms\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "Mashable\n",
      "\n",
      "is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for its dedicated and influential audience around the globe.\n",
      "\n",
      "\n",
      "\n",
      "©2005-2016\n",
      "Mashable, Inc.\n",
      "\n",
      "\n",
      "Reproduction without explicit permission is prohibited. All Rights Reserved.\n",
      "\n",
      "\n",
      "Designed in collaboration with Code & Theory\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "\n",
      "  window.detectStaffEditableLink();\n",
      "\n",
      "\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(soup.get_text())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "try:\n",
    "    text = str(soup.get_text()).split(\"UTC\\n\\n\\n\")[1]\n",
    "except IndexError:\n",
    "    text = str(soup.get_text()).split(\"Analysis\\n\\n\")[1]\n",
    "\n",
    "text = text.split('Have something to add to this story?')[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Apple's long and controversial ebook case has reached its final chapter — and it's not the happy ending the company wanted.\n",
      "The Supreme Court on Monday rejected an appeal filed by Apple to overturn a stinging ruling that it led a broad conspiracy with several major publishers to fix the price of e-books sold through its online bookstore.\n",
      "The court's decision means Apple now has no choice but to pay out $400 million to consumers and an additional $50 million in legal fees, according to the original settlement in 2014.\n",
      "SEE ALSO: Here's how Apple marshalled the entire tech industry in its fight with the FBI\n",
      "For Apple, the final verdict is more damaging to its reputation as a consumer-friendly brand, not to mention the legacy of its beloved founder Steve Jobs, than to its actual bottom line.\n",
      "To put the fine in context, the total $450 million payout is equal to about a little more than half the sales Apple generates on average each day, based on the $75.9 billion in revenue it reported in the most recent quarter.\n",
      "The price-fixing episode dates back to late 2009, just ahead of the original iPad launch. Apple and its founder, recognizing that books would likely be a big selling point of the tablet, began courting what were then the big five book publishers.\n",
      "In a series of e-mails, later released by the U.S. government, Jobs personally persuaded publishing industry executives to re-think the flat $9.99 e-book pricing previously imposed by Amazon, then (and now) the giant of the e-book world.\n",
      "\"All the major publishers tell us that Amazon’s $9.99 price for new releases is eroding the value perception of their products in customer’s minds, and they do not want this practice to continue for new releases.\" Jobs wrote in one email to James Murdoch, an executive at News Corp, which owns Harper Collins.\n",
      "\n",
      "An email Apple CEO Steve Jobs sent to News Corp exec James Murdoch.Image:  screengrab,  mashableThe major publishers, unhappy about the unfavorable terms they'd agreed to with Amazon, signed on to Apple's plan and later used the new competition to pressure Amazon into changing its own pricing structure.\n",
      "While some in the publishing industry argued this move helped break up Amazon's potential monopoly on the market, the U.S. government accused Apple and the five publishers of colluding to keep prices high.\n",
      "The publishers — Hachette, HarperCollins, Macmillan, Penguin and Simon & Schuster — all settled with the Department of Justice before going to trial. \n",
      "Only Apple, armed with the unwavering belief in its own rightness, argued the case in the courts. \n",
      "\"We are ready to distribute the court-mandated settlement funds to Kindle customers as soon as we’re instructed to move forward,\" a spokesperson for Amazon said in a statement provided to Mashable.\n",
      "Reps for Apple did not immediately respond to our request for comment on the Supreme Court decision. However, a company statement after its big loss in court in 2013 says it all. \n",
      "\"When we introduced the iBookstore in 2010, we gave customers more choice, injecting much needed innovation and competition into the market, breaking Amazon's monopolistic grip on the publishing industry,\" Apple said in a statement at the time. \"We've done nothing wrong.\"\n",
      "The U.S. courts have once again determined otherwise.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(text)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Author information"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"600\"\n",
       "            height=\"600\"\n",
       "            src=\"http://mashable.com/people/seth-fiegerman/\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.IFrame at 0x7fb3a5cd9f60>"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Only if author_web != []:\n",
    "from IPython.display import IFrame\n",
    "IFrame(author_web, 600, 600)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Binary features if author is on: Facebook, LinkedIn, Twitter, Google+"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "author_networks = {'facebo': '',\n",
    "                   'linked': '',\n",
    "                   'twitte': '',\n",
    "                   'google': ''}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "response = urllib.request.urlopen(author_web)\n",
    "html = response.read()\n",
    "soup = BeautifulSoup(html, 'html.parser')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get all the networks that the author is in"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<div class=\"profile-networks\">\n",
       " <a class=\"network-badge network-badge-facebook network-badge-round\" href=\"http://www.facebook.com/sfiegerman\" target=\"_blank\"></a>\n",
       " <a class=\"network-badge network-badge-linkedin network-badge-round\" href=\"http://www.linkedin.com/in/sfiegerman\" target=\"_blank\"></a>\n",
       " <a class=\"network-badge network-badge-round network-badge-twitter\" href=\"https://twitter.com/sfiegerman\" target=\"_blank\"></a>\n",
       " </div>]"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "networks = soup.find_all(\"div\", { \"class\" : \"profile-networks\"})\n",
    "networks"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'[<div class=\"profile-networks\">\\n<a class=\"network-badge network-badge-facebook \" href=\"http://www.facebook.com/sfiegerman\" target=\"_blank\"></a>\\n<a class=\"network-badge network-badge-linkedin \" href=\"http://www.linkedin.com/in/sfiegerman\" target=\"_blank\"></a>\\n<a class=\"network-badge  network-badge-twitter\" href=\"https://twitter.com/sfiegerman\" target=\"_blank\"></a>\\n</div>]'"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "networks = str(networks).replace('network-badge-round', '')\n",
    "networks"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['[<div class=\"profile-networks\">\\n<a class=\"network-badge ',\n",
       " 'facebook \" href=\"http://www.facebook.com/sfiegerman\" target=\"_blank\"></a>\\n<a class=\"network-badge ',\n",
       " 'linkedin \" href=\"http://www.linkedin.com/in/sfiegerman\" target=\"_blank\"></a>\\n<a class=\"network-badge  ',\n",
       " 'twitter\" href=\"https://twitter.com/sfiegerman\" target=\"_blank\"></a>\\n</div>]']"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "networks = networks.split('network-badge-')\n",
    "networks  # Note networks is now a list of strings"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "for network in networks:\n",
    "    if network[:6] in author_networks.keys():\n",
    "        author_networks[network[:6]] = network.split('href=\"')[1].split('\" target')[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'facebo': 'http://www.facebook.com/sfiegerman',\n",
       " 'google': '',\n",
       " 'linked': 'http://www.linkedin.com/in/sfiegerman',\n",
       " 'twitte': 'https://twitter.com/sfiegerman'}"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author_networks"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get number of twitter followers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://twitter.com/sfiegerman'"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "author_networks['twitter_followers'] = 0\n",
    "author_networks['twitte']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "response = urllib.request.urlopen(author_networks['twitte'])\n",
    "html = response.read()\n",
    "soup = BeautifulSoup(html, 'html.parser')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'<span class=\"ProfileNav-value\" data-is-compact=\"true\">14,2\\xa0mil</span>'"
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "followers = str(soup.find_all(\"span\", { \"class\" : \"ProfileNav-value\"})[2])\n",
    "followers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'14,2\\xa0mil</span>'"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "followers = followers.split('\">')[1]\n",
    "followers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "14200"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "if ('K' in followers) or ('mil' in followers):\n",
    "    followers = followers.split('\\xa0')[0]\n",
    "    if ',' in followers:\n",
    "        followers = followers.replace(',', '') + '00'\n",
    "    else:\n",
    "        followers = followers + '000'\n",
    "else:\n",
    "    followers = followers.split('</span')[0].replace('.', '')\n",
    "followers = int(followers)\n",
    "followers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "author_networks['twitter_followers'] = followers"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Merge everything into a function"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def news_info(url):\n",
    "    # Download HTML\n",
    "    response = urllib.request.urlopen(url_)\n",
    "    html = response.read()\n",
    "    soup = BeautifulSoup(html, 'html.parser')\n",
    "    \n",
    "    # Title, author, text\n",
    "    title = soup.title.string\n",
    "    \n",
    "    author = soup.find_all(\"span\", { \"class\" : \"author_name\"})\n",
    "    # If author is empty try this:\n",
    "    if author == []:\n",
    "        author = soup.find_all(\"span\", { \"class\" : \"byline basic\"})\n",
    "    author = str(author).split('>')[1].split('By ')[1].split('<')[0]\n",
    "    \n",
    "    # Number of shares\n",
    "    shares = soup.find_all(\"div\", { \"class\" : \"total-shares\"})\n",
    "    shares = str(shares).split('<em>')[1].split('</em>')[0]\n",
    "    if 'k' in shares:\n",
    "        shares = shares[:-1]\n",
    "        shares = shares.replace('.', '') + '00'\n",
    "    \n",
    "    # Get text\n",
    "    try:\n",
    "        text = str(soup.get_text()).split(\"UTC\\n\\n\\n\")[1]\n",
    "    except IndexError:\n",
    "        text = str(soup.get_text()).split(\"Analysis\\n\\n\")[1]\n",
    "        \n",
    "    text = text.split('Have something to add to this story?')[0]\n",
    "    \n",
    "    author_web = soup.find_all(\"a\", { \"class\" : \"byline\"})\n",
    "    if author_web != []:\n",
    "        author_web = 'http://mashable.com' + str(author_web).split('href=\"')[1].split('\">')[0]\n",
    "    \n",
    "        # Author networks\n",
    "        author_networks = {'facebo': '',\n",
    "                           'linked': '',\n",
    "                           'twitte': '',\n",
    "                           'google': ''}\n",
    "\n",
    "        response = urllib.request.urlopen(author_web)\n",
    "        html = response.read()\n",
    "        soup = BeautifulSoup(html, 'html.parser')\n",
    "\n",
    "        networks = str(soup.find_all(\"div\", { \"class\" : \"profile-networks\"})).replace('network-badge-round', '').split('network-badge-')\n",
    "\n",
    "        for network in networks:\n",
    "            if network[:6] in author_networks.keys():\n",
    "                author_networks[network[:6]] = network.split('href=\"')[1].split('\" target')[0]\n",
    "\n",
    "        # Author twitter followers\n",
    "        author_networks['twitter_followers'] = 0\n",
    "        if author_networks['twitte'] != '':\n",
    "\n",
    "            response = urllib.request.urlopen(author_networks['twitte'])\n",
    "            html = response.read()\n",
    "            soup = BeautifulSoup(html, 'html.parser')\n",
    "\n",
    "            followers = str(soup.find_all(\"span\", { \"class\" : \"ProfileNav-value\"})[2]).split('\">')[1]\n",
    "            if ('K' in followers) or ('mil' in followers):\n",
    "                followers = followers.split('\\xa0')[0]\n",
    "                if ',' in followers:\n",
    "                    followers = followers.replace(',', '') + '00'\n",
    "                else:\n",
    "                    followers = followers + '000'\n",
    "            else:\n",
    "                followers = followers.split('</span')[0].replace('.', '')\n",
    "\n",
    "            author_networks['twitter_followers'] = int(followers)\n",
    "        \n",
    "    else:\n",
    "        author_networks = {'facebo': '',\n",
    "                           'linked': '',\n",
    "                           'twitte': '',\n",
    "                           'google': '', \n",
    "                           'twitter_followers': 0}\n",
    "        \n",
    "    return {'title': title, 'author': author, 'shares': shares, \n",
    "            'author_web': author_web, 'text':text, \n",
    "            'author_networks': author_networks}\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'author': 'Yohana Desta',\n",
       " 'author_networks': {'facebo': '',\n",
       "  'google': 'https://plus.google.com/102665910331841447889?rel=author',\n",
       "  'linked': '',\n",
       "  'twitte': 'https://twitter.com/YohanaDesta',\n",
       "  'twitter_followers': 2991},\n",
       " 'author_web': 'http://mashable.com/people/yohana-desta/',\n",
       " 'shares': '762',\n",
       " 'text': '\\nFifty years later, the Who can still rule a crowd.\\nRoger Daltrey’s still got the howl and Pete Townshend can make the entirety of Madison Square Garden lose its mind over a swivel of his right arm. The band, currently on its 50th anniversary tour, packed Manhattan’s famed stadium on Wednesday night with thousands of fans eager to sing along to hits like “My Generation” and \"Won\\'t Get Fooled Again.\"\\xa0\\nThe show was even more celebratory because it was rescheduled from last fall, when Daltrey was diagnosed with viral meningitis. At the end of the show, he thanked the crowd for sticking around while he was \"really having a tough time with the reaper.\"\\n\"Here were are, still standing,\" he said with a grin.\\nSEE ALSO: Watch Lorde pay tribute to David Bowie (without an orange wig)\\n\\nRoger Daltrey at MSG on March 3.Image:  Theo Wargo/Getty Images)Joan Jett and the Blackhearts opened the show, warming up a crowd that was still filing in well into the set. Jett is still a well-oiled performer, hitting all the right notes and delivering classics like “I Love Rock ’n’ Roll” and “I Hate Myself for Loving You\" with her signature snarl.\\nBefore the Who took the stage, numerous messages were posted on the giant screen, including one dedicated to David Bowie, that read: \\n\"Tonight, we will distinctly miss David Bowie, longtime fan of the Who.\"\\n\"Tonight, we will distinctly miss David Bowie, longtime fan of the Who. He’s told the story of how he climbed the fence at London’s Roundhouse to sneak backstage and give Pete Townshend a copy of his new 1969 album, David Bowie. He covered \\'I Cant’ Explain\\' and \\'Anyway, Anyhow, Anywhere\\' on his Pinups album. Nearly every year at MSG, he sat in the first row right beside the stage. We’ll miss our friend, a true icon of music and art, and a brilliant innovator.”\\xa0\\n\\nlovely little tribute to David Bowie before the Who perform pic.twitter.com/2PEXOB5lv9\\n— black hermione (@YohanaDesta) March 4, 2016\\n\\nSoon after, the Who took the stage, launching right into performances of \"Who Are You,\" \"The Seeker\" and \"The Kids Are Alright.\"\\xa0\\nThen, Townshend grabbed the mic, telling an anecdote about how the band\\'s first show in the U.S. was in New York City, around 1967. However, the band wasn\\'t a hit straightaway.\\xa0\\n\"It took time for you f*ckin\\' Americans to catch up,\" he joked to uproarious laughter.\\xa0\\nAnd with that, the band went into \"I Can See for Miles\" and \"My Generation,\" the latter of which riled up the nostalgic, mostly older crowd. Speaking of nostalgia, lots of vintage footage and photographs served as the backdrop for different songs, amplifying the memory lane aspect of the tour.\\xa0\\n\\nthen & now pic.twitter.com/o3wp57V4aM\\n— black hermione (@YohanaDesta) March 4, 2016\\n\\nTownshend chatted with the crowd a bunch between songs, joking about how the Who weren\\'t always perceived as rock\\'n\\'roll.\\xa0\\n\"We were a boy band,\" he says. \"We had pop songs.\"\\nSo then he started playing \"Pictures of Lily,\" which he considers \"one of my favorite\" pop tracks.\\xa0\\nWhen it came to obvious fan favorites, songs like \"Behind Blue Eyes,\" \"Pinball Wizard\" and \"Teenage Wasteland\" ruled the night. However, the standout moments were the ones that allowed the band to flourish and flex some musical muscle.\\xa0\\n\\nPete Townshend of the Who performs at Madison Square Garden on March 3.Image:  Theo Wargo/Getty Images\"The Rock,\" an instrumental number that Daltrey called a favorite, was one such moment, an ever-expanding jam full of delicious guitar solos, coupled with an ever-changing array of backdrop footage, from photos of the Vietnam War, to newspaper headlines about John Lennon\\'s death, to footage of late drummer Keith Moon.\\xa0\\n\"Love, Reign O\\'er Me\" was also a masterful performance, opening with a keyboard solo and descending into an 8-minute rock journey, accented with Daltrey\\'s signature howls.\\xa0\\n\\nThey wrapped with (what else?) \"Baba O\\'Riley\" and \"Won\\'t Get Fooled Again.\"\\xa0\\nTownshend ended the night by introducing everyone in the band, dropping this funny little quip for drummer Zak Starkey.\\xa0\\n\"I hate all drummers, basically, but this one\\'s almost acceptable!\" he joked.\\xa0Starkey\\'s dad, Ringo Starr, would probably appreciate that.\\xa0\\nThen Daltrey took the mic so Townshend could get some applause for himself, then shared some choice parting words. \\xa0\\n\"Thanks for coming!\" Daltrey said. \"Be happy, be healthy ... [and] be lucky!\"\\xa0\\n',\n",
       " 'title': 'The Who’s 50th anniversary MSG show was a nostalgic Rock ’n’ Roll trip'}"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url_ = 'http://mashable.com/2016/03/04/the-who-50th-anniversary'\n",
    "news_info(url_)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'author': 'Davina Merchant',\n",
       " 'author_networks': {'facebo': '',\n",
       "  'google': 'https://plus.google.com/105525238342980116477?rel=author',\n",
       "  'linked': '',\n",
       "  'twitte': '',\n",
       "  'twitter_followers': 0},\n",
       " 'author_web': 'http://mashable.com/people/568bdab3519840193100211f/',\n",
       " 'shares': '7000',\n",
       " 'text': 'LONDON - Last month we reported on a dog-sized rabbit in desperate need of a new home — now just under a month later Atlas the rabbit now has a permanent home. \\nAfter his story went global people from all over the world, including the U.S., Canada and France started reaching out to the Scottish Society for the Prevention of Cruelty to Animals to re-home the rabbit.   \\nThanks to Jen Hislop from Ayrshire, the adorable bunny will get to stay in his native Scotland. \\n\\nHe even has a new buggy.Image: Facebook Scottish SPCAJen, a financial fraud investigator, told the charity, \"I burst into tears when I got the phone call saying I had been chosen to re-home Atlas and I cried again when I collected him.\" \\nThe 43-year-old, who previously had two giant bunnies, currently has a giant Rex rabbit named Coconut.\\nSee also: Dog-sized rabbit looking for home \\'still has growing to do\\'\\nAtlas new home has a summer house with heating and air-conditioning. He also has his own accommodation in a large garden enclosure as well as the run of the house.\\n\\nTo Jen, the rabbit was the perfect addition to her family and the only thing she changed about him was his name. Say hello to Atilla the Bun Binky Master Jazz Paws, but don\\'t worry you can call \"him Atty for short!\"\\n',\n",
       " 'title': 'Adorable dog-sized rabbit finally finds his forever home'}"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url_ = 'http://mashable.com/2016/03/08/scotland-giant-rabbit-home'\n",
    "news_info(url_)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'author': 'Scott Gerber',\n",
       " 'author_networks': {'facebo': '',\n",
       "  'google': '',\n",
       "  'linked': '',\n",
       "  'twitte': '',\n",
       "  'twitter_followers': 0},\n",
       " 'author_web': [],\n",
       " 'shares': '4900',\n",
       " 'text': 'Today\\'s digital marketing experts must have a diverse skill set, including a sophisticated grasp of available media channels, the ability to identify up-and-coming opportunities, on top of having the basic skills of a brilliant marketer. What\\'s more, they have to possess a balance of critical and creative thinking skills in order to drive measurable success for their company.\\nThat\\'s why I asked 15 members of Young Entrepreneur Council (YEC) what they look for when hiring digital marketers. Their best answers are below.\\n1. Paid social media advertising expertise\\n\\nA new digital marketing hire should be well-versed in paid social media advertising, especially through Facebook or a similar social platform that our company uses regularly. They need to be able to understand and implement Facebook analytics and insights, create \"lookalike\" and custom audiences, experiment and test creative campaign and images, and be secure in their knowledge of the overall social media landscape. There are many budget-saving opportunities within the social media advertising space, so we want to make sure that our digital marketing talent knows the ins and outs of this popular and easy-to-implement marketing space. \\n— Miles Jennings, Recruiter.com\\nSEE ALSO: Web developers, data scientists, AI experts: The 15 top tech roles of 2016\\n\\n2. Sales skills\\n\\nWe\\'ve hired many digital marketers over the years, both outsourced and in-house. What we\\'ve found is that people who have sold successfully are much better marketers. They know how to engage with people and turn them into sales opportunities. While your digital marketers may not be closing deals directly, they need to know how to sell or they\\'ll be wasting your valuable marketing dollars without generating qualified lead opportunities for your sales team. \\n— Mark Cenicola, BannerView.com\\n3. Specific marketing channel expertise \\n\\nI see so many marketers who extol the virtues of every conceivable marketing channel: email, SEO, SEM, social, etc. And many channels might work for you, but the key to a successful marketing strategy is focusing on a few channels and using them really well. Often that means understanding the dynamics of that marketing channel deeply and leveraging those dynamics for your specific company. For example, in helping local businesses, Pinterest is less interesting (although it\\'s one of the best drivers of ecommerce traffic). I\\'d much rather focus on the intricate tactics of local SEO to get a client to No. 1 on Google, Maps and Yelp.\\n— Trevor Sumner, LocalVox\\n4. The ability to think objectively \\n\\nMarketers are usually one of the most passionate workers in the office. However, that passion can often cloud the judgment and measurement of marketing theories and initiatives. A marketer who can separate themselves from their work will navigate with an objective eye that can focus on what actually works — not just what they hoped would work.\\n— Wesley Mathews, High Level Marketing\\n5. The ability to execute and analyze drip marketing campaigns\\n\\nInbound marketing is a key skill in driving lead generation. While many marketers can come up with an initial innovative engagement strategy or CPC campaign, what intrigues me more is how they examine the incoming data and create a robust drip marketing campaign. Great automation on these campaigns is not about sending the same email to the entire flock that the campaign gathers. It\\'s about personal, well-written communication that varies depending on the actions performed seven emails deep into the campaign. That\\'s a lot of variation, and requires an analytical mindset and strategic thinking. Exceptional marketing happens when the art of communication expands upon the fundamental science of conversion. \\n— Eran Eyal, Springleap \\nSEE ALSO: 11 things your startup should look for in a creative hire for 2016\\n\\n6. A mix of creativity and analytical abilities\\n\\nDigital marketing requires both creative thinking and analytical thinking, so we look for a candidate capable of and excited about both. Many new candidates want to focus purely on one or the other, but it\\'s important to bring \"art and science\" to each digital program. Digital marketing allows us to be very measurable — even for beautiful creative campaigns — using analytics to inform future strategies. \\n— Kayla Wagner Faires, Revel Interactive\\n7. Good copy and visual storytelling abilities \\n\\nDigital media is a copy- and visual-driven medium unlike any other before it. Our social heart is won over (or double clicked on) by copy that is relevant and visuals that pull on our emotional strings. The native understanding and ability to manipulate those two elements is critical in today\\'s digital marketing landscape. \\n— Alex Frias, Track Marketing Group\\n8. A likable personality\\n\\nRelationship building is such a huge component of digital marketing, and a likable personality can go a long way. With so many people trying to connect with publishers, bloggers, journalists and influencers, someone with a great personality will always stand out and command attention. If you are being pitched by two similar people and one person is the equivalent to talking to a brick wall and the other person is outgoing and pleasant, who are you going to give your time to? The same applies to maintaining relationships — having a likable personality plays such a huge role, yet it\\'s often overlooked. \\n— Jonathan Long, Market Domination Media\\nSEE ALSO: 14 mobile marketing trends that will dominate in 2016\\n\\n9. An understanding of WordPress\\n\\nWith so many platforms now built on WordPress, it is a vital technical tool to add to your toolbox. If you want to create and manage a blog or even a website, WordPress has become the go-to platform for digital marketers. It also helps to continually educate yourself on new plug-ins and functionality because WordPress is always offering something new and useful that speeds up content production. \\n— Angela Ruth, Due.com \\n10. Self-promotion savvy \\n\\nIf you\\'re telling me that you have a strong understanding of social media and leveraging brands, then it should be very easy for you to do the same with your own. My interviewees are their own first project, and I use information I can find on them to make my final decision. Something should come up when I search their names, preferably on all the same platforms that I want to use for my clients. Messaging and vis-a-vis skills should be consistent across most platforms, and some obvious care should be put into the presentation and expansion of each one.\\n— Adam Steele, The Magistrate\\n11. Understanding of brevity\\n\\nIt doesn\\'t matter how good your product is if you can\\'t communicate your value proposition to potential customers in fewer than 140 characters. Digital marketers must be efficient and effective with minimal messaging. \\n— Nicholas Haase, Loot!\\n12. The ability to analyze quantifiable metrics\\n\\nNow, more than ever, being able to quantify the value of investing in marketing and advertising is vital. The battle for supremacy in the marketplace is not won in whole percentage points any longer. It\\'s about making the right choices and moving the needle slightly forward at every opportunity. Digital marketing consultants need to possess the competencies and the general knowledge required to provide actionable metrics, and prove their value with real data. Gone are the days of guessing whether or not a campaign was effective based on simple sales numbers. In-page tracking, coupled with analytics and metrics software are the tools of the day for marketers, and we expect any new consultants or team members to be able to leverage those tools to ensure accuracy and efficacy.\\n— Blair Thomas, EMerchantBroker\\nSee also: Top 11 digital advertising strategies you should use for mobile\\n13. Listening skills\\n\\nAs a digital marketer, our ability to promote our services through words, images, video and social media are essential. Digital marketing also provides an opportunity for its specialists to listen to various groups of people, from clients to consumers, in new ways. Through social media and analytical tools, we can listen to our consumers\\' thoughts on a product, relevant issue or our own services. When I hire a digital marketer, I\\'ll see if they\\'ve sought to listen to consumer and client needs and create a solution from their own observations or insights. \\n— Shalyn Dever, Chatter Buzz\\n14. Agility\\n\\nAt least once a month a new platform pushes its way into relevancy, or a major platform adjusts its algorithm. If you\\'re/they\\'re operating on a methodology devised without flexibility, and/or aren\\'t the type of person to be able to react appropriately, you and your business will fall behind the curve and lose ground fast. \\n— Mickey Meyer, JASH\\n15. Basic design skills\\n\\nBeing able to communicate a message properly is extremely important. However, digital marketing involves more than just words. A large part of digital marketing is about visual appearance. Anyone who calls themselves a digital marketer should have at least some basic knowledge of HTML, CSS or Photoshop. \\n— Dan Sapozhnikov, AdGate Media\\nScott GerberScott Gerber is a serial entrepreneur, author (Never Get a \\'Real\\' Job), TV commentator and founder of Young Entrepreneur Council (YEC), an invite-only organization comprised of the world\\'s most promising young entrepreneur...More\\n\\n\\n\\nTopics:\\nBusiness, career advice, cover letter, digital marketing, job hunt, Jobs, Marketing, Media, resume, Social Media, Work & Play, yec\\n\\n\\n\\n\\n\\n\\n  if(window.pageChanged)\\n    window.omni({\"channel\":\"business\",\"content_type\":\"article\",\"v_buy\":null,\"v_buy_i\":null,\"h_pub\":502.0,\"h_buy\":null,\"h_pub_buy\":null,\"v_cur\":1.6,\"v_max\":1.6,\"v_cur_i\":1,\"v_max_i\":1,\"events\":\"event51,event61\",\"top_channel\":\"business\",\"content_source_type\":\"Internal\",\"content_source_name\":\"Internal\",\"author_name\":\"Scott Gerber\",\"age\":\"20\",\"pub_day\":8,\"pub_month\":3,\"pub_year\":2016,\"pub_date\":\"03/08/2016\",\"sourced_from\":\"Internal\",\"isPostView\":true,\"post_lead_type\":\"Default\",\"topics\":\"Business,career advice,cover letter,digital marketing,job hunt,Jobs,Marketing,Media,resume,Social Media,Uncategorized,Work &amp; Play,yec\",\"campaign\":null,\"display_mode\":null,\"viral_video_type\":null,\"b_flag\":true});\\n    metaData = {\"link\":[[\"canonical\",\"http://mashable.com/2016/03/08/15-skills-digital-marketers/\"],[\"image_src\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTEyMDB4NjI3IwplCWpwZw/58caab29/09e/DigtalMarketing.jpg\"]],\"meta_property\":[[\"og:url\",\"http://mashable.com/2016/03/08/15-skills-digital-marketers/\"],[\"og:title\",\"15 essential skills all digital marketing hires must have\"],[\"og:type\",\"article\"],[\"og:site_name\",\"Mashable\"],[\"og:description\",\"Your prospective employer expects you to know quite a bit as a digital marketer, so we\\'ve gathered 15 experts to tell you what they look for in a new hire.\"],[\"og:image\",\"http://rack.0.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTEyMDB4NjI3IwplCWpwZw/58caab29/09e/DigtalMarketing.jpg\"],[\"og:article:published_time\",\"2016-03-08T12:15:23Z\"],[\"og:article:modified_time\",\"2016-03-21T20:05:06Z\"],[\"og:article:publisher\",\"https://www.facebook.com/mashable\"]],\"meta_name\":[[\"description\",\"Your prospective employer expects you to know quite a bit as a digital marketer, so we\\'ve gathered 15 experts to tell you what they look for in a new hire.\"],[\"keywords\",\"social-media, job-hunt, resume, cover-letter, digital-marketing, uncategorized, yec, business, marketing, media\"],[\"twitter:title\",\"15 essential skills all digital marketing hires must have\"],[\"twitter:description\",\"Your prospective employer expects you to know quite a bit as a digital marketer, so we\\'ve gathered 15 media experts to tell you what they are looking for in new hires.\"],[\"twitter:image\",\"http://rack.2.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTU2MHg3NTAKZQlqcGc/ef5be11d/09e/DigtalMarketing.jpg\"],[\"twitter:site\",\"@mashable\"],[\"twitter:via\",\"mashable\"],[\"twitter:url\",\"http://mashable.com/2016/03/08/15-skills-digital-marketers/\"],[\"twitter:creator\",\"@mashable\"],[\"twitter:card\",\"photo\"],[\"twitter:image:width\",\"560\"],[\"twitter:image:height\",\"750\"],[\"date\",\"2016-03-08 12:15:23 UTC\"],[\"sailthru.author\",\"Scott Gerber\"],[\"sailthru.image.thumb\",\"http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTExNXgxMTUjCmUJanBn/b7eb7f95/09e/DigtalMarketing.jpg\"],[\"sailthru.image.full\",\"http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTk1MHg1MzQjCmUJanBn/bb6c93c0/09e/DigtalMarketing.jpg\"],[\"sailthru.lead_image\",\"http://rack.3.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTYwMHgzMzgjCmUJanBn/a229b3f9/09e/DigtalMarketing.jpg\"],[\"sailthru.secondary_image\",\"http://rack.1.mshcdn.com/media/ZgkyMDE2LzAzLzIxL2YxL0RpZ3RhbE1hcmtlLmJiZjI5LmpwZwpwCXRodW1iCTI4OHgxNjIjCmUJanBn/107c6caa/09e/DigtalMarketing.jpg\"],[\"sailthru.exclude_homepage\",false],[\"sailthru.exclude_uk\",false],[\"sailthru.exclude_australia\",false],[\"sailthru.exclude_india\",false],[\"author\",\"Scott Gerber\"]],\"short_url\":[[\"short_url\",\"http://on.mash.to/21hRMQD\"]]};\\n\\n\\n\\n\\n\\n\\n\\n\\nLoad Comments\\n\\n\\n\\n\\n\\n\\n\\nWhat\\'s Hot\\n\\n\\n\\n\\n\\nMore in Business\\n\\n\\n\\n\\n\\nWhat\\'s New\\n\\n\\nWhat\\'s Rising\\n\\n\\nWhat\\'s Hot\\n\\n\\n\\n\\n\\nWhat\\'s New\\nWhat\\'s Rising\\nWhat\\'s Hot\\n\\n\\n\\n\\n  (function(){\\n    loadScriptAsync(\"//platform.twitter.com/oct.js\", \"twitteroct\")\\n    var timer;\\n    timer = every(500, function() {\\n      if ((typeof twttr !== \"undefined\" && twttr !== null) && (twttr.conversion != null)) {\\n        clearInterval(timer);\\n        return twttr.conversion.trackPid(\\'l4o6d\\');\\n      }\\n    });\\n  }());\\n\\n\\n\\n\\n\\n\\n\\n\\n  if(window.initPage) { window.initPage() }\\n  else { $(function() { window.initPage(); })}\\n\\n\\nAbout UsJobsAdvertiseSubscribePrivacyTerms\\n\\n\\n\\n\\n\\n\\n\\n\\n\\nMashable\\n\\nis a leading global media company that informs, inspires and entertains the digital generation. Mashable is redefining storytelling by documenting and shaping the digital revolution in a new voice, new formats and cutting-edge technologies to a uniquely dedicated audience of 45 million monthly unique visitors and 27 million social followers.\\n\\n\\n\\n©2005-2016\\nMashable, Inc.\\n\\n\\nReproduction without explicit permission is prohibited. All Rights Reserved.\\n\\n\\nDesigned in collaboration with Code & Theory\\n\\n\\n\\n\\n\\n\\n\\n\\n\\n  window.detectStaffEditableLink();\\n\\n\\n\\n',\n",
       " 'title': '15 essential skills all digital marketing hires must have'}"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url_ = 'http://mashable.com/2016/03/08/15-skills-digital-marketers'\n",
    "news_info(url_)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'author': 'Rebecca Ruiz',\n",
       " 'author_networks': {'facebo': '',\n",
       "  'google': '',\n",
       "  'linked': '',\n",
       "  'twitte': 'https://twitter.com/rebecca_ruiz',\n",
       "  'twitter_followers': 3734},\n",
       " 'author_web': 'http://mashable.com/people/rebecca-ruiz/',\n",
       " 'shares': '1400',\n",
       " 'text': 'Analysis\\n\\n\\n\\n\\n\\nThere is a reason that\\xa0Donald Trump\\'s\\xa0outrageous statements and behavior feel familiar to many women.\\xa0\\nIt\\'s not because they know his declarative style and trademark shrug from reality television or political debates. Nor is it because his outsized role in American business made an unforgettable impression on them.\\nSEE ALSO: As Donald Trump targets women, Republicans say he could cost the party everything\\nThe eerie familiarity is more personal than that. They know Trump because they\\'ve encountered a man like him at home, work, on social media or in a relationship.\\xa0\\nThis man extols the virtues of women, but has no problem reducing them to sex objects. He casts himself as unflappable, but blames a woman when his weaknesses are revealed. He insists on personal responsibility, but denies, deflects and perhaps even turns violent when accused of wrongdoing.\\xa0\\n\\nThe media is so after me on women  Wow, this is a tough business. Nobody has more respect for women than Donald Trump!\\n— Donald J. Trump (@realDonaldTrump) March 26, 2016\\n\\nThe psychological warfare of gaslighting, a subtle form of emotional abuse that puts the victim on the defensive, is his go-to strategy.\\xa0\\xa0\\xa0\\xa0\\nThis is not how Trump sees himself or his actions, but it is arguably the image he projects to voters.\\xa0On Tuesday, when Florida police charged his campaign manager, Corey Lewandowski, with battery of a female reporter, Trump issued a series of tweets refuting the video evidence, discrediting the journalist and implying she could have been a dangerous or deadly threat.\\xa0\\n\\nWow, Corey Lewandowski, my campaign manager and a very decent man, was just charged with assaulting a reporter. Look at tapes-nothing there!\\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\\n\\nPowerful women on the left and right forcefully criticized Trump\\'s reaction to the charges. \\n“Too often victims of violence and abuse stay silent, and Donald Trump’s remarks today demonstrate one of the reasons why,\" Dawn Laguens, executive vice president of the Planned Parenthood Action Fund, said in a statement. \"His actions today underscore that it is a fiction that he has been or would be supportive of any woman in this country.\"\\n\\nThis was the reporters statement- when she found out there was tape from my facility, she changed her tune. pic.twitter.com/N5815RS1At\\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\\n\\n\\nWhy is this reporter touching me as I leave news conference? What is in her hand?? pic.twitter.com/HQB8dl0fhn\\n— Donald J. Trump (@realDonaldTrump) March 29, 2016\\n\\nOn Wednesday, a group of conservative female journalists and commentators called for Lewandowski\\'s firing.\\nTrump has a track record of making his female targets — and their defenders — seem like the foolish ones.\\n\\nNichole Bauer, assistant professor in the political science department at the University of Alabama, says the response was classic Trump. He\\'s practiced at denying previous statements even when\\xa0incontrovertible\\xa0evidence of them exists. While this isn\\'t exclusive to his commentary about women, Trump has a track record of making his female targets — and their defenders — seem like the foolish ones.\\xa0\\nOf course he wasn\\'t making a reference to menstruation when he joked about\\xa0Fox anchor Megyn Kelly having \"blood coming out of her wherever\" during a debate. And no, he most certainly did not use schlonged as a vulgar term when describing how badly Pres. Barack Obama beat Hillary Clinton in the 2008 Democratic presidential primary.\\xa0\\n\\nThe press is going out of their way to convince people that I do not like or respect women, when they know that it is just the opposite!\\n— Donald J. Trump (@realDonaldTrump) March 26, 2016\\n\\n\"There’s definitely an accepted belief among the Republican and Democratic mainstream that this sort of outmoded sexism that Donald Trump demonstrates has no real place in discourse,\" says Bauer.\\xa0\\nYet, instead of apologizing, or acknowledging how the woman in question — or any woman, for that matter — might find his remarks offensive, Trump doubled down and obfuscated reality.\\xa0\\nMany women have been here before, whether it\\'s with a coworker who denies the meaning of a sexist comment or a partner who is quick to end an argument by using the word emotional.\\xa0\\n...he\\'s telling women that they don\\'t deserve the same respect and agency as men.\\nTrump\\'s denials may make him appear unassailable to some, but to women they send an entirely different message, says Bauer. By denying the nature of his commentary and behavior, he\\'s telling women that they don\\'t deserve the same respect and agency as men.\\xa0\\nWhile Republican women tend to support traditional roles, Bauer says, they do so believing that deference to a male authority figure or husband is their choice. Trump\\'s faultless behavior effectively takes that autonomy away from them by creating a political climate in which the woman is always wrong.\\xa0\\nThis may\\xa0explain why he performed so poorly with Republican women in one recent survey. That\\xa0NBC/WSJ poll found that 47% of female Republican primary voters cannot see themselves voting for Trump. His favorability ratings were higher, at 59%, amongst registered Republican women in a\\xa0CNN/ORC poll, though it did not ask whether they intended to vote for him.\\n\\n\"@Don_Vito_08: \"A picture is worth a thousand words\" @realDonaldTrump #LyingTed #NeverCruz @MELANIATRUMP pic.twitter.com/5bvVEwMVF8\"\\n— Donald J. Trump (@realDonaldTrump) March 24, 2016\\n\\nThese polls also don\\'t fully reflect his\\xa0recent, unseemly attacks on Heidi Cruz, wife of his opponent Sen. Ted Cruz, or his statement on Wednesday that if abortion is banned, women who have one illegally should \"face some sort of punishment.\"\\xa0\\nThough Trump immediately clarified that comment as a response to a hypothetical question and then reversed his position, it\\'s clear that he\\'s not only willing to publicly embarrass and degrade women, but also consider\\xa0depriving them of physical\\xa0freedom.\\xa0\\nSuch power dynamics aren\\'t hypothetical to women in abusive workplaces or relationships, who cannot fathom a political reality that mirrors their private hell.\\xa0\\n\"People are doing it as a strategy to control others and elevate themselves and insulate themselves from attack.\"\\nJackie White, emerita professor of psychology and a senior research scientist at the Center for Women’s Health and Wellness at the University of North Carolina at Greensboro, says an approach that victimizes women and then blames them for playing a part in their degradation is about manipulation.\\xa0\\n\"People are doing it as a strategy to control others and elevate themselves and insulate themselves from attack,\" she says. \"They’re going to present themselves as a very self-assured, knowledgable person.\"\\xa0\\nMeanwhile, such behavior silences the victim. She may feel depressed, passive or paralyzed. Feelings of doubt and insecurity set in. Women know this experience well, says White.\\xa0\\nShe worries, however, that the tactics on display in the\\xa0campaign could send just as powerful a message to men as to women.\\xa0\\nTrump\\'s behavior may consciously or\\xa0subconsciously\\xa0lead some men to\\xa0endorse harmful stereotypes and engage in emotional manipulation, particularly if they feel threatened by social and demographic change and evolving gender roles.\\n\"[Trump\\'s] actions could inspire them to feel justified in clinging to what they see as their deserved elevated status,\" White says.\\xa0\\nThat\\'s what makes Donald Trump so dangerous. Even if he\\'s offering the public a performance, the fallout is unconscionable for both women and men.\\xa0\\n',\n",
       " 'title': 'Every woman has met a man like Donald Trump'}"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url_ = 'http://mashable.com/2016/03/31/donald-trump-gaslighting-women'\n",
    "news_info(url_)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.1"
  },
  "name": "_merged"
 },
 "nbformat": 4,
 "nbformat_minor": 0
}