Skip to content

Commit

Permalink
data(megafile): automated update
Browse files Browse the repository at this point in the history
  • Loading branch information
@owidbot
owidbot committed Sep 19, 2022
1 parent 0ef4343 commit 062ead3
Showing 1 changed file with 33 additions and 33 deletions.
66 changes: 33 additions & 33 deletions scripts/output/STATUS.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ This file shows the latest status of the data pipeline.
## Vaccinations
### Get (scraping)

`11/111` scripts failed, `20/111` were skipped. Latest update was `2022-09-19T07:04:52`.
`7/111` scripts failed, `20/111` were skipped. Latest update was `2022-09-19T09:44:26`.

<table border="1" class="dataframe">
<thead>
Expand All @@ -19,18 +19,11 @@ This file shows the latest status of the data pipeline.
</thead>
<tbody>
<tr>
<td>cowidev.vax.incremental.suriname</td>
<td>❌</td>
<td>2022-09-19T07:04:52</td>
<td>2.34</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/suriname.py", line 57, in main<br> data = read(source).pipe(pipeline)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/suriname.py", line 13, in read<br> with get_driver() as driver:<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 161, in get_driver<br> driver = webdriver.Chrome(options=options)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/chrome/webdriver.py", line 76, in __init__<br> RemoteWebDriver.__init__(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__<br> self.start_session(capabilities, browser_profile)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session<br> response = self.execute(Command.NEW_SESSION, parameters)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 103<br>Current browser version is 105.0.5195.102 with binary path /usr/bin/chromium-browser<br><br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.paho</td>
<td>cowidev.vax.incremental.macao</td>
<td>❌</td>
<td>2022-09-19T07:04:50</td>
<td>3.05</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 191, in main<br> PAHO().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 186, in export<br> df = self.read().pipe(self.pipeline)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 37, in read<br> df = self._parse_data(url)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/paho.py", line 46, in _parse_data<br> with get_driver(download_folder=self._download_path) as driver:<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 161, in get_driver<br> driver = webdriver.Chrome(options=options)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/chrome/webdriver.py", line 76, in __init__<br> RemoteWebDriver.__init__(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__<br> self.start_session(capabilities, browser_profile)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session<br> response = self.execute(Command.NEW_SESSION, parameters)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 103<br>Current browser version is 105.0.5195.102 with binary path /usr/bin/chromium-browser<br><br></pre></details></td>
<td>2022-09-19T09:44:26</td>
<td>20.00</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 86, in main<br> Macao().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 72, in export<br> data = self.read()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 20, in read<br> elem = driver.find_element_by_partial_link_text("Daily Bulletin on COVID-19")<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 462, in find_element_by_partial_link_text<br> return self.find_element(by=By.PARTIAL_LINK_TEXT, value=link_text)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element<br> return self.execute(Command.FIND_ELEMENT, {<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"partial link text","selector":"Daily Bulletin on COVID-19"}<br> (Session info: headless chrome=105.0.5195.102)<br><br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.russia</td>
Expand All @@ -46,27 +39,6 @@ This file shows the latest status of the data pipeline.
<td>40.03</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn<br> conn = connection.create_connection(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/util/connection.py", line 96, in create_connection<br> raise err<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/util/connection.py", line 86, in create_connection<br> sock.connect(sa)<br>socket.timeout: timed out<br><br>During handling of the above exception, another exception occurred:<br><br>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connectionpool.py", line 699, in urlopen<br> httplib_response = self._make_request(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connectionpool.py", line 382, in _make_request<br> self._validate_conn(conn)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1010, in _validate_conn<br> conn.connect()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connection.py", line 358, in connect<br> conn = self._new_conn()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connection.py", line 179, in _new_conn<br> raise ConnectTimeoutError(<br>urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPSConnection object at 0x7fa95ab0c370>, 'Connection to vaccinare.gov.md timed out. (connect timeout=20)')<br><br>During handling of the above exception, another exception occurred:<br><br>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/adapters.py", line 440, in send<br> resp = conn.urlopen(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/connectionpool.py", line 755, in urlopen<br> retries = retries.increment(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/urllib3/util/retry.py", line 574, in increment<br> raise MaxRetryError(_pool, url, error or ResponseError(cause))<br>urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='vaccinare.gov.md', port=443): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa95ab0c370>, 'Connection to vaccinare.gov.md timed out. (connect timeout=20)'))<br><br>During handling of the above exception, another exception occurred:<br><br>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/moldova.py", line 59, in main<br> Moldova().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/moldova.py", line 54, in export<br> df = self.read().pipe(self.pipeline)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/moldova.py", line 17, in read<br> soup = get_soup(self.source_url)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 83, in get_soup<br> response = get_response(source, request_method, use_proxy, **kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 49, in get_response<br> raise err<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 43, in get_response<br> response = requests.get(source, **kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/api.py", line 75, in get<br> return request('get', url, params=params, **kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/api.py", line 61, in request<br> return session.request(method=method, url=url, **kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/sessions.py", line 529, in request<br> resp = self.send(prep, **send_kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/sessions.py", line 645, in send<br> r = adapter.send(request, **kwargs)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/requests/adapters.py", line 507, in send<br> raise ConnectTimeout(e, request=request)<br>requests.exceptions.ConnectTimeout: HTTPSConnectionPool(host='vaccinare.gov.md', port=443): Max retries exceeded with url: / (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa95ab0c370>, 'Connection to vaccinare.gov.md timed out. (connect timeout=20)'))<br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.macao</td>
<td>❌</td>
<td>2022-09-19T07:04:07</td>
<td>2.40</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 86, in main<br> Macao().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 72, in export<br> data = self.read()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/macao.py", line 16, in read<br> with get_driver() as driver:<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/utils/web/scraping.py", line 161, in get_driver<br> driver = webdriver.Chrome(options=options)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/chrome/webdriver.py", line 76, in __init__<br> RemoteWebDriver.__init__(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__<br> self.start_session(capabilities, browser_profile)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session<br> response = self.execute(Command.NEW_SESSION, parameters)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 103<br>Current browser version is 105.0.5195.102 with binary path /usr/bin/chromium-browser<br><br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.kazakhstan</td>
<td>❌</td>
<td>2022-09-19T07:04:04</td>
<td>2.50</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/kazakhstan.py", line 78, in main<br> Kazakhstan().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/kazakhstan.py", line 73, in export<br> df = self.read().pipe(self.pipeline)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/kazakhstan.py", line 17, in read<br> with webdriver.Chrome(options=op) as driver:<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/chrome/webdriver.py", line 76, in __init__<br> RemoteWebDriver.__init__(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__<br> self.start_session(capabilities, browser_profile)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session<br> response = self.execute(Command.NEW_SESSION, parameters)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 103<br>Current browser version is 105.0.5195.102 with binary path /usr/bin/chromium-browser<br><br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.dominican_republic</td>
<td>❌</td>
<td>2022-09-19T07:04:02</td>
<td>3.37</td>
<td><details><summary>show</summary><pre>Traceback (most recent call last):<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/cmd/commons/get.py", line 47, in run<br> module.main()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 108, in main<br> DominicanRepublic().export()<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 64, in export<br> data = self.read().pipe(self.pipeline)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/src/cowidev/vax/incremental/dominican_republic.py", line 23, in read<br> with webdriver.Chrome(options=op) as driver:<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/chrome/webdriver.py", line 76, in __init__<br> RemoteWebDriver.__init__(<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__<br> self.start_session(capabilities, browser_profile)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session<br> response = self.execute(Command.NEW_SESSION, parameters)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute<br> self.error_handler.check_response(response)<br> File "/mnt/owid_live_covid/covid-19-data/scripts/venv/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response<br> raise exception_class(message, screen, stacktrace)<br>selenium.common.exceptions.SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 103<br>Current browser version is 105.0.5195.102 with binary path /usr/bin/chromium-browser<br><br></pre></details></td>
</tr>
<tr>
<td>cowidev.vax.incremental.bangladesh</td>
<td>❌</td>
Expand Down Expand Up @@ -235,6 +207,34 @@ This file shows the latest status of the data pipeline.
<td>NaN</td>
<td></td>
</tr>
<tr>
<td>cowidev.vax.incremental.paho</td>
<td>✅</td>
<td>2022-09-19T09:44:06</td>
<td>52.05</td>
<td></td>
</tr>
<tr>
<td>cowidev.vax.incremental.suriname</td>
<td>✅</td>
<td>2022-09-19T09:43:28</td>
<td>14.14</td>
<td></td>
</tr>
<tr>
<td>cowidev.vax.incremental.kazakhstan</td>
<td>✅</td>
<td>2022-09-19T09:43:21</td>
<td>7.85</td>
<td></td>
</tr>
<tr>
<td>cowidev.vax.incremental.dominican_republic</td>
<td>✅</td>
<td>2022-09-19T09:43:19</td>
<td>5.63</td>
<td></td>
</tr>
<tr>
<td>cowidev.vax.incremental.china</td>
<td>✅</td>
Expand Down

0 comments on commit 062ead3

Please sign in to comment.