forked from dask/dask
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html
253 lines (215 loc) · 12.3 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<meta name="description" content="">
<meta name="author" content="">
<link rel="icon" href="_images/dask_icon_no_pad.svg">
<title>Dask: Scalable analytics in Python</title>
<!-- Bootstrap core CSS -->
<link href="https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0/css/bootstrap.min.css" rel="stylesheet">
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/prism/1.6.0/themes/prism.min.css">
<!-- Custom styles for this template -->
<link href="_static/main-page.css" rel="stylesheet">
</head>
<body>
<header>
<nav class="navbar navbar-expand-lg">
<div class="navbar-brand">
<img src="_images/dask_icon_no_pad.svg" style="height: 2rem;">
</div>
<div class="navbar-dark bg-dark">
<button class="navbar-toggler" type="button" data-toggle="collapse" data-target="#navbarNavDropdown" aria-controls="navbarNavDropdown" aria-expanded="false" aria-label="Toggle navigation">
<span class="navbar-toggler-icon"></span>
</button>
</div>
<div class="collapse navbar-collapse" id="navbarNavDropdown">
<ul class="navbar-nav">
<li class="navbar-item"><a class="nav-link" href="why.html">Why Dask?</a></li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="navbarDropdownMenuLink" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false">
Documentation
</a>
<div class="dropdown-menu" aria-labelledby="navbarDropdownMenuLink">
<a class="dropdown-item" href="docs.html">Overview</a>
<a class="dropdown-item" href="array.html">Arrays</a>
<a class="dropdown-item" href="dataframe.html">Dataframes</a>
<a class="dropdown-item" href="https://dask-ml.readthedocs.org/en/latest/">Machine Learning</a>
<a class="dropdown-item" href="delayed.html">Custom Applications</a>
<a class="dropdown-item" href="futures.html">Real Time</a>
</div>
</li>
<li class="navbar-item"><a class="nav-link" href="install.html">Install</a></li>
<li class="navbar-item"><a class="nav-link" href="setup.html">Deploy</a></li>
<li class="navbar-item"><a class="nav-link" href="https://github.com/dask/dask-tutorial">Tutorial</a></li>
</ul>
</div>
</nav>
<div class="hero position-relative overflow-hidden p-3 text-center text-light">
<div class="col-md-5 p-lg-1 mx-auto my-5">
<img src="_images/dask_horizontal_white_no_pad.svg" style="max-width: 100rem;">
<p class="lead font-weight-normal">
Dask natively scales Python
</p>
<p class="lead ">
Dask provides advanced parallelism for analytics,
enabling performance at scale for the tools you love
</p>
<a class="btn outline-dask btn-lg" href="docs.html">Learn More</a>
</div>
<div class="product-device box-shadow d-none d-md-block"></div>
<div class="product-device product-device-2 box-shadow d-none d-md-block"></div>
</div>
<main role="main">
<!-- Marketing messaging and featurettes
================================================== -->
<!-- Wrap the rest of the page in another container to center all the content. -->
<div class="container marketing p-md-5">
<!-- Three columns of text below the carousel -->
<h2 class="featurette-heading">Integrates with existing projects</h2>
<h2 class="featurette-subheading">Built with the broader community</h2>
<p>Dask is open source and freely available. It is developed in coordination with other community projects like Numpy, Pandas, and Scikit-Learn.</p>
<div class="row">
<div class="col-lg-4">
<h2 class="mt-3">Numpy</h2>
<img src="_images/dask-array-black-text.svg" class="top-image">
<p>Dask arrays scale Numpy workflows, enabling multi-dimensional data analysis in earth science, satellite imagery, genomics, biomedical applications, and machine learning algorithms</p>
<p>
<a class="btn btn-outline-secondary" href="array.html" role="button">Learn More »</a>
<a class="btn btn-secondary" href="https://mybinder.org/v2/gh/dask/dask-examples/master?filepath=array.ipynb" role="button">Try Now »</a>
</p>
</div><!-- /.col-lg-4 -->
<div class="col-lg-4">
<h2 class="mt-3">Pandas</h2>
<img src="_images/dask-dataframe.svg" class="top-image">
<p>Dask dataframes scale Pandas workflows, enabling applications in time series, business intelligence, and general data munging on big data.</p>
<p>
<a class="btn btn-outline-secondary" href="dataframe.html" role="button">Learn More »</a>
<a class="btn btn-secondary" href="https://mybinder.org/v2/gh/dask/dask-examples/master?filepath=dataframe.ipynb" role="button">Try Now »</a>
</p>
</div><!-- /.col-lg-4 -->
<div class="col-lg-4">
<!-- <img src="https://upload.wikimedia.org/wikipedia/commons/thumb/3/32/Rosenbrock_function.svg/300px-Rosenbrock_function.svg.png" class="top-image"> -->
<h2 class="mt-3">Scikit-Learn</h2>
<img src="https://www.inria.fr/var/inria/storage/images/medias/saclay/actualites-images/saclay_scikit_learn_classification_398x195/841331-1-fre-FR/saclay_scikit_learn_classification_398x195.jpg" class="top-image">
<p>Dask-ML scales machine learning APIs like Scikit-Learn and XGBoost to enable scalable training and prediction on large models and large datasets</p>
<p>
<a class="btn btn-outline-secondary" href="https://dask-ml.readthedocs.org/en/latest/" role="button">Learn More »</a>
<a class="btn btn-secondary" href="https://mybinder.org/v2/gh/dask/dask-examples/master?filepath=machine-learning.ipynb" role="button">Try Now »</a>
</p>
</div><!-- /.col-lg-4 -->
</div><!-- /.row -->
<!-- START THE FEATURETTES -->
<hr class="featurette-divider">
<div class="row featurette">
<div class="col-md-7">
<h2 class="featurette-heading">Familiar for Python users</h2>
<h2 class="featurette-subheading"> and easy to get started</h2>
<p class="lead">Dask uses existing Python APIs and data structures to make it easy to switch between Numpy, Pandas, Scikit-learn to their Dask-powered equivalents. </>
<p class="lead"> You don't have to completely rewrite your code or retrain to scale up</p>
<a class="btn btn-secondary" href="api.html" role="button">Learn About Dask APIs »</a>
</div>
<div class="col-md-5 code-block">
<pre><code class="language-python"># Arrays implement the Numpy API
import dask.array as da
x = da.random.random(size=(10000, 10000),
chunks=(1000, 1000))
x + x.T - x.mean(axis=0)</code></pre>
<pre><code class="language-python"># Dataframes implement the Pandas API
import dask.dataframe as dd
df = dd.read_csv('s3://.../2018-*-*.csv')
df.groupby(df.account_id).balance.sum()</code></pre>
<pre><code class="language-python"># Dask-ML implements the Scikit-Learn API
from dask_ml.linear_model \
import LogisticRegression
lr = LogisticRegression()
lr.fit(train, test)</code></pre>
</div>
</div>
<hr class="featurette-divider"></hr>
<div class="row featurette">
<div class="col-md-7 order-md-1">
<h2 class="featurette-heading">Scale up to clusters </h2>
<h2 class="featurette-subheading">or just use it on your laptop</h2>
<p class="lead">Dask's schedulers scale to thousand-node clusters and its algorithms have been tested on some of the largest supercomputers in the world.</p>
<p class="lead">But you don't need a massive cluster to get started. Dask ships with schedulers designed for use on personal machines. Many people use Dask today to scale computations on their laptop, using multiple cores for computation and their disk for excess storage.</p>
<a class="btn btn-secondary" href="scheduling.html" role="button">Learn About Dask Schedulers »</a>
</div>
<div class="col-md-5 order-md-2" style="padding: 6rem 0rem;">
<img src="https://github.com/dask/dask-org/raw/master/images/grid_search_schedule.gif"
width="100%">
</div>
</div>
<hr class="featurette-divider"></hr>
<div class="row featurette">
<div class="col-md-7">
<h2 class="featurette-heading">Customizable</h2>
<h2 class="featurette-subheading">Enabling you to parallelize internal systems</h2>
<p class="lead">Not all computations fit into a big dataframe</p>
<p class="lead">Dask exposes lower-level APIs letting you build custom systems for in-house applications. This helps open source leaders parallelize their own packages and helps business leaders scale custom business logic</p>
</div>
<div class="col-md-5 p-lg-1 mx-auto my-5">
<img src="https://github.com/dask/dask-org/raw/master/images/credit-model.svg.png"
width="100%">
</div>
</div>
<div class="text-center">
<a class="btn btn-outline-secondary btn-lg" href="docs.html" role="button">Learn More »</a>
<a class="btn btn-secondary btn-lg" href="https://mybinder.org/v2/gh/dask/dask-examples/master" role="button">Try Now »</a>
</div>
<hr class="featurette-divider"></hr>
</div>
<section id="supporters">
<div class="container supporters">
<h2>Supported By</h2>
<p>Dask receives generous support from the following institutions, either through direct funding, or by employing core developers<p>
<div class="row">
<div class="col supporter">
<a href="https://anaconda.com"><img src="https://www.anaconda.com/wp-content/themes/anaconda/images/logo-dark.png"></a>
</div>
<div class="col supporter">
<a href="https://www.darpa.mil"><img src="https://upload.wikimedia.org/wikipedia/commons/thumb/6/6e/DARPA_Logo.jpg/320px-DARPA_Logo.jpg"></a>
</div>
<div class="col supporter">
<a href="https://www.moore.org"><img src="https://www.moore.org/content/images/logo-light.png"></a>
</div>
<div class="col supporter">
<a href="https://www.nsf.gov"><img src="https://www.nsf.gov/images/logos/NSF_4-Color_bitmap_Logo.png"></a>
</div>
<div class="col supporter">
<a href="https://www.janelia.org"><img src="_images/HHMI_Janelia_Color.png"></a>
</div>
</div>
</div>
</section>
<!-- /END THE FEATURETTES -->
<!-- FOOTER -->
<footer class="container">
<p class="float-right">New-BSD Licensed</p>
<p>© 2018 Dask core developers</p>
</footer>
</main>
<!-- Bootstrap core JavaScript
================================================== -->
<!-- Placed at the end of the document so the pages load faster -->
<script src="https://code.jquery.com/jquery-3.2.1.slim.min.js"
integrity="sha384-KJ3o2DKtIkvYIK3UENzmM7KCkRr/rE9/Qpg6aAZGJwFDMVNA/GpGFF93hXpG5KkN"
crossorigin="anonymous"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0/js/bootstrap.min.js"></script>
<!-- Code highlighting -->
<script src="https://cdnjs.cloudflare.com/ajax/libs/prism/1.6.0/prism.min.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/prism/1.6.0/components/prism-python.min.js"></script>
<!-- Google Analytics -->
<script>
window.ga=window.ga||function(){(ga.q=ga.q||[]).push(arguments)};ga.l=+new
Date;
ga('create', 'UA-18218894-5', 'auto');
ga('set', 'anonymizeIp', true);
ga('send', 'pageview');
</script>
<script async
src='https://www.google-analytics.com/analytics.js'></script>
<!-- End Google Analytics -->
</body>
</html>