Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
cyz-ai authored Feb 13, 2023
1 parent 1e9a20d commit b7eb99b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ We consider learning representation with the following objective:
$$\min L(f(X), Y) - \beta \cdot I(f(X); T)$$
where $L$ is some loss (e.g. BCE) and $I$ is the mutual information. This objective is ubiquitous in fairness, invariance, disentangled representation learning, domain adaptation, etc. In the figure above, $Y$ is the digit and $T$ is the color.

Traditionally we need to (re-)estimate $I$ before every update to $f$. We show that to minimise $I$ we need not to estimate it.
Traditionally we need to (re-)estimate $I$ before every update to $f$. We show this is indeed uncecessary.


## Materials
Expand Down

0 comments on commit b7eb99b

Please sign in to comment.