Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SAE UI in Explore Page #58

Open
Tracked by #59
enjalot opened this issue Sep 20, 2024 · 0 comments
Open
Tracked by #59

SAE UI in Explore Page #58

enjalot opened this issue Sep 20, 2024 · 0 comments
Labels
Milestone

Comments

@enjalot
Copy link
Owner

enjalot commented Sep 20, 2024

Once #57 is completed, we can create UI in the Explore page to enable functionality when a dataset has SAE features associated with it.

There are few main buckets of functionality:

  1. Filtering data points by features
  2. Visualizing features of data points
  3. Steering search via features

Filtering data points by features

We can provide an autocomplete feature selector that would then filter data points by the highest activations for the chosen feature. For an example of the feature selector see latent-taxonomy

We could also try transitioning the UMAP where the y-axis would then represent the activation of the data point for that feature.

Visualizing features of data points

We can show the top features activated for a data point in the table of results. For an example, see the visualizations in latent-taxonomy

We can also explore visualizations that surface the most commonly activated features for a selection of data points (e.g. for a cluster or a lasso selection)

Steering search via features

Currently, when we do search on our dataset we embed the text entered by the user and do a nearest neighbor search against the embeddings. One thing we could do is extract the features of the search text and then allow the user to turn them up or down. When the features have been modified we can modify the search vector before doing nearest neighbor search.

@enjalot enjalot mentioned this issue Sep 20, 2024
4 tasks
@enjalot enjalot added this to the 1.0 milestone Sep 20, 2024
@enjalot enjalot added the web label Sep 20, 2024
@enjalot enjalot modified the milestones: 0.5, 1.0 Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant