histogram

[LiuJinzhe-Keepgoing]

Very interesting work. I am confused about the purpose of making histogram. Can you explain the specific relationship with the threshold? In addition, can you provide the histogram visualization code about the histogram.pt file?

[LiuJinzhe-Keepgoing]

I don't understand what the function of grab_acts.py is. Thank you for your explanation

[chromecast56]

Hi! See this for code to visualize the histograms. Histograms are needed to set thresholds to their correct values -- if you want to threshold 50% of a hidden state's activations to 0, based on absolute value, you need some knowledge of the underlying distribution of activations, which histograms provide.