Fixing linear_activation_tensor dynamic quant (pytorch#622)

Summary: dynamic quant was broken for generate due to no repr function

Test Plan: sh benchmarks.sh

20240806170037, tok/s=  9.54, mem/s=  63.14 GB/s, peak_mem= 8.61 GB, model_size= 6.62 GB quant: int8dq, mod: Llama-2-7b-chat-hf, kv_quant: False, compile: True, compile_prefill: False, dtype: torch.bfloat16, device: cuda repro: python generate.py --quantization int8dq --checkpoint_path ../../../checkpoints/meta-llama/Llama-2-7b-chat-hf/model.pth --device cuda --precision torch.bfloat16 --compile --num_samples 5 --max_new_tokens 200 --top_k 200 --temperature 0.8

Reviewers:

Subscribers:

Tasks:

Tags:

fix version check

fix atol test again

skip test cases that rely on pt 2.5

Fix FP6-LLM API and add .to(device) op (pytorch#599)

* fix

* add some ops for convenience

Co-authored-by: Thien Tran <[email protected]>

Update version.txt

Fix crash when PYTORCH_VERSION is not defined (pytorch#455)

[Release Only] Pin generate-matrix to release 2.3.1 (pytorch#352)

[Relase only] Add test-infra-ref release/2.3 as input parameter

[Release Only] Pin generate-matrix to release 2.3.1 (pytorch#352)