ethnzhng
Follow
Lists (13)
Stars
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
AWS SDK for the Rust Programming Language
🍅 World's neatest Pomodoro timer for macOS menu bar
Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.
Rust bindings for the C++ api of PyTorch.
A minimalist Jekyll theme for building a personal portfolio site powered by Jekyll and GitHub Pages
An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io/vallex/
Protocol Buffers - Google's data interchange format
The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
Continuous saving of tmux environment. Automatic restore when tmux is started. Automatic tmux start when computer is turned on.
Persists tmux environment across system restarts.
A massively parallel, high-level programming language
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, etc. It compresses deep learning models for downstream d…
List of papers related to neural network quantization in recent AI conferences and journals.
Demo applications showcasing DJL
Completely revolutionizes the Spotify Lyrics Experience by introducing Live Lyrics, Dynamic Backgrounds, and Immersive Views
🐠 ZSH port of Fish history search (up arrow)
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.