A reading list on LLM based Synthetic Data Generation 🔥

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

📈 目前最大的工业缺陷检测数据库及论文集 Constantly summarizing open source dataset and critical papers in the field of surface defect research which are of great importance.

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐

Segmentation models with pretrained backbones. PyTorch.

BMXNet 2: An Open-Source Binary Neural Network Implementation Based on MXNet

LSQ+ or LSQplus

Collections of model quantization algorithms. Any issues, please contact Peng Chen ([email protected])

Several simple examples for popular neural network toolkits calling custom CUDA operators.

Open Source Differentiable Computer Vision Library for PyTorch

Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design

A curated list of automated deep learning (including neural architecture search and hyper-parameter optimization) resources.

model compression based on pytorch (1、quantization: 16/8/4/2 bits(dorefa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、ternary/binary value(twn/bnn/x…

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

A curated list of neural network pruning resources.

Advanced Deep Learning with Keras, published by Packt

🕶 A curated list of Tiny Object Detection papers and related resources.

Runtime Analyzer and Statistical Profiler

Pytorch Implementation of FasterRCNN

提供对YOLOv3及Tiny的多种剪枝版本，以适应不同的需求。

PyTorch implementation of CNNs for CIFAR benchmark

General code to convert a trained keras model into an inference tensorflow model

A PyTorch-Based Framework for Deep Learning in Computer Vision

PyTorch implementation of DeepLab v2 on COCO-Stuff / PASCAL VOC

pytorch handbook是一本开源的书籍，目标是帮助那些希望和使用PyTorch进行深度学习开发和研究的朋友快速入门，其中包含的Pytorch教程全部通过测试保证可以成功运行

机器人视觉 移动机器人 VS-SLAM ORB-SLAM2 深度学习目标检测 yolov3 行为检测 opencv PCL 机器学习 无人驾驶

Image process framework based on plugin like imagej, it is esay to glue with scipy.ndimage, scikit-image, opencv, simpleitk, mayavi...and any libraries based on numpy