官网链接：https://cvpr2022.thecvf.com/
开会时间：2022年6月19日-6月24日
❣❣❣近日，CVPR 2022 接收论文公布！ 总计2067篇！，全部论文已发布，本文档也将持续收录分类ing，多多关注!!
❣❣❣另外打包下载所有论文，可在【我爱计算机视觉】微信公众号后台回复“paper”。
历年综述论文分类汇总戳这里↘️ CV-Surveys施工中~~~~~~~~~~
- 姿态
- Visual Grounding
- 动作识别
- 图像修复
- 半监督
- OOD
- VL
- 分类
- 目标检测
- 对比学习
- 检索
- 类增量
- 图像字幕
- 3D
- 分割
- Weakly Supervised Segmentation on Outdoor 4D Point Clouds With Temporal Matching and Spatial Graph Propagation
- Scribble-Supervised LiDAR Semantic Segmentation
😮oral⭐code - GanOrCon: Are Generative Models Useful for Few-Shot Segmentation?
⭐code🏠project - Masked-Attention Mask Transformer for Universal Image Segmentation
⭐code🏠project
- 手部网格重建
- NAS
- 点云
- Transformer
- 跟踪
- 语音分离
- 数据增强
- 人类运动预测
- 语音驱动的动画舌头
- 自监督
- 组织病理学
- 视频编解码
- MVS
- 域适应
- 人脸表情识别
- 6D
- 手部跟踪
- 黑盒
- 视听事件定位
- 量化
- 步态识别
- SR
- 3D
- 换衣重识别
- 其它
- The Neurally-Guided Shape Parser: Grammar-Based Labeling of 3D Shape Regions With Approximate Inference
⭐code - AutoLoss-Zero: Searching Loss Functions From Scratch for Generic Tasks
- Scalable Penalized Regression for Noise Detection in Learning With Noisy Labels
⭐code - Parameter-Free Online Test-Time Adaptation
😮oral⭐code - AlignMixup: Improving Representations by Interpolating Aligned Features
⭐code - HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imaging
⭐code - Brain-inspired Multilayer Perceptron with Spiking Neurons
- SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems
- Mega-NERF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs
- Training Quantised Neural Networks with STE Variants: the Additive Noise Annealing Algorithm
⭐code - Split Hierarchical Variational Compression
- Privacy Preserving Partial Localization
- The Neurally-Guided Shape Parser: Grammar-Based Labeling of 3D Shape Regions With Approximate Inference
- 聚类
- 场景流
- 图识别
- 运动模糊
- 人像眼镜和阴影消除
- 识别唇语
- 模拟时钟读数
- 指纹识别
- 基于草图的图像操作
- 草图识别
- 去偏移
- 线段分类
- Interactive object understanding
- 数字人类
- 强化学习
- 视觉关系检测
- 裂缝识别
- 眼球认证
- 视听事件定位
- Active Learning for Open-Set Annotation
- Active Learning by Feature Mixing
- Towards Robust and Reproducible Active Learning Using Neural Networks
⭐code
- DEFEAT: Deep Hidden Feature Backdoor Attacks by Imperceptible Perturbation and Latent Representation Constraints
- Better Trigger Inversion Optimization in Backdoor Scanning
- Highly-efficient Incomplete Large-scale Multi-view Clustering with Consensus Bipartite Graph
⭐code - Multi-Level Feature Learning for Contrastive Multi-View Clustering
⭐code - Deep Safe Multi-View Clustering: Reducing the Risk of Clustering Performance Degradation Caused by View Increase
- Rethinking Spatial Invariance of Convolutional Networks for Object Counting
⭐code📰解读 - Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Counting
⭐code
- Neural Face Identification in a 2D Wireframe Projection of a Manifold Object
⭐code - JoinABLe: Learning Bottom-up Assembly of Parametric CAD Joints
⭐code - ROCA: Robust CAD Model Retrieval and Alignment from a Single Image
⭐code
- APES: Articulated Part Extraction From Sprite Sheets
🏠project - BANMo: Building Animatable 3D Neural Models From Many Casual Videos
😮oral🏠project - Neural Head Avatars From Monocular RGB Videos
⭐code🏠project - 图像动画
- 人物动画
- 3D character animation(三维角色动画)
- 3D 舞蹈生成
- 静止图像到动画
- Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Camera
- IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Images
😮oral🏠project - SqueezeNeRF: Further factorized FastNeRF for memory-efficient inference
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction
⭐code - Modeling Indirect Illumination for Inverse Rendering
⭐code🏠project - GenDR: A Generalized Differentiable Renderer
⭐code
泛化可微渲染器 - CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields
⭐code🏠project - NeRF-Editing: Geometry Editing of Neural Radiance Fields
- AR-NeRF: Unsupervised Learning of Depth and Defocus Effects from Natural Images with Aperture Rendering Neural Radiance Fields
🏠project - Neural Rays for Occlusion-Aware Image-Based Rendering
⭐code🏠project - EfficientNeRF Efficient Neural Radiance Fields
⭐code - CoNeRF: Controllable Neural Radiance Fields
⭐code🏠project - Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
🏠project - Hallucinated Neural Radiance Fields in the Wild
⭐code🏠project - HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video
😮oral⭐code🏠project📺video - Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
- Deblur-NeRF: Neural Radiance Fields From Blurry Images
⭐code🏠project - NeRFReN: Neural Radiance Fields With Reflections
🏠project - Depth-Supervised NeRF: Fewer Views and Faster Training for Free
⭐code🏠project - Dense Depth Priors for Neural Radiance Fields From Sparse Input Views
⭐code🏠project📺video - Light Field Neural Rendering
⭐code🏠project - InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering
⭐code🏠project
- GazeOnce: Real-Time Multi-Person Gaze Estimation
- Contrastive Regression for Domain Adaptation on Gaze Estimation
- Generalizing Gaze Estimation With Rotation Consistency
- GaTector: A Unified Framework for Gaze Object Prediction
- Dynamic 3D Gaze From Afar: Deep Gaze Estimation From Temporal Eye-Head-Body Coordination
🏠project
- Finding Fallen Objects via Asynchronous Audio-Visual Integration
🏠project - 声源定位
- 音频配对
- 语音克隆
- 视听语音增强
- 文本转语音
- 语音转人脸图像
- 语音分离
- NPBG++: Accelerating Neural Point-Based Graphics
🏠project - Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations
🏠project - AutoRF: Learning 3D Object Radiance Fields from Single View Observations
🏠project - NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
⭐code🏠project📺video📰解读 - GeoNeRF: Generalizing NeRF with Geometry Priors
⭐code🏠project📺video - FWD: R eal-Time Novel View Synthesis With Forward Warping and Depth
⭐code - Block-NeRF: Scalable Large Scene Neural View Synthesis
- 视图连接
- ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer
⭐code🏠project📰粗解 - Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities
⭐code🏠project - 3MASSIV: Multilingual, Multimodal and Multi-Aspect dataset of Social Media Short Videos
- Hephaestus: A large scale multitask dataset towards InSAR understanding
- SmartPortraits: Depth Powered Handheld Smartphone Dataset of Human Portraits for State Estimation, Reconstruction and Synthesis
🌻dataset - AKB-48: A Real-World Articulated Object Knowledge Base
⭐code
📰粗解 - Primitive3D: 3D Object Dataset Synthesis from Randomly Assembled Primitives
- ZeroWaste Dataset: Towards Deformable Object Segmentation in Cluttered Scenes
⭐code🏠project - ETHSeg: An Amodel Instance Segmentation Network and a Real-World Dataset for X-Ray Waste Inspection
一个Amodel实例分割网络和一个用于X射线废物检查的真实数据集 - MAD: A Scalable Dataset for Language Grounding in Videos From Movie Audio Descriptions
🌻dataset
一个可扩展的数据集，用于从电影音频描述中获得视频的Language Grounding - 卫星数据集
- 动物行为理解数据集
- 数据集(森林监测)
- 3D目标理解
- 数据集(AutoMine)
- 数据集(人脸表情识别)
- 数据集(手势识别)
- A Simple Multi-Modality Transfer Learning Baseline for Sign Language Translation
- Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production
- MLSLT: Towards Multilingual Sign Language Translation
🏠project - 手语识别
- Motron: Multimodal Probabilistic Human Motion Forecasting
- Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction
⭐code - Spatio-Temporal Gating-Adjacency GCN for Human Motion Prediction
- MotionAug: Augmentation With Physical Correction for Human Motion Prediction
⭐code - Future Transformer for Long-term Action Anticipation
⭐code🏠project - Weakly-Supervised Action Transition Learning for Stochastic Human Motion Prediction
⭐code
- Compressive Single-Photon 3D Cameras
- Light Field(光场)
- 深度重建
- 快门校正
- 热红外成像
- 相机姿势估计
- 相机重定位
- 成像
- 光学
- 相机姿势
- 相机成像
- Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
⭐code - Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
⭐code - Anomaly Detection via Reverse Distillation From One-Class Embedding
- Towards Total Recall in Industrial Anomaly Detection
⭐code - 离群点检测
- Multi-View Transformer for 3D Visual Grounding
⭐code - Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning
⭐code
视觉定位，通过自然语言定位目标位置 （很有意思的研究） - Shifting More Attention to Visual Backbone: Query-Modulated Refinement Networks for End-to-End Visual Grounding
⭐code - Pseudo-Q: Generating Pseudo Language Queries for Visual Grounding
⭐code
- 小样本
- Ranking Distance Calibration for Cross-Domain Few-Shot Learning
- Few-shot Learning with Noisy Labels
- Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference
🏠project📺video - Few-shot Backdoor Defense Using Shapley Estimation
📰解读 - Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-Shot Learning
⭐code - EASE: Unsupervised Discriminant Subspace Learning for Transductive Few-Shot Learning
⭐code - Semi-Supervised Few-Shot Learning via Multi-Factor Clustering
⭐code - Cross-Domain Few-Shot Learning With Task-Specific Adapters
⭐code
- 零样本
- MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning
⭐code📰粗解 - Unseen Classes at a Later Time? No Problem
⭐code - En-Compactness: Self-Distillation Embedding & Contrastive Generation for Generalized Zero-Shot Learning
📰解读 - Non-Generative Generalized Zero-Shot Learning via Task-Correlated Disentanglement and Controllable Samples Synthesis
- Siamese Contrastive Embedding Network for Compositional Zero-Shot Learning
⭐code - KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning
⭐code
📰解读 - Uni-Perceiver: Pre-Training Unified Architecture for Generic Perception for Zero-Shot and Few-Shot Tasks
- Distinguishing Unseen From Seen for Generalized Zero-Shot Learning
- VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning
⭐code
📰零样本学习，大幅减少人工标注！马普所和北邮提出富含视觉信息的类别语义嵌入 - Audio-Visual Generalised Zero-Shot Learning With Cross-Modal Attention and Language
⭐code
- MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning
- 域泛化
- Compound Domain Generalization via Meta-Knowledge Encoding
- Causality Inspired Representation Learning for Domain Generalization
⭐code - Towards Unsupervised Domain Generalization
📰CVPR 2022丨清华大学提出：无监督域泛化 (UDG)
本次任务的主要目标是域泛化（domain generalization(DG)），是首篇将DG推广到unsupervised learning 领域的，并提出一个新的研究领域 unsupervised domain generalization(UDG)。 - Towards Principled Disentanglement for Domain Generalization
😮oral⭐code - Meta Convolutional Neural Networks for Single Domain Generalization
- PCL: Proxy-Based Contrastive Learning for Domain Generalization
- Localized Adversarial Domain Generalization
- Unsupervised Domain Generalization by Learning a Bridge Across Domains
- Style Neophile: Constantly Seeking Novel Styles for Domain Generalization
- 域外泛化
- 域适应
- Continual Test-Time Domain Adaptation
⭐code - Safe Self-Refinement for Transformer-based Domain Adaptation
⭐code📰解读 - Source-Free Domain Adaptation via Distribution Estimation
📰解读 - Learning Distinctive Margin toward Active Domain Adaptation
⭐code
📰解读 - DINE: Domain Adaptation from Single and Multiple Black-box Predictors
⭐code - Exploring Domain-Invariant Parameters for Source Free Domain Adaptation
- Physically Disentangled Intra- and Inter-Domain Adaptation for Varicolored Haze Removal
⭐code
- Continual Test-Time Domain Adaptation
- No-Reference Point Cloud Quality Assessment via Domain Adaptation
⭐code - Slimmable Domain Adaptation
⭐code - SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation
- 无监督域适应
- Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptation
⭐code - Category Contrast for Unsupervised Domain Adaptation in Visual Tasks
- The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalization
⭐code - Spectral Unsupervised Domain Adaptation for Visual Recognition
- Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptation
- PPDL: Predicate Probability Distribution Based Loss for Unbiased Scene Graph Generation
- Fine-Grained Predicates Learning for Scene Graph Generation
⭐code - HL-Net: Heterophily Learning Network for Scene Graph Generatio
⭐code
场景图生成：异质学习网络
📰解读 - RU-Net: Regularized Unrolling Network for Scene Graph Generation
⭐code
场景图生成：正则展开网络
📰解读 - The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generation
⭐code - Dynamic Scene Graph Generation via Anticipatory Pre-Training
- Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generation
⭐code - 视频场景图生成
- CD2-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learning
- Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage
⭐code - FedCorr: Multi-Stage Federated Learning for Label Noise Correction
⭐code - Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning
- Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning
- Layer-Wised Model Aggregation for Personalized Federated Learning
- Federated Learning With Position-Aware Neurons
- Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning
⭐code - FedDC: Federated Learning With Non-IID Data via Local Drift Decoupling and Correction
⭐code - Learn From Others and Be Yourself in Heterogeneous Federated Learning
⭐code
- Controllable Dynamic Multi-Task Architectures
🏠project - Task Adaptive Parameter Sharing for Multi-Task Learning
- Self-Taught Metric Learning without Labels
⭐code🏠project - Enhancing Adversarial Robustness for Deep Metric Learning
- 增量学习
- 类增量学习
- Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches
- Constrained Few-shot Class-incremental Learning
⭐code - Class-Incremental Learning with Strong Pre-trained Models
- Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation
⭐code - Bring Evanescent Representations to Life in Lifelong Class Incremental Learning
- Self-Sustaining Representation Expansion for Non-Exemplar Class-Incremental Learning
- MetaFSCIL: A Meta-Learning Approach for Few-Shot Class Incremental Learning
- Federated Class-Incremental Learning
⭐code
- Give Me Your Attention: Dot-Product Attention Considered Harmful for Adversarial Patch Robustness
- Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network
- Towards Practical Certifiable Patch Defense with Vision Transformer
📰解读 - Enhancing Adversarial Training with Second-Order Statistics of Weights
⭐code - Practical Evaluation of Adversarial Robustness via Adaptive Auto Attack
⭐code - Improving Adversarial Transferability via Neuron Attribution-Based Attacks
⭐code - Two Coupled Rejection Metrics Can Tell Adversarial Examples Apart
⭐code - Bounded Adversarial Attack on Deep Content Features
- Subspace Adversarial Training
⭐code - Cross-Modal Transferable Adversarial Attacks From Images to Videos
⭐code - Understanding and Increasing Efficiency of Frank-Wolfe Adversarial Training
⭐code - Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free
⭐code - Robust Combination of Distributed Gradients Under Adversarial Perturbations
- Adversarial Texture for Fooling Person Detectors in the Physical World
- DTA: Physical Camouflage Attacks Using Differentiable Transformation Network
🏠project - BppAttack: Stealthy and Efficient Trojan Attacks Against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learning
⭐code - Pyramid Adversarial Training Improves ViT Performance
🏠project - 对抗样本
- 对抗攻击
- 黑盒
- Investigating Top-k White-Box and Transferable Black-box Attack
⭐code - DST: Dynamic Substitute Training for Data-free Black-box Attack
🏠project - Bandits for Structure Perturbation-based Black-box Attacks to Graph Neural Networks with Theoretical Guarantees
😮oral⭐code - Adversarial Eigen Attack on Black-Box Models
- Investigating Top-k White-Box and Transferable Black-box Attack
- 对抗训练
- On Generalizing Beyond Domains in Cross-Domain Continual Learning
- Probing Representation Forgetting in Supervised and Unsupervised Continual Learning
- Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries
⭐code - Learning To Prompt for Continual Learning
⭐code - Learning Bayesian Sparse Networks With Full Experience Replay for Continual Learning
- Not Just Selection, but Exploration: Online Class-Incremental Continual Learning via Dual View Consistency
⭐code - Continual Learning for Visual Search With Backward Consistent Feature Embedding
⭐code - Meta-Attention for ViT-Backed Continual Learning
⭐code - Continual Learning with Lifelong Vision Transformer
📰解读
- What Matters For Meta-Learning Vision Regression Tasks?
- Multidimensional Belief Quantification for Label-Efficient Meta-Learning
- Dynamic Kernel Selection for Improved Generalization and Memory Efficiency in Meta-learning
- Learning to Learn and Remember Super Long Multi-Domain Task Sequence
😮oral⭐code
📰解读
- Selective-Supervised Contrastive Learning with Noisy Labels
⭐code📰粗解 - Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning
⭐code - Cam-Ready: UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learning
⭐code - Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework
⭐code - Crafting Better Contrastive Views for Siamese Representation Learning
😮oral⭐code - Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo
⭐code - Estimating Fine-Grained Noise Model via Contrastive Learning
- Contextual Outpainting With Object-Level Contrastive Learning
🏠project - Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance With Expanded Views
- Contrastive Dual Gating: Learning Sparse Features With Contrastive Learning
- Noise Is Also Useful: Negative Correlation-Steered Latent Contrastive Learning
- On Learning Contrastive Representations for Learning With Noisy Labels
- Unsupervised Deraining: Where Contrastive Learning Meets Self-Similarity
- Robust Contrastive Learning Against Noisy Views
⭐code - Unified Contrastive Learning in Image-Text-Label Space
⭐code - Consistent Explanations by Contrastive Learning
⭐code - Rethinking Minimal Sufficient Representation in Contrastive Learning
⭐code
- CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow
⭐code - DIP: Deep Inverse Patchmatch for High-Resolution Optical Flow
⭐code - Imposing Consistency for Optical Flow Estimation
- Deep Equilibrium Optical Flow Estimation
⭐code📰解读 - GMFlow: Learning Optical Flow via Global Matching
😮oral⭐code📰解读 - Optical Flow Estimation for Spiking Camera
⭐code - Learning Optical Flow with Kernel Patch Attention
⭐code📰解读 - CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimation
⭐code - Global Matching With Overlapping Attention for Optical Flow Estimation
⭐code
- XYLayoutLM: Towards Layout-Aware Multimodal Networks for Visually-Rich Document Understanding
- SwinTextSpotter: Scene Text Spotting via Better Synergy Between Text Detection and Text Recognition
⭐code - 场景文本检测
- Towards End-to-End Unified Scene Text Detection and Layout Analysis
⭐code - Pushing the Performance Limit of Scene Text Recognizer without Human Annotation
- Vision-Language Pre-Training for Boosting Scene Text Detectors
⭐code
视觉语言预训练，场景文本检测,代码将开源，地址尚未公布。 - Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detection
- Towards End-to-End Unified Scene Text Detection and Layout Analysis
- 场景文本识别
- Text Spotting
- LOGO设计
- 字体生成
- 文本识别
- 表格结构识别
- 文本美观预测评估
- 表结构理解
- 文本分割
- 表格检测
- 文本修复
- 知识蒸馏
- Knowledge Distillation with the Reused Teacher Classifier
- DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers
📰解读 - Decoupled Knowledge Distillation
⭐code
📰解耦知识蒸馏，让Hinton在7年前提出的方法重回SOTA行列 - Knowledge Distillation via the Target-aware Transformer
😮oral⭐code
📰RMIT&阿里&UTS&中山提出Target-aware Transformer，进行one-to-all知识蒸馏！性能SOTA - Evaluation-oriented Knowledge Distillation for Deep Face Recognition
😮oral⭐code
📰解读1
📰解读2 - Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation
⭐code - Self-Distillation From the Last Mini-Batch for Consistency Regularization
⭐code - Knowledge Distillation As Efficient Pre-Training: Faster Convergence, Higher Data-Efficiency, and Better Transferability
⭐code
- 模型压缩
- 剪枝
- 量化
- A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic Information
⭐code🏠project - Mr.BiQ: Post-Training Non-Uniform Quantization Based on Minimizing the Reconstruction Error
- Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation
⭐code - AlignQ: Alignment Quantization With ADMM-Based Correlation Preservation
⭐code - Data-Free Network Compression via Parametric Non-Uniform Mixed Precision Quantization
- Mutual Quantization for Cross-Modal Search With Noisy Labels
- A Deeper Dive Into What Deep Spatiotemporal Networks Encode: Quantifying Static vs. Dynamic Information
- 超参数优化
- HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction
⭐code - MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection
- GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection
⭐code - Distillation Using Oracle Queries for Transformer-Based Human-Object Interaction Detection
⭐code - OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction
⭐code
📰粗解 - D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions
🏠code - Learning Transferable Human-Object Interaction Detector With Natural Language Supervision
⭐code - What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions
😮oral - Human-Object Interaction Detection via Disentangled Transformer
- Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection
⭐code📰解读 - Interactiveness Field in Human-Object Interactions
⭐code - Stability-driven Contact Reconstruction From Monocular Color Images
⭐code
单目彩色图像的手物交互重建，人机交互 - Interactiveness Field of Human-Object Interactions
⭐code
📰粗解 - Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection
⭐code
📰解读1
📰解读2 - Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions
😮oral⭐code - Efficient Two-Stage Detection of Human-Object Interactions With a Novel Unary-Pairwise Transformer
🏠project - NeuralHOFusion: Neural Volumetric Rendering Under Human-Object Interactions
- HOI跟踪
- 🐦️AlignMix: Improving representation by interpolating aligned features
- 3D Common Corruptions and Data Augmentation
⭐code🏠project📺video📰粗解 - Kubric: A scalable dataset generator
- Robust Optimization As Data Augmentation for Large-Scale Graphs
⭐code - AIM: an Auto-Augmenter for Images and Meshes
⭐code - Boosting Robustness of Image Matting With Context Assembling and Strong Data Augmentation
🏠project
- Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships
⭐code - VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers
- Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
🌻dataset - Robust Cross-Modal Representation Learning with Progressive Self-Distillation
- Prompt Distribution Learning
在下游的识别任务中，作者提出的方法在12个数据集上均展示出了一致性的性能提升。 - Vision-Language Pre-Training with Triple Contrastive Learning
⭐code - Improving features Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning
⭐code
📰国科大&港中文提出带视觉语言验证和迭代推理的Visual Grounding框架，性能SOTA，代码已开源！ - Towards General Purpose Vision Systems: An End-to-End Task-Agnostic Vision-Language Architecture
⭐code🏠project - VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks
⭐code - Lite-MDETR: A Lightweight Multi-Modal Detector
- Align and Prompt: Video-and-Language Pre-Training With Entity Prompts
⭐code - Unsupervised Vision-and-Language Pre-Training via Retrieval-Based Multi-Granular Alignment
- RegionCLIP: Region-based Language-Image Pretraining(https://github.com/microsoft/RegionCLIP)
- Grounded Language-Image Pre-Training
⭐code - Advancing High-Resolution Video-Language Representation With Large-Scale Video Transcriptions
⭐code - Conditional Prompt Learning for Vision-Language Models
⭐code - Multi-Modal Alignment Using Representation Codebook
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks
😮oral⭐code - An Empirical Study of Training End-to-End Vision-and-Language Transformers
⭐code - VLN
- EnvEdit: Environment Editing for Vision-and-Language Navigation
⭐code - Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language Navigation
⭐code - Reinforced Structured State-Evolution for Vision-Language Navigation
⭐code📰解读 - Cross-modal Map Learning for Vision and Language Navigation
⭐code🏠project - One Step at a Time: Long-Horizon Vision-and-Language Navigation With Milestones
- What do navigation agents learn about their environment?
- Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation
⭐code - ADAPT: Vision-Language Navigation With Modality-Aligned Action Prompts
- EnvEdit: Environment Editing for Vision-and-Language Navigation
- 视频-文本表示学习
- 视觉表征学习
- 视觉导航
- 视觉描述
- VQA
- SimVQA: Exploring Simulated Environments for Visual Question Answering
🏠project - SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering
⭐code📰粗解 - V-Doc: Visual Questions Answers With Documents
⭐code - Grounding Answers for Visual Questions Asked by Visually Impaired People
🏠project - Query and Attention Augmentation for Knowledge-Based Explainable Reasoning
⭐code - MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-Based Visual Question Answering
⭐code - Transform-Retrieve-Generate: Natural Language-Centric Outside-Knowledge Visual Question Answering
- LaTr: Layout-Aware Transformer for Scene-Text VQA
- WebQA: Multihop and Multimodal QA* AVQA
- Learning to Answer Questions in Dynamic Audio-Visual Scenarios
😮oral⭐code
📰CVPR 2022 Oral | 人大高瓴AI学院提出面向动态视音场景的问答学习任务 - Dual-Key Multimodal Backdoors for Visual Question Answering
⭐code - Maintaining Reasoning Consistency in Compositional Visual Question Answering
⭐code
- SimVQA: Exploring Simulated Environments for Visual Question Answering
- Video-QA
- SLAM
- 目标导航
- try-on
- Dressing in the Wild by Watching Dance Videos
🏠project - Style-Based Global Appearance Flow for Virtual Try-On
⭐code - ClothFormer:Taming Video Virtual Try-on in All Module
😮oral⭐code🏠project📰解读 - Weakly Supervised High-Fidelity Clothing Model Generation
- Full-Range Virtual Try-On With Recurrent Tri-Level Transform
🏠project
- Dressing in the Wild by Watching Dance Videos
- AR
- Episodic Memory Question Answering
😮oral⭐code
AI助理：情景记忆问答 （增强现实新任务，数据及代码均将开源）
- Episodic Memory Question Answering
- 机器人
- 机器人导航
- Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer
⭐code - Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation
⭐code - Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalization
😮oral⭐code - HEAT: Holistic Edge Attention Transformer for Structured Reconstruction
⭐code - StyTr2: Image Style Transfer With Transformers
⭐code - 运动风格迁移
- 运动迁移
- 场景风格化
- 外观迁移
- 风格化
- OSOP: A Multi-Stage One Shot Object Pose Estimation Framework
- OnePose: One-Shot Object Pose Estimation without CAD Models
⭐code🏠project📰解读 - ABPN: Adaptive Blend Pyramid Network for Real-Time Local Retouching of Ultra High-Resolution Photo
- On the Instability of Relative Pose Estimation and RANSAC's Role
- SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation With Learnt Surface Embeddings
⭐code🏠project - ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapes
⭐code🏠project📺video - GPV-Pose: Category-Level Object Pose Estimation via Geometry-Guided Point-Wise Voting
- 4D
- 9D
- 单目目标姿势估计
- 6D
- RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization
⭐code - FS6D: Few-Shot 6D Pose Estimation of Novel Objects
⭐code🏠project📰解读 - Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimation
- ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework
⭐code - Focal Length and Object Pose Estimation via Render and Compare
⭐code🏠project📰解读 - DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation
⭐code🏠project📰解读 - Coupled Iterative Refinement for 6D Multi-Object Pose Estimation
⭐code📰解读 - ZebraPose: Coarse To Fine Surface Encoding for 6DoF Object Pose Estimation
⭐code - Symmetry and Uncertainty-Aware Object SLAM for 6DoF Object Pose Estimation
⭐code - OVE6D: Object Viewpoint Encoding for Depth-Based 6D Object Pose Estimation
⭐code - SAR-Net: Shape Alignment and Recovery Network for Category-Level 6D Object Pose and Size Estimation
⭐code🏠project
- RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization
- 3D Object Articulation
- 3Dope
- GNN
- Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification
- 细粒度分类
- 图像分类
- Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classification
⭐code - DTFD-MIL: Double-Tier Feature Distillation Multiple Instance Learning for Histopathology Whole Slide Image Classification
⭐code - Contrastive Test-Time Adaptation
🏠project - A Comprehensive Study of Image Classification Model Sensitivity to Foregrounds, Backgrounds, and Visual Attributes
- VisCUIT: Visual Auditor for Bias in CNN Image Classifier
📺video - Multi-Label Iterated Learning for Image Classification With Label Ambiguity
⭐code - Efficient Classification of Very Large Images With Tiny Objects
- Node-Aligned Graph Convolutional Network for Whole-Slide Image Representation and Classification
⭐code - Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable Prototypes
⭐code
- Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classification
- 小样本分类
- CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification
- Matching Feature Sets for Few-Shot Image Classification
⭐code🏠project📺video - Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification
😮oral⭐code🏠project📰解读 - Learning to Affiliate: Mutual Centralized Learning for Few-shot Classification
📰解读 - Generating Representative Samples for Few-Shot Classification
⭐code
📰粗解
在小样本分类问题中，通过生成更多代表性样本，去除非代表性样本，改善了分类结果。实现了SOTA的结果。 - Improving Adversarially Robust Few-Shot Image Classification With Generalizable Representations
- Task Discrepancy Maximization for Fine-Grained Few-Shot Classification
- 小样本分类与分割(FS-CS)
- 长尾识别
- Nested Collaborative Learning for Long-Tailed Visual Recognition
⭐code - Long-Tailed Recognition via Weight Balancing
⭐code - Targeted Supervised Contrastive Learning for Long-Tailed Recognition
- Long-Tail Recognition via Compositional Knowledge Transfer
- RelTransformer: A Transformer-Based Long-Tail Visual Relationship Recognition
⭐code - Trustworthy Long-Tailed Classification
⭐code - Balanced Contrastive Learning for Long-Tailed Visual Recognition
- The Majority Can Help the Minority: Context-Rich Minority Oversampling for Long-Tailed Classification
⭐code - Retrieval Augmented Classification for Long-Tail Visual Recognition
- Nested Collaborative Learning for Long-Tailed Visual Recognition
- 细粒度识别
- 多标签分类
- 类不平衡分类
- Learning Graph Regularisation for Guided Super-Resolution
⭐code - Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellites
⭐code🏠project📰解读 - Deep Constrained Least Squares for Blind Image Super-Resolution
⭐code📰解读 - Discrete Cosine Transform Network for Guided Depth Map Super-Resolution
😮oral⭐code - Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolution
⭐code - LAR-SR: A Local Autoregressive Model for Image Super-Resolution
- VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution
⭐code - Blind Image Super-Resolution With Elaborate Degradation Modeling on Noise and Kernel
⭐code - Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
⭐code - SphereSR: 360deg Image Super-Resolution With Arbitrary Projection via Continuous Spherical Image Representation
- Reflash Dropout in Image Super-Resolution
- GCFSR: A Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors
⭐code - Learning the Degradation Distribution for Blind Image Super-Resolution
⭐code - VSR
- Stable Long-Term Recurrent Video Super-Resolution
- Reference-based Video Super-Resolution Using Multi-Camera Video Triplets
⭐code - Learning Trajectory-Aware Transformer for Video Super-Resolution
😮oral⭐code - Investigating Tradeoffs in Real-World Video Super-Resolution
⭐code📰解读 - BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment
⭐code🏠project📺video
🏆NTIRE 2021年视频修复和增强挑战赛冠军 - Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modeling
📰ETDM：基于显式时间差分建模的视频超分辨率 - Memory-Augmented Non-Local Attention for Video Super-Resolution
⭐code📰解读 - Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learning
⭐code
📰解读 - RSTT: Real-Time Spatial Temporal Transformer for Space-Time Video Super-Resolution
⭐code
- Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrieval
⭐code - Correlation Verification for Image Retrieval
😮oral⭐code - Sketch3T: Test-Time Training for Zero-Shot SBIR
- Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image
- Forward Compatible Training for Large-Scale Embedding Retrieval Systems
⭐code - Contextual Similarity Distillation for Asymmetric Image Retrieval
- Object-Aware Video-Language Pre-Training for Retrieval
⭐code - Effective Conditioned and Composed Image Retrieval Combining CLIP-Based Features
- 视频检索
- 文本-视频检索
- 跨模太检索
- Interactive Image Synthesis with Panoptic Layout Generation
- Autoregressive Image Generation using Residual Quantization
⭐code📰粗解 - GIRAFFE HD: A High-Resolution 3D-aware Generative Model
- Arbitrary-Scale Image Synthesis
⭐code📰粗解 - Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis
⭐code📰解读 - Learning to Memorize Feature Hallucination for One-Shot Image Generation
📰解读 - StyleSwin: Transformer-Based GAN for High-Resolution Image Generation
⭐code - Neural Texture Extraction and Distribution for Controllable Person Image Synthesis
⭐code - Unpaired Cartoon Image Synthesis via Gated Cycle Mapping
- Global Context With Discrete Diffusion in Vector Quantised Modelling for Image Generation
- 3D Scene Painting via Semantic Image Synthesis
- 3D-Aware Image Synthesis via Learning Structural and Textural Representations
⭐code🏠project📺video - High-Resolution Image Synthesis With Latent Diffusion Models
⭐code - Retrieval-Based Spatially Adaptive Normalization for Semantic Image Synthesis
⭐code - DPGEN: Differentially Private Generative Energy-Guided Network for Natural Image Synthesis
⭐code - 文本引导的图像处理
- 姿势引导的图像合成
- 文本到图像合成
- StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis
- Text-to-Image Synthesis based on Object-Guided Joint-Decoding Transformer
📰解读 - LAFITE: Towards Language-Free Training for Text-to-Image Generation
⭐code - DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesis
😮oral⭐code - Text to Image Generation With Semantic-Spatial Aware GAN
⭐code
- 图像翻译
- 图像生成
- 图像到本文
- 文本-形状生成
- 图像-视频生成
- 基于文本的目标生成
- 人物图像生成
- CVNet: Contour Vibration Network for Building Extraction
⭐code - CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data
🏠project - Self-Supervised Material and Texture Representation Learning for Remote Sensing Tasks
⭐code - 遥感图像融合
- 航空图像分割
- 自动驾驶
- Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data
⭐code - Exploiting Temporal Relations on Radar Perception for Autonomous Driving
- COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles
⭐code🏠project📰解读 - Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior
🏠project - Learning From All Vehicles
⭐code - Time3D: End-to-End Joint Monocular 3D Object Detection and Tracking for Autonomous Driving
- Unifying Panoptic Segmentation for Autonomous Driving
- Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous Driving
⭐code
- Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data
- 车道线检测
- 车道线描述
- 行为预测
- 自动驾驶场景重新照明
- 行人轨迹预测
- 轨迹预测
- MUSE-VAE: Multi-Scale VAE for Environment-Aware Long Term Trajectory Prediction
- Remember Intentions: Retrospective-Memory-Based Trajectory Prediction
⭐code - LTP: Lane-Based Trajectory Prediction for Autonomous Driving
- Vehicle trajectory prediction works, but not everywhere
🏠project - End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps
⭐code - Whose Track Is It Anyway? Improving Robustness to Tracking Errors With Affinity-Based Trajectory Prediction
- Adaptive Trajectory Prediction via Transferable GNN
- M2I: From Factored Marginal Trajectory Prediction to Interactive Prediction
- 车辆检测
- 🐦️ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior
⭐code - Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search
⭐code📰解读 - GPUNet: Searching the Deployable Convolution Neural Networks for GPUs
神经架构搜索，面向GPUs部署的轻量级网络结构搜索 （比谷歌EfficientNet-X系列、Meta FBNetV3 速度更快，甚至性能都要好，作者来自英伟达） - Distribution Consistent Neural Architecture Search
- Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search
- BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule
- GreedyNASv2: Greedier Search With a Greedy Path Filter
- Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning
⭐code
- 组重识别
- Reid
- Part-based Pseudo Label Refinement for Unsupervised Person Re-identification
⭐code - Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentification
- FMCNet: Feature-Level Modality Compensation for Visible-Infrared Person Re-Identification
- Large-Scale Pre-training for Person Re-identification with Noisy Labels
⭐code - Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-Identification
⭐code - Implicit Sample Extension for Unsupervised Person Re-Identification
⭐code📰解读 - Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification
⭐code - NFormer: Robust Person Re-identification with Neighbor Transformer
⭐code📰解读 - Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification
- Unleashing Potential of Unsupervised Pre-Training With Intra-Identity Regularization for Person Re-Identification
- Learning With Twin Noisy Labels for Visible-Infrared Person Re-Identification
⭐code - Lifelong Unsupervised Domain Adaptive Person Re-Identification With Coordinated Anti-Forgetting and Adaptation
🏠project - Learning Memory-Augmented Unidirectional Metrics for Cross-Modality Person Re-Identification
- Augmented Geometric Distillation for Data-Free Incremental Person ReID
⭐code - Salient-to-Broad Transition for Video Person Re-Identification
⭐code - 换装行人重识别
- 遮挡行人重识别
- Part-based Pseudo Label Refinement for Unsupervised Person Re-identification
- 人群计数
- 行人检测
- 步态识别
- Person Search
- Temporal Context Matters: Enhancing Single Image Prediction with Disease Progression Representations
😮oral - BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotation
⭐code - DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slides
- DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis
⭐code📰解读 - Surpassing the Human Accuracy: Detecting Gallbladder Cancer from USG Images with Curriculum Learning
⭐code🏠project - What Makes Transfer Learning Work for Medical Images: Feature Reuse & Other Factors
- 3D生物打印
- Generating 3D Bio-Printable Patches Using Wound Segmentation and Reconstruction to Treat Diabetic Foot Ulcers
利用伤口分割和重建生成3D生物打印贴片来治疗糖尿病足溃疡
- Generating 3D Bio-Printable Patches Using Wound Segmentation and Reconstruction to Treat Diabetic Foot Ulcers
- SR（ＭRI）
- 医学图像分割
- 医学图像配准
- 医学图像分析
- 自动生成报告
- 医学图像分类
- CT合成
- 医学影像关键点检测
- MRI
- 组织病理学
- 自监督
- A study on the distribution of social biases in self-supervised learning visual models
⭐code - Learning Where to Learn in Cross-View Self-Supervised Learning
- Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy
- DATA: Domain-Aware and Task-Aware Self-Supervised Learning
⭐code - Contextualized Spatio-Temporal Contrastive Learning With Self-Supervision
⭐code - Self-Supervised Spatial Reasoning on Multi-View Line Drawings
⭐code🏠project - Self-Supervised Models Are Continual Learners
⭐code - Learning Pixel Trajectories With Multiscale Contrastive Random Walks
⭐code🏠project - Locality-Aware Inter- and Intra-Video Reconstruction for Self-Supervised Correspondence Learning
⭐code - Backdoor Attacks on Self-Supervised Learning
⭐code - Neural Shape Mating: Self-Supervised Object Assembly With Adversarial Shape Priors
🏠project - Masked Feature Prediction for Self-Supervised Visual Pre-Training
⭐code - Semantic-Aware Auto-Encoders for Self-Supervised Representation Learning
⭐code - Patch-Level Representation Learning for Self-Supervised Vision Transformers
- A Simple Data Mixing Prior for Improving Self-Supervised Learning
⭐code - Sound and Visual Representation Learning With Multiple Pretraining Tasks
- A study on the distribution of social biases in self-supervised learning visual models
- 无监督
- 半监督
- Class-Aware Contrastive Semi-Supervised Learning
⭐code
📰解读 - RSCFed: Random Sampling Consensus Federated Semi-supervised Learning
⭐code - FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filtering
😮oral🏠project - Semi-Supervised Learning of Semantic Correspondence with Pseudo-Labels
- SimMatch: Semi-Supervised Learning With Similarity Matching
⭐code - CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning
⭐code - DASO: Distribution-Aware Semantics-Oriented Pseudo-Label for Imbalanced Semi-Supervised Learning
⭐code🏠project - Semi-Weakly-Supervised Learning of Complex Actions From Instructional Task Videos
⭐code - Towards Discovering the Effectiveness of Moderately Confident Samples for Semi-Supervised Learning
- Class-Aware Contrastive Semi-Supervised Learning
- 弱监督
- P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision
⭐code
使用教学视频进行概率性程序规划的弱监督方法 - Revisiting Weakly Supervised Pre-Training of Visual Perception Models
⭐code - Automatic Synthesis of Diverse Weak Supervision Sources for Behavior Analysis
⭐code - Decoupling Makes Weakly Supervised Local Feature Better
⭐code
- P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision
- Vision Transformer With Deformable Attention
⭐code - Delving Deep Into the Generalization of Vision Transformers Under Distribution Shifts
⭐code - HiVT: Hierarchical Vector Transformer for Multi-Agent Motion Prediction
- Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space
⭐code - Video Swin Transformer
⭐code - APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers
- Fast Point Transformer
⭐code - ChiTransformer:Towards Reliable Stereo from Cues
- Beyond Fixation: Dynamic Window Visual Transformer
⭐code - Training-free Transformer Architecture Search
📰解读 - Automated Progressive Learning for Efficient Training of Vision Transformers
⭐code - Collaborative Transformers for Grounded Situation Recognition
⭐code - TubeDETR: Spatio-Temporal Video Grounding with Transformers
😮oral⭐code🏠project - Deformable Video Transformer
- MixFormer: Mixing Features across Windows and Dimensions
😮oral⭐code📰粗解 - Are Multimodal Transformers Robust to Missing Modality?
- MiniViT: Compressing Vision Transformers with Weight Multiplexing
- Multimodal Token Fusion for Vision Transformers
⭐code - Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer
😮oral⭐code📰解读 - UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog
对比学习用于视觉对话的统一Transformer架构 - Patch Slimming for Efficient Vision Transformers
📰解读 - Swin Transformer V2: Scaling Up Capacity and Resolution
⭐code
📰大大刷新记录！Swin Transformer v2.0 来了，30亿参数！ - SimMIM: A Simple Framework for Masked Image Modeling
⭐code - NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition
⭐code
📰解读 - Mobile-Former: Bridging MobileNet and Transformer
⭐code - MulT: An End-to-End Multitask Learning Transformer
⭐code🏠project - Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning
😮oral⭐code📰解读 - CodedVTR: Codebook-Based Sparse Voxel Transformer With Geometric Guidance
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens
⭐code - IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes
⭐code - Reversible Vision Transformers
⭐code - MetaFormer Is Actually What You Need for Vision
😮oral⭐code - GradViT: Gradient Inversion of Vision Transformers
🏠project - CSWin Transformer: A General Vision Transformer Backbone With Cross-Shaped Windows
⭐code - MViTv2: Improved Multiscale Vision Transformers for Classification and Detection
⭐code
📰Meta&伯克利基于池化自注意力机制提出通用多尺度视觉Transformer，在ImageNet分类准确率达88.8%！开源 - A-ViT: Adaptive Tokens for Efficient Vision Transformer
😮oral
📰不重要的token可以提前停止计算！英伟达提出自适应token的高效视觉Transformer网络A-ViT，提高模型的吞吐量！ - Certified Patch Robustness via Smoothed Vision Transformers
⭐code - The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy
⭐code - Bootstrapping ViTs: Towards Liberating Vision Transformers From Pre-Training
⭐code - Object-Region Video Transformers
⭐code🏠project - 形状补全
- Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models
😮oral - Improving Video Model Transfer With Dynamic Representation Learning
- 动作分割
- 动作理解
- Video Copy Detection(视频拷贝检测)
- 视频合成
- 视频异常检测
- 视频监控
- 视频时刻检索和视频高光检测
- 视频时刻检索
- 视频预测
- 视频个体计数
- 视频插值
- Many-to-many Splatting for Efficient Video Frame Interpolation
⭐code - TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolation
🏠project - Long-term Video Frame Interpolation via Feature Propagation
- Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusion
- Many-to-many Splatting for Efficient Video Frame Interpolation
- 视觉对应（视频）
- 视频识别
- BEVT: BERT Pretraining of Video Transformers
⭐code
📰视频Transformer自监督预训练新范式，复旦、微软云AI实现视频识别新SOTA - MLP-3D: A MLP-like 3D Architecture with Grouped Time Mixing
⭐code📰解读 - MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition
- Multiview Transformers for Video Recognition
⭐code
- BEVT: BERT Pretraining of Video Transformers
- 视频分类
- 视频预测
- 视频分割
- Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation
⭐code - VSS
- VOS
- Recurrent Dynamic Embedding for Video Object Segmentation
⭐code - Language-Bridged Spatial-Temporal Interaction for Referring Video Object Segmentation
⭐code🏠project - Accelerating Video Object Segmentation With Compressed Video
⭐code - End-to-End Referring Video Object Segmentation With Multimodal Transformers
⭐code - HODOR: High-Level Object Descriptors for Object Re-Segmentation in Video Learned From Static Images
⭐code - SWEM: Towards Real-Time Video Object Segmentation With Sequential Weighted Expectation-Maximization
- Language As Queries for Referring Video Object Segmentation
⭐code - Wnet: Audio-Guided Video Object Segmentation via Wavelet-Based Cross-Modal Denoising Networks
⭐code
- Recurrent Dynamic Embedding for Video Object Segmentation
- 视频实例分割(VIS)
- 视频语义分割
- 视频全景分割
- Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation
- 视频影像处理
- 视频恢复
- 视频修复
- 视频去摩尔纹
- 视频去模糊
- 视频去噪
- 电影修复
- 视频表征学习
- TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition
😮oral⭐code📰解读 - Motion-Aware Contrastive Video Representation Learning via Foreground-Background Merging
⭐code - Motion-Adjustable Neural Implicit Video Representation
- 自监督视频表征学习
- Hierarchical Self-supervised Representation Learning for Movie Understanding
⭐code🏠project - Learning from Untrimmed Videos: Self-Supervised Video Representation Learning with Hierarchical Consistency
⭐code🏠project - Cross-Architecture Self-supervised Video Representation Learning
⭐code
📰解读
📰不同网络结构的特征也能进行对比学习？蚂蚁&美团&南大&阿里提出跨架构自监督视频表示学习方法CACL，性能SOTA！
- Hierarchical Self-supervised Representation Learning for Movie Understanding
- 视频对比学习
- TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition
- 视频分解
- 视频阴影检测
- 视频帧插值
- 视频理解
- 视频字幕
- 视频重构
- 视频相似度评估
- 视频摘要
- 视频编解码
- 视频建模
- 🐦️HyperInverter: Improving StyleGAN Inversion via Hypernetwork
🏠project - InsetGAN for Full-Body Image Generation
🏠project
📰1024x1024 分辨率，效果惊人！InsetGAN：全身图像生成 - Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data
⭐code - Deep Image-based Illumination Harmonization
- GAN-Supervised Dense Visual Alignment
😮oral⭐code🏠project📺video
📰CVPR2022 Oral：GAN监督的密集视觉对齐，代码开源 - Styleformer: Transformer Based Generative Adversarial Networks With Style Vector
⭐code
📰解读 - HairMapper: Removing Hair from Portraits Using GANs
⭐code - Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps
😮oral🏠project - Drop the GAN: In Defense of Patches Nearest Neighbors As Single Image Generative Models
- On Aliased Resizing and Surprising Subtleties in GAN Evaluation
⭐code🏠project - Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignment
- Depth-Aware Generative Adversarial Network for Talking Head Video Generation
⭐code - Efficient Geometry-Aware 3D Generative Adversarial Networks
⭐code🏠project - DO-GAN: A Double Oracle Framework for Generative Adversarial Networks
- GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation
⭐code - CoordGAN: Self-Supervised Dense Correspondences Emerge From GANs
⭐code🏠project📺video - HyperStyle: StyleGAN Inversion With HyperNetworks for Real Image Editing
⭐code🏠project - Spatially-Adaptive Multilayer Selection for GAN Inversion and Editing
- Improving GAN Equilibrium by Raising Spatial Awareness
⭐code🏠project - SphericGAN: Semi-Supervised Hyper-Spherical Generative Adversarial Networks for Fine-Grained Image Synthesis
- Pix2NeRF: Unsupervised Conditional p-GAN for Single Image to Neural Radiance Fields Translation
⭐code - Think Twice Before Detecting GAN-Generated Fake Images From Their Spectral Domain Imprints
- Ensembling Off-the-Shelf Models for GAN Training
😮oral⭐code🏠project - Style Transformer for Image Inversion and Editing
⭐code - 图像篡改检测
- 头发编辑
- Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks
- Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation
⭐code - InstaFormer: Instance-Aware Image-to-Image Translation with Transformer
- Unsupervised Image-to-Image Translation with Generative Prior
⭐code🏠project📺video - Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint
⭐code📰解读 - Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation
- QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translation
⭐code
- Synthetic Generation of Face Videos With Plethysmograph Physiology
🏠project - Protecting Celebrities with Identity Consistency Transformer
- PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer
⭐code - How Much Does Input Data Type Impact Final Face Model Accuracy?
- HP-Capsule: Unsupervised Face Part Discovery by Hierarchical Parsing Capsule Network
- Deepfake
- 妆容迁移
- 人脸识别
- Local-Adaptive Face Recognition via Graph-based Meta-Clustering and Regularized Adaptation
- Killing Two Birds with One Stone:Efficient and Robust Training of Face Recognition CNNs by Partial FC
⭐code - AdaFace: Quality Adaptive Margin for Face Recognition
😮oral⭐code - Killing Two Birds With One Stone: Efficient and Robust Training of Face Recognition CNNs by Partial FC
⭐code - Learning To Learn Across Diverse Data Biases in Deep Face Recognition
- 人脸表情识别
- 三维人像
- 3D人脸
- 活体检测
- 假脸检测
- 人脸交换
- 人脸属性分类
- Face Relighting(人脸重照光)
- 人脸编辑
- 人脸幻构
- Deepfake检测
- 人脸重建
- 人脸捕捉
- 换头
- 人像畸变矫正
- 3D人脸建模
- 人脸修复
- 人脸对齐
- 语音驱动的3D脸部动画
- 舌头三维重建
- 伪造图像检测
- 人脸解析
- 人脸表情
- 人脸检测
- 人脸重现
- 说话人脸生成
- 人脸关键点
- 人脸变形
- 3D人脸表情合成
- 语音驱动的动画舌头
- Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
- Depth-Guided Sparse Structure-from-Motion for Movies and TV Shows
⭐code - 3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection
😮oral⭐code📰解读 - Physical Simulation Layer for Accurate 3D Modeling
- φ-SfT: Shape-from-Template with a Physics-Based Deformation Model
🏠project - ICON: Implicit Clothed Humans Obtained From Normals
⭐code🏠project - Representing 3D Shapes With Probabilistic Directed Distance Fields
- Improving Neural Implicit Surfaces Geometry With Patch Warping
⭐code - LOLNerf: Learn From One Look
🏠project - Neural Mesh Simplification
- Extracting Triangular 3D Models, Materials, and Lighting From Images
😮oral⭐code🏠project - Stereo Merging
- PSMNet: Position-aware Stereo Merging Network for Room Layout Estimation
- GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature
⭐code - Degradation-agnostic Correspondence from Resolution-asymmetric Stereo
- Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation
😮oral⭐code📰解读
- stereo matching
- Chitransformer: Towards Reliable Stereo From Cues
⭐code - Uniform Subdivision of Omnidirectional Camera Space for Efficient Spherical Stereo Matching
- FoggyStereo: Stereo Matching With Fog Volume Representation
- ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networks
⭐code
- Chitransformer: Towards Reliable Stereo From Cues
- 深度估计
- OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion
😮oral⭐code - NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimation
⭐code🏠project - 🐦️Toward Practical Self-Supervised Monocular Indoor Depth Estimation
- P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior
⭐code - HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Model
- Multi-Frame Self-Supervised Depth with Transformers
- Layered Depth Refinement with Mask Guidance
🏠project - 360MonoDepth: High-Resolution 360deg Monocular Depth Estimation
⭐code🏠project - Towards Multimodal Depth Estimation from Light Fields
- Multi-Frame Self-Supervised Depth with Transformers
- Exploiting Pseudo Labels in a Self-Supervised Learning Framework for Improved Monocular Depth Estimation
- Rethinking Depth Estimation for Multi-View Stereo: A Unified Representation
⭐code - [Multi-View Depth Estimation by Fusing Single-View Depth Probability With Multi-View Geometry](Multi-View Depth Estimation by Fusing Single-View Depth Probability With Multi-View Geometry)
😮oral⭐code - Toward Practical Monocular Indoor Depth Estimation
- Single-Stage 3D Geometry-Preserving Depth Estimation Model Training on Dataset Mixtures With Uncalibrated Stereo Data
- Stereo Depth From Events Cameras: Concentrate and Focus on the Future
⭐code - Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light
⭐code
- OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion
- 房间布局
- MVS
- RayMVSNet: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereo
- TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers
⭐code📰解读 - Non-parametric Depth Distribution Modelling based Depth Inference for Multi-view Stereo
⭐code - IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo
⭐[code] (https://github.com/FangjinhuaWang/IterMVS) - Generalized Binary Search Network for Highly-Efficient Multi-View Stereo
⭐code - MVPS
- 三维重建
- PlaneMVS: 3D Plane Reconstruction from Multi-View Stereo
- Self-supervised Neural Articulated Shape and Appearance Models
🏠project - BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusion
- Topologically-Aware Deformation Fields for Single-View 3D Reconstruction
⭐code🏠project - Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstruction
⭐code🏠project📰解读 - What's in your hands? 3D Reconstruction of Generic Objects in Hands
⭐code🏠project📺video📰解读 - Surface Reconstruction from Point Clouds by Learning Predictive Context Priors
⭐code - FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstruction
⭐code
📰解读 - KeyTr: Keypoint Transporter for 3D Reconstruction of Deformable Objects in Videos
- SPAMs: Structured Implicit Parametric Models
🏠project📺video - Enhancing Face Recognition With Self-Supervised 3D Reconstruction
- Neural Fields As Learnable Kernels for 3D Reconstruction
🏠project - 三维场景重建
- Neural 3D Scene Reconstruction with the Manhattan-world Assumption
😮oral⭐code🏠project📺video📰解读 - StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions
⭐code🏠project📺video - PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes
⭐code - Look Outside the Room: Synthesizing a Consistent Long-Term 3D Scene Video From a Single Image
⭐code🏠project
- Neural 3D Scene Reconstruction with the Manhattan-world Assumption
- 手物重建
- 三维服装网格重建
- 三维网格重建
- 三维形状重建
- 三维服装变形
- 纹理迁移与合成
- 形状匹配
- 表面重建
- 多视图网格重建
- 3D形状分析
- 三维补全
- 图像重建
- PS
- 预测三维物体形状
- 三维形状
- 神经三维内容生成
- 深度补全
- 线段重建
- 形状重建
- 3D形状生成
- COAP: Compositional Articulated Occupancy of People
⭐code🏠project📺video📰解读 - Context-Aware Sequence Alignment using 4D Skeletal Augmentation
😮oral⭐code🏠project - Generalizable Human Pose Triangulation
- Location-Free Human Pose Estimation
📰解读 - Meta Agent Teaming Active Learning for Pose Estimation
- 多人姿态估计
- 基于视频的HPE
- 3D pose
- MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Video
- PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision
😮oral⭐code - Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation
🏠project - Single-Stage Is Enough: Multi-Person Absolute 3D Pose Estimation
- Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation
📰精准高效估计多人3D姿态，美图&北航分布感知式单阶段模型 - Forecasting Characteristic 3D Poses of Human Actions
📺video - Ray3D: Ray-Based 3D Human Pose Estimation for Monocular Absolute 3D Localization
⭐code - Estimating Egocentric 3D Human Pose in the Wild With External Weak Supervision
🏠project - ElePose: Unsupervised 3D Human Pose Estimation by Predicting Camera Elevation and Learning Normalizing Flows on 2D Poses
⭐code - MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation
⭐code - PoseKernelLifter: Metric Lifting of 3D Human Pose Using Sound
- 4D 人体捕获
- 运动捕捉
- 手臂-手部动态估计
- 3D人体形状
- Dense correspondence
- 3D人体运动重建
- 三维人体姿态重建
- 人体网格恢复
- 人体运动描述
- 三维人体动作
- 三维人体合成
- HSC
- 3D人体运动合成
- 人体重建
- 手部姿态
- 手部网格重建
- 3D手部姿势
- 音频驱动的手势重演
- 3D手重建
- 手部跟踪
- 手势生成
- 3D手网格估计
- 动作检测
- Colar: Effective and Efficient Online Action Detection by Consulting Exemplars
- Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos
- End-to-End Semi-Supervised Learning for Video Action Detection
- SPAct: Self-supervised Privacy Preservation for Action Recognition
⭐code - Temporal Alignment Networks for Long-term Video
😮oral⭐code🏠project📰粗解 - SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognition
- GateHUB: Gated History Unit With Background Suppression for Online Action Detection
- MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection
⭐code - Look for the Change: Learning Object States and State-Modifying Actions From Untrimmed Web Videos
🏠project - Uncertainty-Guided Probabilistic Transformer for Complex Action Recognition
- Learning From Temporal Gradient for Semi-Supervised Action Recognition
⭐code - DirecFormer: A Directed Attention in Transformer Approach to Robust Action Recognition
⭐code - Interact Before Align: Leveraging Cross-Modal Knowledge for Domain Adaptive Action Recognition
- Object-Relation Reasoning Graph for Action Recognition
- Revisiting Skeleton-Based Action Recognition
😮oral⭐code - InfoGCN: Representation Learning for Human Skeleton-Based Action Recognition
- E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition
⭐code - 零样本动作识别
- 小样本动作识别
- 时序动作检测
- 时序动作定位
- Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation
⭐code📰粗解 - Unsupervised Pre-training for Temporal Action Localization Tasks
⭐code - ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization
⭐code - Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localization
⭐code - Structured Attention Composition for Temporal Action Localization
⭐code - Learning To Refactor Action and Co-Occurrence Features for Temporal Action Localization
- Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation
- 重复动作计数
- 组动作识别
- 动作质量评估
- 活动识别
- Shape-invariant 3D Adversarial Point Clouds
⭐code - AziNorm: Exploiting the Radial Symmetry of Point Cloud for Azimuth-Normalized 3D Perception
⭐code - REGTR: End-to-end Point Cloud Correspondences with Transformers
⭐code - Equivariant Point Cloud Analysis via Learning Orientations for Message Passing
⭐code - Text2Pos: Text-to-Point-Cloud Cross-Modal Localization
⭐code🏠project - Deformation and Correspondence Aware Unsupervised Synthetic-to-Real Scene Flow Estimation for Point Clouds
⭐code - Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation
⭐code📰解读 - 3DeformRS: Certifying Spatial Deformations on Point Clouds
⭐code - Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors
⭐code📰解读 - Density-preserving Deep Point Cloud Compression
⭐code🏠project📰解读 - Surface Representation for Point Clouds
😮oral⭐code
📰解读1
📰解读2 - Neural Points: Point Cloud Representation With Neural Fields for Arbitrary Upsampling
⭐code - Point Cloud Pre-Training With Natural 3D Structures
⭐code🏠project - Not All Points Are Equal: Learning Highly Efficient Point-Based Detectors for 3D LiDAR Point Clouds
⭐code - Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinders
- RigidFlow: Self-Supervised Scene Flow Learning on Point Clouds by Local Rigidity Prior
- PatchFormer: An Efficient Point Transformer With Patch Attention
- PhyIR: Physics-Based Inverse Rendering for Panoramic Indoor Images
- Point Cloud Color Constancy
⭐code - Multimodal Colored Point Cloud to Image Alignment
- No Pain, Big Gain: Classify Dynamic Point Cloud Sequences With Static Models by Fitting Feature-Level Space-Time Surfaces
⭐code - Domain Adaptation on Point Clouds via Geometry-Aware Implicits
⭐code - 3D 点云
- Point-BERT: Pre-Training 3D Point Cloud Transformers With Masked Point Modeling
⭐code - CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding
⭐code📰粗解
CrossPoint，一个用于 3D 点云表征学习的简单自监督学习框架。虽然该方法是在合成的三维物体数据集上训练的，但在下游任务中的实验结果，如三维物体分类和三维物体部分分割，在合成和真实世界的数据集中都证明了该方法在学习可迁移表征方面的有效性。 - IDEA-Net: Dynamic 3D Point Cloud Interpolation via Deep Embedding Alignment
⭐code - A Unified Query-based Paradigm for Point Cloud Understanding
⭐code - WarpingGAN: Warping Multiple Uniform Priors for Adversarial 3D Point Cloud Generation
⭐code - 3DJCG: A Unified Framework for Joint Dense Captioning and Visual Grounding on 3D Point Clouds
- Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks With Implicit Gradients
🏠project - Why Discard if You Can Recycle?: A Recycling Max Pooling Module for 3D Point Cloud Analysis
- Point-BERT: Pre-Training 3D Point Cloud Transformers With Masked Point Modeling
- 3D点云分割
- 点云分类
- 点云配准
- SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration
⭐code
📰二阶相似性测度，让传统配准方法取得比深度学习更好的性能，并达到深度学习的速度 - Multi-Instance Point Cloud Registration by Efficient Correspondence Clustering
⭐code - Deterministic Point Cloud Registration via Novel Transformation Decomposition
📰解读 - SC2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration
⭐code
- SC^2-PCR: A Second Order Spatial Compatibility for Efficient and Robust Point Cloud Registration
- 点云补全
- 点云分割
- Contrastive Boundary Learning for Point Cloud Segmentation
⭐code📰解读 - SemAffiNet: Semantic-Affine Transformation for Point Cloud Segmentation
⭐code📰解读 - An MIL-Derived Transformer for Weakly Supervised Point Cloud Segmentation
⭐code - Pyramid Architecture for Multi-Scale Processing in Point Cloud Segmentation
⭐code
- Contrastive Boundary Learning for Point Cloud Segmentation
- 点云匹配
- 场景流估计
- TCTrack: Temporal Contexts for Aerial Tracking
⭐code📰粗解
📰TCTrack: 用于空中跟踪的时序信息框架 - Correlation-Aware Deep Tracking
- Global Tracking Transformers
⭐code - Unified Transformer Tracker for Object Tracking
⭐code - Global Tracking via Ensemble of Local Trackers
- Unsupervised Learning of Accurate Siamese Tracking
⭐code - Transformer Tracking with Cyclic Shifting Window Attention
⭐code
Transformer 跟踪：循环为一窗口注意力模型。该算法在五个数据集VOT2020, UAV123, LaSOT, TrackingNet, GOT-10k上均实现了新的SOTA. - Tracking People by Predicting 3D Appearance, Location and Pose
😮oral⭐code🏠project - Cannot See the Forest for the Trees: Aggregating Multiple Viewpoints to Better Classify Objects in Videos
⭐code - Opening Up Open World Tracking
😮oral⭐code🏠project - Transforming Model Prediction for Tracking
⭐code - PyMiceTracking: An Open-Source Toolbox for Real-Time Behavioral Neuroscience Experiments
⭐code - Spiking Transformers for Event-Based Single Object Tracking
⭐code - Correlation-Aware Deep Tracking
- 3D 目标跟踪
- 多目标跟踪
- Learning of Global Objective for Network Flow in Multi-Object Tracking
- MeMOT: Multi-Object Tracking with Memory
😮oral - Multi-Object Tracking Meets Moving UAV
- Adiabatic Quantum Computing for Multi Object Tracking
- Towards Discriminative Representation: Multi-View Trajectory Contrastive Learning for Online Multi-Object Tracking
- LMGP: Lifted Multicut Meets Geometry Projections for Multi-Camera Multi-Object Tracking
⭐code
- RGB-T跟踪
- 视觉跟踪
- 夜间跟踪
- DN-DETR: Accelerate DETR Training by Introducing Query DeNoising
⭐code📰粗解 - Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation
⭐code - ESCNet: Gaze Target Detection with the Understanding of 3D Scenes
⭐code - Segment and Complete: Defending Object Detectors Against Adversarial Patch Attacks With Robust Patch Detection
⭐code - Interactron: Embodied Adaptive Object Detection
⭐code - Beyond Bounding Box: Multimodal Knowledge Learning for Object Detection
以往目标检测往往以目标包围框作为标注训练，作者引入语言提示信息，提炼语言知识到目标检测模型中，获得了1.6~2.1%的性能增益。 - Dynamic Sparse R-CNN
- Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wild
⭐code📰粗解 - Focal and Global Knowledge Distillation for Detectors
⭐code📰解读
关于目标检测的知识蒸馏工作，只需要30行代码就可以在 anchor-base, anchor-free 的单阶段、两阶段各种检测器上稳定涨点，现在代码已经开源。 - Group R-CNN for Weakly Semi-supervised Object Detection with Points
⭐code
📰解读 - Real-time Object Detection for Streaming Perception
⭐code📰解读 - Ev-TTA: Test-Time Adaptation for Event-Based Object Recognition
- Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model
⭐code - Optimal Correction Cost for Object Detection Evaluation
- Expanding Low-Density Latent Regions for Open-Set Object Detection
⭐code
📰解读 - SIOD: Single Instance Annotated Per Category Per Image for Object Detection
⭐code
📰解读 - Task-specific Inconsistency Alignment for Domain Adaptive Object Detection
⭐code - Zero-Query Transfer Attacks on Context-Aware Object Detectors
- AdaMixer: A Fast-Converging Query-Based Object Detector
😮oral⭐code - Learning to Detect Mobile Objects from LiDAR Scans Without Labels
⭐code - Forecasting from LiDAR via Future Object Detection
⭐code - Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection
😮oral⭐code - Multi-Granularity Alignment Domain Adaptation for Object Detection
- Proper Reuse of Image Classification Features Improves Object Detection
⭐code - R(Det)^2: Randomized Decision Routing for Object Detection
- Towards Robust Adaptive Object Detection under Noisy Annotations
⭐code - Entropy-based Active Learning for Object Detection with Progressive Diversity Constraint
- Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection
- Interactive Segmentation and Visualization for Tiny Objects in Multi-megapixel Images
⭐code - Cross Domain Object Detection by Target-Perceived Dual Branch Distillation
⭐code
跨域目标检测：目标感知双分支蒸馏 - Progressive End-to-End Object Detection in Crowded Scenes
⭐code
📰解读 - HCSC: Hierarchical Contrastive Selective Coding
⭐code
📰CNN自监督预训练新SOTA：上交、Mila、字节联合提出具有层级结构的图像表征自学习新框架 - Recurrent Glimpse-based Decoder for Detection with Transformer
😮oral⭐code
📰解读 - Continual Object Detection via Prototypical Task Correlation Guided Gating Mechanism
⭐code - Balanced and Hierarchical Relation Learning for One-Shot Object Detection
⭐code - Accelerating DETR Convergence via Semantic-Aligned Matching
⭐code - DETReg: Unsupervised Pretraining With Region Priors for Object Detection
⭐code🏠project - Source-Free Object Detection by Learning To Overlook Domain Style
- DESTR: Object Detection With Split Transformer
- SmartAdapt: Multi-Branch Object Detection Framework for Videos on Mobiles
- Explore Spatio-Temporal Aggregation for Insubstantial Object Detection: Benchmark Dataset and Baseline
⭐code - Exploring Endogenous Shift for Cross-Domain Detection: A Large-Scale Benchmark and Perturbation Suppression Network
- Not All Labels Are Equal: Rationalizing the Labeling Costs for Training Object Detection
⭐code - Training Object Detectors From Scratch: An Empirical Study in the Era of Vision Transformer
- Sequential Voting With Relational Box Fields for Active Object Detection
⭐code🏠project - Simple Multi-dataset Detection
⭐code - ObjectFormer for Image Manipulation Detection and Localization
- 小目标检测
- 小样本目标检测
- 目标定位
- Weakly Supervised Object Localization as Domain Adaption
⭐code📰粗解 - Bridging the Gap between Classification and Localization for Weakly Supervised Object Localization
- Object Localization under Single Coarse Point Supervision
⭐code
📰解读 - CREAM: Weakly Supervised Object Localization via Class RE-Activation Mapping
⭐code
- Weakly Supervised Object Localization as Domain Adaption
- 3D目标检测
- A Versatile Multi-View Framework for LiDAR-based 3D Object Detection with Guidance from Panoptic Segmentation
- Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection From Point Clouds
⭐code - Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving
⭐code📰粗解 - Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Task
🏠project - Point2Seq: Detecting 3D Objects as Sequences
⭐code - MonoDETR: Depth-aware Transformer for Monocular 3D Object Detection
⭐code - Canonical Voting: Towards Robust Oriented Bounding Box Detection in 3D Scenes
⭐code
📰粗解 - Exploring Geometric Consistency for Monocular 3D Object Detection
- LiDAR Snowfall Simulation for Robust 3D Object Detection
😮oral⭐code - CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection
- Homography Loss for Monocular 3D Object Detection
- HyperDet3D: Learning a Scene-conditioned 3D Object Detector
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection
⭐code - OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data
⭐code - Focal Sparse Convolutional Networks for 3D Object Detection
😮oral⭐code📰解读📓 - Rotationally Equivariant 3D Object Detection
🏠project - Bridged Transformer for Vision and Point Cloud 3D Object Detection
📰解读 - Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completion
📰解读 - VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention
⭐code
📰华南理工提出VISTA：双跨视角空间注意力机制实现3D目标检测SOTA，即插即用 - Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection
😮oral - MonoDTR: Monocular 3D Object Detection With Depth-Aware Transformer
⭐code - Voxel Field Fusion for 3D Object Detection
⭐code
📰解读 - DisARM: Displacement Aware Relation Module for 3D Detection
⭐code - Back to Reality: Weakly-supervised 3D Object Detection with Shape-guided Label Enhancement
⭐code - Embracing Single Stride 3D Object Detector With Sparse Transformer
⭐code - 3D-VField: Adversarial Augmentation of Point Clouds for Domain Generalization in 3D Object Detection
🏠project - Dimension Embeddings for Monocular 3D Object Detection
- MonoJSG: Joint Semantic and Geometric Cost Volume for Monocular 3D Object Detection
⭐code - RBGNet: Ray-Based Grouping for 3D Object Detection
⭐code - LIFT: Learning 4D LiDAR Image Fusion Transformer for 3D Object Detection
- 伪装目标检测
- 全监督目标检测
- 半监督目标检测
- 弱监督目标检测
- 显著目标检测
- Pyramid Grafting Network for One-Stage High Resolution Saliency Detection
⭐code📰解读
📰超高分辨率显著目标检测，新颖高效的错层嫁接架构PGNet（CVPR2022） - Learning from Pixel-Level Noisy Label : A New Perspective for Light Field Saliency Detection
⭐code📰解读 - Bi-directional Object-context Prioritization Learning for Saliency Ranking
⭐code - Multi-Source Uncertainty Mining for Deep Unsupervised Saliency Detection
- Learning From Pixel-Level Noisy Label: A New Perspective for Light Field Saliency Detection
⭐code
- Pyramid Grafting Network for One-Stage High Resolution Saliency Detection
- 密集目标检测
- Co-Salient目标检测
- 长尾目标检测
- 旋转目标检测
- 关键点检测
- object discovery
- Affordance grounding
- 图像对齐
- 物体属性识别
- 消影点检测
- 红外探测线
- OOD
- Deep Hybrid Models for Out-of-Distribution Detection
- Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detection
- Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization
🌻dataset - PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures
⭐code - The Two Dimensions of Worst-Case Training and Their Integrated Effect for Out-of-Domain Generalization
- Out-of-Distribution Generalization With Causal Invariant Transformations
- ViM: Out-Of-Distribution with Virtual-logit Matching
⭐code - OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization
⭐code
- 开放世界目标检测
- 域适应目标检测
- X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
⭐code - Quantifying Societal Bias Amplification in Image Captioning
- NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Models
- It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collection
⭐code🏠project - Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning
- DIFNet: Boosting Visual Information Flow for Image Captioning
⭐code
📰解读 - VisualGPT: Data-Efficient Adaptation of Pretrained Language Models for Image Captioning
⭐code - Comprehending and Ordering Semantics for Image Captioning
⭐code
📰解读 - DeeCap: Dynamic Early Exiting for Efficient Image Captioning
⭐code - Show, Deconfound and Tell: Image Captioning With Causal Inference
⭐code - Novel Object Captioning
- 图像恢复
- Attentive Fine-Grained Structured Sparsity for Image Restoration
⭐code📰解读 - Uformer: A General U-Shaped Transformer for Image Restoration
⭐code - Burst Image Restoration and Enhancement
😮oral⭐code - BNUDC: A Two-Branched Deep Neural Network for Restoring Images From Under-Display Cameras
- Restormer: Efficient Transformer for High-Resolution Image Restoration
😮oral⭐code - TransWeather: Transformer-Based Restoration of Images Degraded by Adverse Weather Conditions
⭐code - Deep Generalized Unfolding Networks for Image Restoration
⭐code - Self-Supervised Deep Image Restoration via Adaptive Stochastic Gradient Langevin Dynamics
⭐code
- Attentive Fine-Grained Structured Sparsity for Image Restoration
- 图像修复
- Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding
⭐code📰粗解 - MAT: Mask-Aware Transformer for Large Hole Image Inpainting
⭐code - Reduce Information Loss in Transformers for Pluralistic Image Inpainting
⭐code - UniCoRN: A Unified Conditional Image Repainting Network
- Dual-Path Image Inpainting With Auxiliary GAN Inversion
- Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding
- 图像拼接
- 运动去模糊
- image outpainting
- 图像美学评估
- 图像质量评估
- 图像去雨
- 图像去模糊
- Learning to Deblur using Light Field Generated and Real Defocus Images
⭐code🏠project - Pixel Screening Based Intermediate Correction for Blind Deblurring
- Deblurring via Stochastic Refinement
- XYDeblur: Divide and Conquer for Single Image Deblurring
- Towards Multi-Domain Single Image Dehazing via Test-Time Training
- Learning to Deblur using Light Field Generated and Real Defocus Images
- 图像压缩
- SASIC: Stereo Image Compression With Latent Shifts and Stereo Attention
⭐code - Global Sensing and Measurements Reuse for Image Compressed Sensing
⭐code - DPICT: Deep Progressive Image Compression Using Trit-Planes
😮oral⭐code - Joint Global and Local Hierarchical Priors for Learned Image Compression
⭐code - Neural Data-Dependent Transform for Learned Image Compression
⭐code🏠project - LC-FDNet: Learned Lossless Image Compression With Frequency Decomposition Network
⭐code - ELIC: Efficient Learned Image Compression With Unevenly Grouped Space-Channel Contextual Adaptive Coding
😮oral - Deep Stereo Image Compression via Bi-Directional Coding
- SASIC: Stereo Image Compression With Latent Shifts and Stereo Attention
- 图像去噪
- CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image
⭐code - NAN: Noise-Aware NeRFs for Burst-Denoising
- Blind2Unblind: Self-Supervised Image Denoising With Visible Blind Spots
⭐code - AP-BSN: Self-Supervised Denoising for Real-World Images via Asymmetric PD and Blind-Spot Network
⭐code - RePaint: Inpainting Using Denoising Diffusion Probabilistic Models
⭐code
- CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image
- 图像去雾
- De-rendering
- Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata
⭐code📰解读 - De-Rendering 3D Objects in the Wild
⭐code - IDR: Self-Supervised Image Denoising via Iterative Data Refinement
⭐code - RADU: Ray-Aligned Depth Update Convolutions for ToF Data Denoising
⭐code - Self-augmented Unpaired Image Dehazing via Density and Depth Decomposition
⭐code
📰解读
- Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata
- 图像增强
- Toward Fast, Flexible, and Robust Low-Light Image Enhancement
😮oral⭐code📰解读
📰SCI：快速、灵活与稳健的低光照图像增强方法（CVPR 2022 Oral） - AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image Enhancement
⭐code - Directional Self-supervised Learning for Heavy Image Augmentations
⭐code
📰解读 - Abandoning the Bayer-Filter To See in the Dark
⭐code - URetinex-Net: Retinex-Based Deep Unfolding Network for Low-Light Image Enhancement
⭐code - GIQE: Generic Image Quality Enhancement via Nth Order Iterative Degradation
- Toward Fast, Flexible, and Robust Low-Light Image Enhancement
- 图像和谐化
- 图像超级补全
- Scene Graph Expansion for Semantics-Guided Image Outpainting
该文解决了一个非常有意思的问题，通过对图像场景图的扩展，对图像边缘以外的内容进行语义引导的内容生成，可帮助设计师快速绘就自然和谐的图像扩展内容。
- Scene Graph Expansion for Semantics-Guided Image Outpainting
- 语义图像匹配
- 图像修饰
- 图像着色
- 图像校正
- 图像分解
- 图像重建
- 图像配准
- A Variational Bayesian Method for Similarity Learning in Non-Rigid Image Registration
⭐code - NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registration
- RFNet: Unsupervised Network for Mutually Reinforcing Multi-Modal Image Registration and Fusion
- Aladdin: Joint Atlas Building and Diffeomorphic Registration Learning With Pairwise Alignment
⭐code
- A Variational Bayesian Method for Similarity Learning in Non-Rigid Image Registration
- 图像编辑
- 图像缩放
- 图像色彩编辑
- 图像拼图
- 图像裁剪
- 图像补全
- 基于文本指导的图像操作
- Image Dewarping
- FocalClick: Towards Practical Interactive Image Segmentation
⭐code📰粗解 - Multimodal Material Segmentation
- Semantic-Aware Domain Generalized Segmentation
😮oral⭐code - ReSTR: Convolution-free Referring Image Segmentation Using Transformers
⭐code🏠project - CRIS: CLIP-Driven Referring Image Segmentation
- Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
🏠project
全景神经场：谷歌新提出的语义级目标感知的神经场景表示模型。该表示模型可以有效地用于新视图合成、2D 全景分割、3D 场景编辑和多视图深度预测等多项任务。相信这又会是一个引领潮流的新方向。 - FocusCut: Diving Into a Focus View in Interactive Segmentation
🏠project - Hyperbolic Image Segmentation
⭐code - Clustering Plotted Data by Image Segmentation
⭐code - Generalizable Cross-Modality Medical Image Segmentation via Style Augmentation and Dual Normalization
⭐code - Image Segmentation Using Text and Image Prompts
⭐code - ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation
⭐code
📰解读 - Adaptive Early-Learning Correction for Segmentation From Noisy Annotations
⭐code - Weakly Supervised Segmentation on Outdoor 4D Point Clouds With Temporal Matching and Spatial Graph Propagation
- Masked-Attention Mask Transformer for Universal Image Segmentation
⭐code🏠project - 实例分割
- E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentation
⭐code📰粗解 - Open-Vocabulary Instance Segmentation via Robust Cross-Modal Pseudo-Labeling
⭐code - Sparse Instance Activation for Real-Time Instance Segmentation
⭐code - SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentation
🏠project - Open-World Instance Segmentation: Exploiting Pseudo Ground Truth From Learned Pairwise Affinity
⭐code🏠project - DArch: Dental Arch Prior-assisted 3D Tooth Instance Segmentation
- Relieving Long-tailed Instance Segmentation via Pairwise Class Balance
⭐code📰解读 - ContrastMask: Contrastive Learning to Segment Every Thing
📰解读
基于像素级对比学习的不完全监督实例分割算法 - GASP, a Generalized Framework for Agglomerative Clustering of Signed Graphs and Its Application to Instance Segmentation
⭐code - TWIST: Two-Way Inter-Label Self-Training for Semi-Supervised 3D Instance Segmentation
⭐code - Pointly-Supervised Instance Segmentation
😮oral⭐code🏠project - Instance Segmentation With Mask-Supervised Polygonal Boundary Transformers
⭐code - 半监督实例分割
- 3D 实例分割
- 🐦️FreeSOLO: Learning to Segment Objects without Annotations
⭐code - 小样本分割
- E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentation
- 语义分割
- Generalized Few-Shot Semantic Segmentation
⭐[code](https://github.com/XinyuLyu/FGPL - Scribble-Supervised LiDAR Semantic Segmentation
😮oral⭐code - Novel Class Discovery in Semantic Segmentation
⭐code🏠project - Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation
⭐code - Semi-Supervised Video Semantic Segmentation With Inter-Frame Feature Reconstruction
⭐code - Pin the Memory: Learning to Generalize Semantic Segmentation
⭐code📰解读 - Representation Compensation Networks for Continual Semantic Segmentation
⭐code - Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentation
⭐code📰解读 - GroupViT: Semantic Segmentation Emerges from Text Supervision
⭐code🏠project📺video
📰做语义分割不用任何像素标签，UCSD、英伟达在ViT中加入分组模块 - Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation
⭐code📰粗解 - Deep Hierarchical Semantic Segmentation
⭐code - Semantic Segmentation by Early Region Proxy
⭐code📰粗解 - SimT: Handling Open-set Noise for Domain Adaptive Semantic Segmentation
⭐code - Rethinking Semantic Segmentation: A Prototype View
😮oral⭐code - On the Road to Online Adaptation for Semantic Image Segmentation
⭐code - Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholds
⭐code - NightLab: A Dual-level Architecture with Hardness Detection for Segmentation at Night
⭐code📰解读 - TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation
- Cross-Image Relational Knowledge Distillation for Semantic Segmentation
⭐code📰解读 - Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation
- Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers
⭐code - Self-Supervised Learning of Object Parts for Semantic Segmentation
⭐code - Cross-view Transformers for real-time Map-view Semantic Segmentation
😮oral⭐code - Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization
🏠project - Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation
⭐code📰解读 - Real-Time, Accurate, and Consistent Video Semantic Segmentation via Unsupervised Adaptation and Cross-Unit Deployment on Mobile Device
- Partial Class Activation Attention for Semantic Segmentation
⭐code - Incremental Learning in Semantic Segmentation From Image Labels
⭐code - HybridCR: Weakly-Supervised 3D Point Cloud Semantic Segmentation via Hybrid Contrastive Regularization
📰解读 - 3D分割
- 弱监督语义分割
- Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation
⭐code📰粗解 - Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentation
⭐code - Contrastive learning of Class-agnostic Activation Map for Weakly Supervised Object Localization and Semantic Segmentation
⭐code - Cross Language Image Matching for Weakly Supervised Semantic Segmentation
⭐code - Multi-class Token Transformer for Weakly Supervised Semantic Segmentation
⭐code - Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformers
⭐code📰解读 - Weakly Supervised Semantic Segmentation using Out-of-Distribution Data
⭐code📰粗解 - L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentation
⭐code - Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast
- CLIMS: Cross Language Image Matching for Weakly Supervised Semantic Segmentation
⭐code - Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation
⭐code
- Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation
- 无监督语义分割
- 半监督语义分割
- Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels
- Semi-supervised Semantic Segmentation with Error Localization Network
⭐code🏠project📰粗解 - UCC: Uncertainty guided Cross-head Co-training for Semi-Supervised Semantic Segmentation
- Perturbed and Strict Mean Teachers for Semi-Supervised Semantic Segmentation
⭐code
- 域适应语义分割
- 域泛化语义分割
- 小样本语义分割
- 跨域语义分割
- Generalized Few-Shot Semantic Segmentation
- 动作分割
- 场景解析
- 雾景分割
- 全景分割
- Panoptic, Instance and Semantic Relations: A Relational Context Encoder to Enhance Panoptic Segmentation
- Joint Forecasting of Panoptic Segmentations with Difference Attention
⭐code📰解读 - PanopticDepth: A Unified Framework for Depth-aware Panoptic Segmentation
⭐code📰解读 - Amodal Panoptic Segmentation
🏠project - Panoptic-PHNet: Towards Real-Time and High-Precision LiDAR Panoptic Segmentation via Clustering Pseudo Heatmap
- CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation
- 视频全景分割
- 抠图
- 玻璃分割
- Amodal Segmentation
- 场景理解
- 人体解析
- Part Segmentation
- 小样本分割
- Learning to Anticipate Future with Dynamic Context Removal
⭐code📰粗解 - Learning Optimal K-space Acquisition and Reconstruction using Physics-Informed Neural Networks
- Instance-wise Occlusion and Depth Orders in Natural Scenes
⭐code - IFOR: Iterative Flow Minimization for Robotic Object Rearrangement
🏠project - PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence
⭐code🏠project📺video📰粗解 - LiT: Zero-Shot Transfer with Locked-image text Tuning
- CAFE: Learning to Condense Dataset by Aligning Features
⭐code📰粗解 - Enhancing Adversarial Robustness for Deep Metric Learning
- BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning
⭐code📰粗解📓 - ACVNet: Attention Concatenation Volume for Accurate and Efficient Stereo Matching
⭐code📰粗解 - Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values
⭐code - Do Explanations Explain? Model Knows Best
⭐code - HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
⭐code - E-CIR: Event-Enhanced Continuous Intensity Recovery
⭐code - 🐦️Transferability Estimation using Bhattacharyya Class Separability
- Interpretable part-whole hierarchies and conceptual-semantic relationships in neural networks
⭐code - GlideNet: Global, Local and Intrinsic based Dense Embedding NETwork for Multi-category Attributes Prediction
⭐code - Differentially Private Federated Learning with Local Regularization and Sparsification
- Towards Efficient and Scalable Sharpness-Aware Minimization
⭐code - DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos
- Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondences
⭐code📰粗解 - Dynamic Dual-Output Diffusion Models
- Moving Window Regression: A Novel Approach to Ordinal Regression
- Egocentric Prediction of Action Target in 3D
- Compositional Temporal Grounding
with Structured Variational Cross-Graph Correspondence Learning
⭐code - Hierarchical Nearest Neighbor Graph Embedding for Efficient Dimensionality Reduction
⭐code - Neural Reflectance for Shape Recovery with Shadow Handling
⭐code - DyRep: Bootstrapping Training with Dynamic Re-parameterization
⭐code - Enhancing Classifier Conservativeness and Robustness by Polynomiality
- Versatile Multi-Modal Pre-Training for Human-Centric Perception
⭐code - Attributable Visual Similarity Learning
⭐code - Optimizing Elimination Templates by Greedy Parameter Search
- Partially Does It: Towards Scene-Level FG-SBIR with Partial Input
- Bi-level Doubly Variational Learning for Energy-based Latent Variable Models
- Brain-inspired Multilayer Perceptron with Spiking Neurons
- ARCS: Accurate Rotation and Correspondence Search
⭐code - iPLAN: Interactive and Procedural Layout Planning
- HINT: Hierarchical Neuron Concept Explainer
⭐code - Visual Abductive Reasoning
⭐code - A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration
⭐code - Learning Structured Gaussians to Approximate Deep Ensembles
- Self-Supervised Image Representation Learning with Geometric Set Consistency
- Balanced Multimodal Learning via On-the-fly Gradient Modulation
😮oral⭐code - CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters
⭐code - Eigencontours: Novel Contour Descriptors Based on Low-Rank Approximation
😮oral - Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian
- Long-term Visual Map Sparsification with Heterogeneous GNN
- Clean Implicit 3D Structure from Noisy 2D STEM Images
- Equivariance Allows Handling Multiple Nuisance Variables When Analyzing Pooled Neuroimaging Datasets
- CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphism
⭐code🏠project - Fast Light-Weight Near-Field Photometric Stereo
- Fast, Accurate and Memory-Efficient Partial Permutation Synchronization
- Multi-Robot Active Mapping via Neural Bipartite Graph Matching
- Learning Program Representations for Food Images and Cooking Recipes
😮oral⭐code🏠project - Iterative Deep Homography Estimation
⭐code - Practical Learned Lossless JPEG Recompression with Multi-Level Cross-Channel Entropy Model in the DCT Domain
- Generating High Fidelity Data from Low-density Regions using Diffusion Models
- Continuous Scene Representations for Embodied AI
⭐code🏠project - It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
- End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps
- Reflection and Rotation Symmetry Detection via Equivariant Learning
⭐code🏠project - Exploiting Explainable Metrics for Augmented SGD
⭐code - On the Importance of Asymmetry for Siamese Representation Learning
⭐code - Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regression
- Perception Prioritized Training of Diffusion Models
⭐code - LASER: LAtent SpacE Rendering for 2D Visual Localization
😮oral - Efficient Maximal Coding Rate Reduction by Variational Forms
- Exemplar-bsaed Pattern Synthesis with Implicit Periodic Field Network
- Progressive Minimal Path Method with Embedded CNN
- Online Convolutional Re-parameterization
⭐code - Consistency driven Sequential Transformers Attention Model for Partially Observable Scenes
⭐code - Leveraging Equivariant Features for Absolute Pose Regression
- Neural Convolutional Surfaces
🏠project - GLASS: Geometric Latent Augmentation for Shape Spaces
⭐code🏠project - Total Variation Optimization Layers for Computer Vision
- Identifying Ambiguous Similarity Conditions via Semantic Matching
⭐code📰解读 - TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates
- Gravitationally Lensed Black Hole Emission Tomography
⭐code🏠project📺video - Robust and Accurate Superquadric Recovery: a Probabilistic Approach
⭐code - Projective Manifold Gradient Layer for Deep Rotation Regression
⭐code - Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale
⭐code - Single-Photon Structured Light
- Explaining Deep Convolutional Neural Networks via Latent Visual-Semantic Filter Attention
😮oral⭐code - Defensive Patches for Robust Recognition in the Physical World
⭐code📰解读 - Event-aided Direct Sparse Odometry
😮oral⭐code🏠project📺video - Deep Unlearning via Randomized Conditionally Independent Hessians
⭐code - Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data
- Towards Data-Free Model Stealing in a Hard Label Setting
⭐code🏠project - Proto2Proto: Can you recognize the car, the way I do?
⭐code - Balanced MSE for Imbalanced Visual Regression
😮oral⭐code
📰CVPR 2022 (Oral) | 回归标签不平衡? 试试Balanced MSE - Leveraging Unlabeled Data for Sketch-based Understanding
- Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction
⭐code🏠project - Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs
⭐code📰解读 - RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality
⭐code📰解读 - An Image Patch is a Wave: Quantum Inspired Vision MLP
😮oral⭐code - A ConvNet for the 2020s
⭐code - NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations
头发建模：仅用一幅图像，构建高保真度的头发模型，使用隐式神经表示的方法。出自浙大CAD&CG组、ETH Zurich、香港城市大学。 - A Unified Framework for Implicit Sinkhorn Differentiation
⭐code
📰解读 - Towards Better Understanding Attribution Methods
⭐code - Universal Photometric Stereo Network using Global Lighting Contexts
⭐code🏠project📺video📰解读 - Estimating Example Difficulty Using Variance of Gradients
- One Loss for Quantization: Deep Hashing with Discrete Wasserstein Distributional Matching
- Holocurtains: Programming Light Curtains via Binary Holography
- Do Learned Representations Respect Causal Relationships?
- CAPRI-Net: Learning Compact CAD Shapes With Adaptive Primitive Assembly
- Mixed Differential Privacy in Computer Vision
- Which Model To Transfer? Finding the Needle in the Growing Haystack
- Learning Soft Estimator of Keypoint Scale and Orientation With Probabilistic Covariant Loss
⭐code - RAGO: Recurrent Graph Optimizer For Multiple Rotation Averaging
⭐code - Virtual Elastic Objects
🏠project - Bayesian Invariant Risk Minimization
⭐code - Shape From Polarization for Complex Scenes in the Wild
⭐code - Non-Iterative Recovery from Nonlinear Observations using Generative Models
- Moving Window Regression: A Novel Approach to Ordinal Regression
⭐code - Generative Flows With Invertible Attentions
- Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers
- The Flag Median and FlagIRLS
- Implicit Feature Decoupling With Depthwise Quantization
⭐code - UNIST: Unpaired Neural Implicit Shape Translation Network
⭐code🏠project - Mutual Information-Driven Pan-Sharpening
- A Framework for Learning Ante-Hoc Explainable Models via Concepts
- SeeThroughNet: Resurrection of Auxiliary Loss by Preserving Class Probability Information
- Learning ABCs: Approximate Bijective Correspondence for Isolating Factors of Variation With Weak Supervision
⭐code - Convolutions for Spatial Interaction Modeling
- FastDOG: Fast Discrete Optimization on GPU
⭐code - Convolution of Convolution: Let Kernels Spatially Collaborate
⭐code - Generalized Category Discovery
⭐code🏠project - Maximum Consensus by Weighted Influences of Monotone Boolean Functions
- Divide and Conquer: Compositional Experts for Generalized Novel Class Discovery
⭐code - Fast Algorithm for Low-Rank Tensor Completion in Delay-Embedded Space
- Less Is More: Generating Grounded Navigation Instructions From Landmarks
- HEAT: Holistic Edge Attention Transformer for Structured Reconstruction
⭐code🏠project - Instance-Dependent Label-Noise Learning With Manifold-Regularized Transition Matrix Estimation
- Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization
⭐code - How Well Do Sparse ImageNet Models Transfer?
⭐code - REX: Reasoning-Aware and Grounded Explanation
⭐code - Coherent Point Drift Revisited for Non-Rigid Shape Matching and Registration
- Hire-MLP: Vision MLP via Hierarchical Rearrangement
⭐code - One-Bit Active Query With Contrastive Pairs
- Sparse Non-Local CRF
- Dataset Distillation by Matching Training Trajectories
⭐code🏠project - Deep Decomposition for Stochastic Normal-Abnormal Transport
😮oral - Parametric Scattering Networks
⭐code - ScaleNet: A Shallow Architecture for Scale Estimation
⭐code - Learning To Solve Hard Minimal Problems
- Learning Canonical F-Correlation Projection for Compact Multiview Representation
- CellTypeGraph: A New Geometric Computer Vision Benchmark
⭐code - RIDDLE: Lidar Data Compression With Range Image Deep Delta Encoding
- HODEC: Towards Efficient High-Order DEcomposed Convolutional Neural Networks
- Smooth Maximum Unit: Smooth Activation Function for Deep Networks Using Smoothing Maximum Technique
- Learning Invisible Markers for Hidden Codes in Offline-to-Online Photography
- Task2Sim: Towards Effective Pre-Training and Transfer From Synthetic Data
⭐code🏠project - Neural Prior for Trajectory Estimation
- ActiveZero: Mixed Domain Learning for Active Stereovision with Zero Annotation
⭐code - Global-Aware Registration of Less-Overlap RGB-D Scans
- Efficient Deep Embedded Subspace Clustering
- Rep-Net: Efficient On-Device Learning via Feature Reprogramming
⭐code - WALT: Watch and Learn 2D Amodal Representation From Time-Lapse Imagery
- FLAVA: A Foundational Language and Vision Alignment Model
⭐code🏠project - Scanline Homographies for Rolling-Shutter Plane Absolute Pose
⭐code - Exemplar-based Pattern Synthesis with Implicit Periodic Field Network
- Understanding Uncertainty Maps in Vision With Statistical Testing
⭐code - B-Cos Networks: Alignment Is All We Need for Interpretability
- Learning to Collaborate in Decentralized Learning of Personalized Models
📰解读 - 360-Attack: Distortion-Aware Perturbations From Perspective-Views
- A Unified Model for Line Projections in Catadioptric Cameras With Rotationally Symmetric Mirrors
- A Hybrid Quantum-Classical Algorithm for Robust Fitting
⭐code - Topology Preserving Local Road Network Estimation From Single Onboard Camera Image
⭐code - RendNet: Unified 2D/3D Recognizer With Latent Space Rendering
- Towards Real-World Navigation With Deep Differentiable Planners
⭐code - An Iterative Quantum Approach for Transformation Estimation From Point Sets
- UnweaveNet: Unweaving Activity Stories
⭐code - Faithful Extreme Rescaling via Generative Prior Reciprocated Invertible Representations
⭐code - Learning Video Representations of Human Motion From Synthetic Data
- TVConv: Efficient Translation Variant Convolution for Layout-Aware Visual Processing
⭐code - The Probabilistic Normal Epipolar Constraint for Frame-to-Frame Rotation Optimization Under Uncertain Feature Positions
⭐code🏠project - Simple but Effective: CLIP Embeddings for Embodied AI
⭐code - Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations
⭐code - Recall@k Surrogate Loss With Large Batches and Similarity Mixup
⭐code - Bending Graphs: Hierarchical Shape Matching Using Gated Optimal Transport
⭐code - Nested Hyperbolic Spaces for Dimensionality Reduction and Hyperbolic NN Design
- HeadNeRF: A Real-Time NeRF-Based Parametric Head Model
⭐code - Replacing Labeled Real-Image Datasets With Auto-Generated Contours
⭐code🏠project - Pushing the Envelope of Gradient Boosting Forests via Globally-Optimized Oblique Trees
- Omnivore: A Single Model for Many Visual Modalities
🏠project - Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers
- Open-Domain, Content-Based, Multi-Modal Fact-Checking of Out-of-Context Images via Online Resources
⭐code🏠project - Memory-Augmented Deep Conditional Unfolding Network for Pan-Sharpening
⭐code - HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture
🏠project - Deep Image-based Illumination Harmonization
⭐code - Ditto: Building Digital Twins of Articulated Objects From Interaction
😮oral⭐code🏠project - TO-FLOW: Efficient Continuous Normalizing Flows With Temporal Optimization Adjoint With Moving Speed
- Masked Autoencoders Are Scalable Vision Learners
- Neural Inertial Localization
⭐code🏠project - Neural Recognition of Dashed Curves With Gestalt Law of Continuity
- BACON: Band-Limited Coordinate Networks for Multiscale Scene Representation
🏠project - Merry Go Round: Rotate a Frame and Fool a DNN
- Modeling sRGB Camera Noise With Normalizing Flows
🏠project - Co-Advise: Cross Inductive Bias Distillation
⭐code - Automatic Relation-Aware Graph Network Proliferation
⭐code - Stereo Magnification With Multi-Layer Images
⭐code🏠project - CO-SNE: Dimensionality Reduction and Visualization for Hyperbolic Data
- Rethinking Controllable Variational Autoencoders
- BigDL 2.0: Seamless Scaling of AI Pipelines From Laptops to Distributed Cluster
- HARA: A Hierarchical Approach for Robust Rotation Averaging
⭐code - Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
😮oral⭐code🏠project - Learning Fair Classifiers with Partially Annotated Group Labels
⭐code - Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems Through Stochastic Contraction
- High-Fidelity Human Avatars From a Single RGB Camera
⭐code🏠project - RIO: Rotation-Equivariance Supervised Learning of Robust Inertial Odometry
- How Good Is Aesthetic Ability of a Fashion Model?
⭐code - Learning With Neighbor Consistency for Noisy Labels
- GeoEngine: A Platform for Production-Ready Geospatial Research
- Using 3D Topological Connectivity for Ghost Particle Reduction in Flow Reconstruction
- On the Integration of Self-Attention and Convolution
⭐code - Towards Better Plasticity-Stability Trade-Off in Incremental Learning: A Simple Linear Connector
⭐code - MAXIM: Multi-Axis MLP for Image Processing
😮oral⭐code - Delving Into the Estimation Shift of Batch Normalization in a Network
⭐code - Learning Object Context for Novel-View Scene Layout Generation
- Dist-PU: Positive-Unlabeled Learning From a Label Distribution Perspective
- Relative Pose From a Calibrated and an Uncalibrated Smartphone Image
- The Devil Is in the Margin: Margin-Based Label Smoothing for Network Calibration
⭐code - The Neurally-Guided Shape Parser: Grammar-Based Labeling of 3D Shape Regions With Approximate Inference
⭐code - AutoLoss-Zero: Searching Loss Functions From Scratch for Generic Tasks
- Scalable Penalized Regression for Noise Detection in Learning With Noisy Labels
⭐code - Parameter-Free Online Test-Time Adaptation
😮oral⭐code - AlignMixup: Improving Representations by Interpolating Aligned Features
⭐code - HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imaging
⭐code - Brain-inspired Multilayer Perceptron with Spiking Neurons
- SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems
- Mega-NERF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs
- Training Quantised Neural Networks with STE Variants: the Additive Noise Annealing Algorithm
⭐code - Split Hierarchical Variational Compression
- Privacy Preserving Partial Localization
