LLM inference in C/C++

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

Learn to optimize machine learning tasks for environmental sustainability. Discover how to use real-time electricity data and low-carbon energy sources for model training and inference, reducing th…

How much energy do GenAI models consume?

PowerAPI is a Python framework for building software-defined power meters.

Tools for producing high-quality hourly generation and emissions data for U.S. electric grids

Karpenter is a Kubernetes Node Autoscaler built for flexibility, performance, and simplicity.

A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)

The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality!

A slightly quackers Docker TUI based on k9s 🦆

Carbon Explorer helps evaluating solutions make datacenters operate on renewable energy.

Slide decks with editable source files

Cost monitoring for Kubernetes workloads and cloud costs

Execute tasks on a point in time with minimal grid carbon intensity

Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration

KEDA is a Kubernetes-based Event Driven Autoscaling component. It provides event driven scale for any container running in Kubernetes

🌐 Wikipedia for Web APIs. Directory of REST API definitions in OpenAPI 2.0/3.x format

CATS: the Climate-Aware Task Scheduler 🐈 🐅 🐆

Kepler (Kubernetes-based Efficient Power Level Exporter) uses eBPF to probe performance counters and other system stats, use ML models to estimate workload energy consumption based on these stats, …

A K8s operator to reduce CO2 footprint of your clusters

Carbon characteristics of Google Cloud regions

Helping developers to use AWS Graviton2, Graviton3, and Graviton4 processors which power the 6th, 7th, and 8th generation of Amazon EC2 instances (C6g[d], M6g[d], R6g[d], T4g, X2gd, C6gn, I4g, Im4g…

AWS Lambda Power Tuning is an open-source tool that can help you visualize and fine-tune the memory/power configuration of Lambda functions. It runs in your own AWS account - powered by AWS Step Fu…

Kubernetes Carbon Intensity Exporter

A tool written in go to help you factor carbon intensity into decisions about where and when to run computing jobs.

Carbon-Aware SDK