Quantizing Models Bitsandbytes
Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster infere…
Docker, CI/CD, cloud, Linux and Git.
404 prompts
Quantizes LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss. Use when GPU memory is limited, need to fit larger models, or want faster infere…
Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 token…
Provides guidance for training and analyzing Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features. Use when disco…
Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow - framework-agnostic ML lifecycle platform
RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI proje…
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency. Use for production deployment on NVIDIA GPUs (A100/H100), when you need 10-100x f…
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or…
Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or hi…
Serverless GPU cloud platform for running ML workloads. Use when you need on-demand GPU access without infrastructure management, deploying ML models as APIs, or running…
Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instan…
Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), re…
Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on loca…
Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need maximum…
Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with m…
Generate Linear Work Log You are tasked with generating a technical work log comment for a Linear issue based on recent git commits. Instructions 1. Check Linear MCP Ava…
Git Status Command Show detailed git repository status Command originally created by IndyDevDan (YouTube: https://www.youtube.com/@indydevdan) / DislerH (GitHub: https:/…
Clean Branches Command Clean up merged and stale git branches Instructions Follow this systematic approach to clean up git branches: $ARGUMENTS 1. Repository State Analy…
Read README.md, THEN run git ls-files grep -v -f (sed 's ^ ^ ; s $ / ' .cursorignore psub) to understand the context of the project
Generate comprehensive daily standup reports with team activity analysis and progress tracking
Setup comprehensive automated synchronization workflows with monitoring and CI/CD integration
Comprehensive migration assistant for large-scale GitHub-Linear data transitions with validation and rollback
Setup comprehensive CI/CD pipeline with automated testing, deployment, and monitoring
Setup comprehensive development environment with tools, configurations, and workflows
Setup Docker containerization with multi-stage builds and development workflows