Pytorch Fsdp
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
Search and filter the whole catalogue. Results update as you type.
6,264 prompts
Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2
High-level PyTorch framework with Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks system, and minimal boilerplate. Scales from laptop to su…
Distributed training orchestration across clusters. Scales PyTorch/TensorFlow/HuggingFace from laptop to 1000s of nodes. Built-in hyperparameter tuning with Ray Tune, fa…
Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT…
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), exten…
Merge multiple fine-tuned models using mergekit to combine capabilities without retraining. Use when creating specialized models by blending domain-specific expertise (m…
Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT. Use when compressing models without retraining, achieving 50% sparsity with m…
Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales f…
Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace. Use when training large-scale models with limited compute (5× cost reduction vs dense models), impl…
Enhanced AI Mode for Complex Tasks Enhanced AI mode for complex tasks Command originally created by IndyDevDan (YouTube: https://www.youtube.com/@indydevdan) / DislerH (…
Intelligently Refactor and Improve Code Quality Intelligently refactor and improve code quality Instructions Follow this systematic approach to refactor code: $ARGUMENTS…
Analyze product screenshots to extract features and generate development task lists.
Multi-framework structured analysis: surfaces hidden assumptions, generates competing solutions, stress-tests each with adversarial reasoning, and delivers confidence-ca…
Autonomous AI agent platform for building and deploying continuous agents. Use when creating visual workflow agents, deploying persistent autonomous agents, or building…
Directory Deep Dive Analyze directory structure and purpose Instructions 1. Target Directory - Focus on the specified directory $ARGUMENTS or the current working directo…
Multi-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agents working together on complex tasks, when you need role…
Analyze and Explain Code Functionality Analyze and explain code functionality Instructions Follow this systematic approach to explain code: $ARGUMENTS 1. Code Context An…
Framework for building LLM-powered applications with agents, chains, and RAG. Supports multiple providers (OpenAI, Anthropic, Google), 500+ integrations, ReAct agents, t…
Fix Issue Command Identify and resolve code issues Instructions Follow this structured approach to analyze and fix issues: $ARGUMENTS 1. Issue Analysis - Use gh issue vi…
Data framework for building LLM applications with RAG. Specializes in document ingestion (300+ connectors), indexing, and querying. Features vector indices, query engine…
Generate Linear Work Log You are tasked with generating a technical work log comment for a Linear issue based on recent git commits. Instructions 1. Check Linear MCP Ava…
Daily digest of AI releases from Anthropic, Meta, Vercel Labs, OpenAI and Google GitHub repos, the Claude Cowork changelog, the claude.dev blog and Hacker News, deduplic…
Git Status Command Show detailed git repository status Command originally created by IndyDevDan (YouTube: https://www.youtube.com/@indydevdan) / DislerH (GitHub: https:/…
Build a reference for the implementation details of this project. Use provided summarize tool to get summary of the files. Avoid reading the content of many files yourse…