A ML playground for education purpose
-
Updated
Dec 30, 2025 - Python
#
machine-learning-infrastructure
Here are 25 public repositories matching this topic...
Fullstack machine learning inference template
aws machine-learning cloudformation full-stack infrastructure-as-code twitter-sentiment-analysis inference-server fastapi machine-learning-template machine-learning-infrastructure
-
Updated
Nov 24, 2023 - Jupyter Notebook
A systems programming language where automatic differentiation is a compiler pass and model parameters are explicit, growable memory.
programming-language rust compiler llvm automatic-differentiation agi bare-metal systems-programming machine-learning-infrastructure
-
Updated
Jan 5, 2026 - Rust
A Branchless, Zero-Jitter Ingress Router for 32-GPU Distributed Mesh Networks utilizing JAX/XLA and NCCL.
hpc distributed-computing cuda high-performance-computing memory-management multi-gpu systems-programming distributed-training nccl jax xla branchless deep-learning-compiler machine-learning-infrastructure distributed-inference llm-infrastructure zero-jitter sram-optimization
-
Updated
Jul 6, 2026 - Python
Compiler MVP that detects Transformer fusion patterns, generates optimized CUDA kernels with WMMA Tensor Cores, and executes them on real GPU hardware — 10.5 TFLOPs on RTX 2070, correctness validated against PyTorch.
performance-engineering deep-learning compiler jinja2 gpu cuda transformer fusion systems code-generation turing gemm auto-tuning tensor-cores llm machine-learning-infrastructure kernel-optimization wmma rtx-2070 sm75
-
Updated
Jul 26, 2026 - Python
tpu-doc is a zero-dependency diagnostic binary for Google Cloud TPU environments that instantly validates hardware health, discovers software stack configurations, and provides AI-powered log analysis to eliminate expensive debugging downtime.
rust tensorflow gcp pytorch high-performance-computing cloud-infrastructure diagnostics performance-monitoring troubleshooting tpu jax mlops ai-ops machine-learning-infrastructure llm-ops google-cloud-tpu hardware-valida distrbuted-training
-
Updated
Jan 6, 2026 - Rust
Analytical benchmark connecting pipeline parallelism and KV cache management: bubble-time overlap for disaggregation, prefix reuse tax of PP stages, and tiering speedup across NVLink, InfiniBand, and PCIe
performance-engineering benchmark simulation inference systems infiniband disaggregation pcie nvlink analytical-model tiering pipeline-parallelism kv-cache llm llm-serving machine-learning-infrastructure prefix-sharing kv-cache-management bubble-time
-
Updated
Jul 26, 2026 - Python
A custom Deep Learning Framework built from scratch using NumPy. Implements Automatic Differentiation, Backpropagation, and modular Layer architectures.
python numpy neural-networks backpropagation deep-learning-framework machine-learning-infrastructure
-
Updated
Dec 28, 2025 - Python
FlashAttention v1 forward pass in CUDA for NVIDIA Turing (SM75)
deep-learning cuda pytorch attention gpu-computing turing tensor-cores llm flash-attention machine-learning-infrastructure wmma sm75
-
Updated
Jul 27, 2026 - Python
Tungsten Alpha: A JAX-native, 7-layer Adelic-Riemannian Operating System. Implements resurgent gradient flow through discrete logic and Levi-Civita parallel transport for decentralized XLA clusters. Hardened for zero-jitter, systolic array execution.
high-performance-computing artificial-general-intelligence tpu jax riemannian-geometry riemannian-optimization fisher-information-matrix xla information-geometry jit-compilation natural-gradient parallel-transport machine-learning-infrastructure triton-inference orbax custom-jax-primitives hlo-fusion sensor-swarms manifold-learning-decentralized-ai
-
Updated
Mar 16, 2026 - Python
Monte Carlo simulation benchmark for MoE expert activation memory variability and admission control under non-deterministic routing — including routing skew amplification, top_k sweep, and policy comparison across uniform, skewed, and very_skewed distributions
performance-engineering benchmark simulation scheduling inference systems moe monte-carlo-simulation mixture-of-experts admission-control llm llm-serving machine-learning-infrastructure expert-routing serving-systems load-imbalance activation-memory routing-skew
-
Updated
Jul 26, 2026 - Python
Upload datasets and train machine learning models using an interactive web interface built with Streamlit and Scikit-learn.
python classifier machine-learning computer-vision aws-lambda compiler xcode pattern-matching recommendation-system image-classification image-recognition vison coreml-model tflite coreml-vision mlir apple-silicon tflm machine-learning-infrastructure
-
Updated
Jul 29, 2026 - Python
A research-grade course in Numerical Methods and Optimization for ML. No deep learning libraries—just pure math and NumPy. Rebuilds automatic differentiation engines, stable SVD/Cholesky algorithms, quasi-Newton solvers (BFGS), stable log-sum-exp layers, and Gaussian Process regressions from scratch
optimization linear-algebra automatic-differentiation numerical-methods gaussian-processes numerical-stability machine-learning-infrastructure backpropagation-from-scratch
-
Updated
May 27, 2026 - Jupyter Notebook
Distributed, GPU-aware workload scheduler for heterogeneous clusters: queueing, quotas, GPU flavors, and autoscaling.
python golang distributed-systems text-to-speech typescript sdk rest-api cuda grpc tts openai high-availability resource-management gpu-cluster tencent-cloud gpu-scheduler quota-management machine-learning-infrastructure workload-scheduler
-
Updated
May 17, 2026 - Go
Analytical benchmark for sliding window attention KV cache management: quality vs window size tradeoffs, SWA vs eviction comparison, prefix sharing interaction, and operational window recommendations across four attention distributions
performance-engineering benchmark simulation inference systems attention mistral eviction analytical-model kv-cache llm long-context llm-serving machine-learning-infrastructure sliding-window-attention prefix-sharing serving-systems kv-cache-management
-
Updated
Jul 26, 2026 - Python
Discrete-event simulation benchmark for LLM request cancellation handling, measuring wasted compute, KV residency overhead, and survivor latency recovery across polling and push-based strategies.
performance-engineering benchmark streaming simulation latency inference systems throughput request-cancellation discrete-event-simulation kv-cache llm llm-serving batch-scheduling machine-learning-infrastructure serving-systems
-
Updated
Jul 25, 2026 - Python
Simulation benchmark for canary deployment strategies in LLM model updates, measuring safety, rollback behavior, bad exposure, and rollout speed across good, bad, and marginal candidate scenarios
performance-engineering benchmark simulation rollback inference systems ab-testing canary-deployment rollout model-deployment model-versioning mlops guardrails llm llm-serving machine-learning-infrastructure serving-systems serving-safety
-
Updated
Jul 26, 2026 - Python
Discrete-event simulation for LLM serving capacity planning: how many GPUs for a p99 TTFT SLO under ShareGPT traffic, batching fragmentation, and autoscaling lag — with cliff analysis and three levels of planning rigor.
performance-engineering benchmark simulation latency capacity-planning inference systems slo autoscaling cost-optimization discrete-event-simulation kv-cache llm sharegpt llm-serving batch-scheduling machine-learning-infrastructure serving-systems gpu-capacity
-
Updated
Jul 26, 2026 - Python
Calibrated simulation benchmark for real-time LLM request routing, comparing complexity signals, output-length awareness, cost savings, and quality-risk trade-offs.
performance-engineering benchmark simulation latency routing inference cost-model systems gpu-memory request-routing perplexity kv-cache llm long-context llm-serving machine-learning-infrastructure model-routing draft-model
-
Updated
Jul 25, 2026 - Python
Analytical benchmark connecting tensor parallelism and KV cache management in LLM serving: GQA sharding regimes, all-gather vs recompute tradeoffs, PCIe viability, and operational decision matrix across NVLink, InfiniBand, and PCIe
performance-engineering benchmark simulation inference systems attention infiniband disaggregation pcie nvlink analytical-model gqa kv-cache tensor-parallelism llm llm-serving grouped-query-attention machine-learning-infrastructure prefix-sharing all-gather
-
Updated
Jul 26, 2026 - Python
Improve this page
Add a description, image, and links to the machine-learning-infrastructure topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the machine-learning-infrastructure topic, visit your repo's landing page and select "manage topics."