AK Avnish Kumar

Senior SDE & Tech Lead · Amazon Bedrock

Avnish Kumar

AI infrastructure and distributed systems leader building production-scale systems for generative AI, computer vision, and IoT intelligence. Currently leading LLM hosting, prompt caching, and multimodal model customization on Amazon Bedrock. Former CTO and co-founder of an IoT/AI startup serving 100+ enterprise clients.

View Experience LinkedIn
0-1A
Extraordinary Ability
Cornell
MEng CS
IIT Delhi
MTech

Skills & Expertise

Technical Depth

AI & ML

  • Generative AI Infrastructure
  • LLM Serving Platforms
  • Model Customization Pipelines
  • Computer Vision Infrastructure

Systems

  • Distributed Systems
  • Data Plane Architecture
  • AI Reliability
  • IoT and Fleet Intelligence

Cloud & Security

  • Cloud Security and Networking
  • High-Availability Operations
  • Fault Isolation
  • Technical Leadership

Experience

Selected Impact

2023 - Present Seattle, WA

Senior Software Development Engineer, Tech Lead

Amazon Bedrock, AWS

90% cost reduction
  • Designed and implemented GenAI hosting infrastructure for Anthropic models in Amazon Bedrock.
  • Led architecture across networking, security, high availability, and performance-sensitive model-serving paths.
  • Delivered prompt caching support, reducing customer cost by up to 90% and latency by up to 85%.
  • Designed data ingestion systems for Bedrock multimodal model customization.
2020 - 2023 Seattle, WA

Software Development Engineer

Amazon Rekognition, AWS

3 weeks to 1 week patching
  • Led modernization of container patching for Amazon Rekognition Custom Labels.
  • Architected an automated patching pipeline with rollback and guardrails.
  • Improved disaster recovery from approximately 1 hour to near-instant recovery across environments.
  • Won AWS Rekognition Hackathons in 2021 and 2023.
2014 - 2019 New Delhi, India

CTO and Co-Founder

Briston Technomach

25% fleet cost reduction
  • Co-founded an IoT/AI B2B startup in fuel and fleet management serving 100+ enterprise clients.
  • Scaled the platform to monitor 3,000+ heavy equipment assets and manage 5 million liters of fuel.
  • Launched AI-based preventive maintenance and real-time alerting for customer fleet operations.
  • Led $150K seed fundraising from angel and seed investors in India.

Intellectual Property

Patents & Publications

U.S. Patents

Efficient Prompt Caching Routing for AI Infrastructure Patent Filing
Efficient Deployment of Large Language Models Patent Filing
Capacity Rebalance Optimizations for AI Infrastructure Patent Filing
AI Reliability Invention (P91347-US01) — details embargoed Patent Filing

Publications & Open Source

IEEE Open Access: Physiology-Aware Chlorophyll-Guided Multimodal Transformer With Federated Learning for Early Pest-Risk Forecasting in Tea Plantations Publication
Contracted author, Springer book on Agentic AI Systems (manuscript in progress) Book
Contributor to Serverless Land — infrastructure patterns for serverless and cloud-native systems Open Source

Community

Professional Service

JudgeSeattle Startup Summit
ReviewerIEEE ICDM
PC MemberIEEE/IFIP DSN
JudgeAWS AI Agents Hackathon
JudgeMCP Agents Hackathon
Co-ChairFrontier AI Symposium, New Era AI
SpeakerNew Era AI World Leaders Summit
SpeakerIEEE Cloud Summit
ReviewerIEEE COMPSAC Distributed Systems

From the PDF

Original profile direction, rebuilt as code.

Technical depth section from the source website PDF

Get in Touch

Let’s Connect

Open to conversations about AI infrastructure, distributed systems, research collaborations, and speaking opportunities.

avnishkumar.del@gmail.com LinkedIn Profile