Skip to content

GenAI Career Roles — Complete Reference (2026)

"AI Engineer" was LinkedIn's #1 fastest-growing job title in 2026. This document covers 31 roles across a 6-layer AI stack — from Application (easiest entry) to Infrastructure & Hardware (highest pay). Salary data for both US and India markets.

Note on "AI/ML Developer": This is NOT a distinct job role. It's used interchangeably with "AI Engineer" or "ML Engineer" in job postings. Read the JD — it maps to one of the 31 roles below.

Last researched: 2026-03. Treat compensation and hiring examples as a market snapshot, not a permanent truth.

Dedicated Role Guides

Grouped Role Guides


Table of Contents

  1. The 6-Layer AI Stack
  2. Role Overview Table
  3. Role-by-Role Breakdown
  4. Layer 6 — Application
  5. Layer 5 — Orchestration
  6. Layer 4 — Fine-tuning & Evaluation
  7. Layer 3 — Inference & Serving
  8. Layer 2 — Foundation Model
  9. Layer 1 — Infrastructure & Hardware
  10. Cross-cutting
  11. Roles by Entry Difficulty
  12. Career Pathways
  13. Skills × Roles Matrix
  14. Interview Preparation Map
  15. Job Search Keywords
  16. Frontier Lab Requirements
  17. Target Companies by Tier
  18. Salary Table (All 31 Roles)
  19. Certification Roadmap
  20. Portfolio Project Ideas
  21. Sources

★ The 6-Layer AI Stack

Note: This is a career-planning model adapted from industry frameworks (a16z, NVIDIA, Sequoia). Standard industry models use 4-5 layers; this 6-layer version provides finer granularity for mapping roles.

┌─────────────────────────────────────────────────────────────────────┐
│  LAYER 6: APPLICATION                                               │
│  Integrating AI into products, workflows, and user-facing features  │
│  Roles: Full-Stack AI, AI Integration, AI Sales, AI Consultant,     │
│         AI PM, Conversational AI, AI Tech Writer/DevRel             │
├─────────────────────────────────────────────────────────────────────┤
│  LAYER 5: ORCHESTRATION                                             │
│  Building AI systems: agents, RAG pipelines, multi-model workflows  │
│  Roles: AI Engineer, GenAI Engineer, Agentic AI, Prompt Engineer,   │
│         AI Architect, AI DevTools Engineer                          │
├─────────────────────────────────────────────────────────────────────┤
│  LAYER 4: FINE-TUNING & EVALUATION                                  │
│  Adapting models: fine-tuning, evaluation, domain-specific training  │
│  Roles: LLM Engineer, RAG Engineer, AI Data Eng, NLP Eng, CV Eng,  │
│         Data Scientist, AI Safety/Red Team, AI Trainer              │
├─────────────────────────────────────────────────────────────────────┤
│  LAYER 3: INFERENCE & SERVING                                       │
│  Production: deployment, monitoring, optimization, cost control     │
│  Roles: MLOps/LLMOps, ML Engineer, Inference Optimization Eng      │
├─────────────────────────────────────────────────────────────────────┤
│  LAYER 2: FOUNDATION MODEL                                          │
│  Building models: pre-training, architecture design, research       │
│  Roles: Foundation Model Eng, AI Research Scientist, Applied Sci    │
├─────────────────────────────────────────────────────────────────────┤
│  LAYER 1: INFRASTRUCTURE & HARDWARE                                 │
│  Compute: GPU clusters, compilers, kernels, distributed systems     │
│  Roles: AI Infra/Platform Eng, AI Compiler/Kernel Eng               │
└─────────────────────────────────────────────────────────────────────┘

★ Role Overview Table (31 Roles)

# Role Layer Entry Difficulty Availability Salary (US Range) Min Education
1 Full-Stack AI Engineer L6 🟡 Moderate 🟢 Very High $88K–$250K+ Bachelor's
2 AI Integration Engineer L6 🟡 Moderate 🟢 Very High $120K–$250K+ Bachelor's
3 AI Sales Engineer L6 🟢 Accessible 🟢 High $120K–$250K+ Bachelor's
4 AI Consultant / Strategist L6 🟡 Moderate 🟢 High $130K–$280K+ Bachelor's
5 AI Product Manager L6 🔴 Advanced 🟢 High $150K–$300K+ Bachelor's
6 Conversational AI Engineer L6 🔴 Advanced 🟡 Medium $140K–$300K+ Bachelor's
7 AI Technical Writer / DevRel L6 🟢 Accessible 🟢 High $110K–$220K+ Bachelor's
8 AI Engineer L5 🟡 Moderate 🟢 Very High $100K–$350K+ Bachelor's
9 Generative AI Engineer L5 🟡 Moderate 🟢 High $120K–$350K+ Bachelor's
10 Agentic AI Engineer L5 🟡 Moderate 🟡 Medium-High $170K–$350K+ Bachelor's
11 Prompt Engineer L5 🟢 Accessible 🟢 High $80K–$250K Bachelor's
12 AI Solutions Architect L5 🔴 Advanced 🟡 Medium $160K–$320K+ Bachelor's
13 AI Developer Tools Engineer L5 🔴 Advanced 🟡 Growing $150K–$300K+ Bachelor's
14 LLM Engineer L4 🔴 Advanced 🟡 Medium-High $180K–$400K+ Master's pref
15 RAG Engineer L4 🟡 Moderate 🟡 Medium-High $150K–$300K+ Bachelor's
16 AI Data Engineer L4 🟡 Moderate 🟢 High $130K–$260K+ Bachelor's
17 NLP Engineer L4 🔴 Advanced 🟡 Medium $130K–$280K+ Master's pref
18 Computer Vision Engineer L4 🔴 Advanced 🟡 Medium $137K–$350K+ Master's pref
19 Data Scientist (GenAI) L4 🟡 Moderate 🟢 Very High $95K–$280K+ Bachelor's
20 AI Safety / Red Team Eng L4 ⚫ Elite 🔴 Niche $160K–$300K+ Master's pref
21 AI Trainer / RLHF Annotator L4 🟢 Accessible 🟢 Very High $45K–$180K+ None/Bachelor's
22 MLOps / LLMOps Engineer L3 🔴 Advanced 🟢 Very High $140K–$280K+ Bachelor's
23 ML Engineer L3 🔴 Advanced 🟢 Very High $96K–$550K TC Bachelor's
24 Inference Optimization Eng L3 ⚫ Elite 🔴 Niche $167K–$350K+ Master's/PhD
25 Foundation Model Engineer L2 ⚫ Elite 🔴 Very Few $160K–$400K+ Master's/PhD
26 AI Research Scientist L2 ⚫ Elite 🔴 Niche $115K–$400K+ PhD preferred
27 Applied AI Scientist L2 ⚫ Elite 🟡 Medium $150K–$400K+ Master's/PhD
28 AI Infra / Platform Engineer L1 ⚫ Elite 🔴 Niche $140K–$320K+ Bachelor's
29 AI Compiler / Kernel Engineer L1 ⚫ Elite 🔴 Ultra-Niche $250K–$400K+ Master's/PhD
30 AI Ethics & Governance Lead Cross 🔴 Advanced 🟡 Medium $140K–$280K+ Master's pref
31 AI Data Governance Manager Cross 🔴 Advanced 🟡 Medium $130K–$260K+ Bachelor's

★ Role-by-Role Breakdown

Layer 6 — Application (7 Roles)


1. Full-Stack AI Engineer 🟢

Field Details
Stack Layer Layer 6 (Application)
What You Do Build complete AI-powered applications end-to-end — frontend, backend, and AI integration. The most in-demand "generalist" AI role.
Key Responsibilities Build AI-powered web/mobile apps, integrate LLM APIs into products, design RAG systems for apps, build AI agent UIs, handle model serving and latency optimization
Must-Have Skills Python, TypeScript/JavaScript, React/Next.js, LLM APIs (OpenAI/Gemini/Claude), RAG, SQL + vector DBs, Docker, cloud (AWS/GCP)
Nice-to-Have AI agent frameworks, embeddings, streaming responses, real-time AI features, product thinking
Salary (US) Entry: $88–120K · Mid: $120–180K · Senior: $168–250K+
Salary (India) Entry: ₹6–12 LPA · Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies Every SaaS company, every startup adding AI features, every enterprise
Job Availability 🟢 Highest volume — this is where most AI jobs are right now
Entry Requirements Bachelor's in CS/SE. 1–2 years full-stack + AI/LLM project experience. Strong portfolio.
Career Progression → AI Engineer (L5) · → AI Architect · → AI PM · → Founding Engineer at AI startup
Related Roles AI Integration Engineer, AI Engineer, GenAI Engineer
Key Differentiator Requires frontend (React/Next.js) + backend + AI — true full-stack, not just backend+LLM

2. AI Integration Engineer 🟢

Field Details
Stack Layer Layer 6 (Application)
What You Do Integrate AI into existing enterprise products. Add AI features to CRMs, ERPs, SaaS platforms. The "glue" between AI capabilities and business systems.
Key Responsibilities LLM API integration, RAG pipelines for enterprise data, AI feature design, latency/cost/hallucination guardrails, testing AI features, stakeholder communication
Must-Have Skills Python, API development (REST/GraphQL), LLM APIs, RAG, prompt engineering, SQL, enterprise integration patterns
Nice-to-Have Domain expertise (finance, healthcare, legal), Salesforce/ServiceNow integrations, data governance
Salary (US) Mid: $120–180K · Senior: $160–250K+
Salary (India) Mid: ₹12–25 LPA · Senior: ₹25–50+ LPA
Hiring Companies Accenture, Deloitte, TCS, Infosys, every enterprise, every SaaS company
Job Availability 🟢 Very High — every company integrating AI needs this role
Entry Requirements Bachelor's in CS/SE. 1–3 years backend/integration experience. LLM API experience preferred.
Career Progression → AI Consultant · → AI Architect · → AI Sales Engineer · → AI PM
Related Roles Full-Stack AI Engineer, AI Consultant, AI Engineer
Key Differentiator Focused on integrating AI into existing systems, not building new AI-native apps

3. AI Sales Engineer / Solutions Engineer 🟢

Field Details
Stack Layer Layer 6 (Application)
What You Do Demo AI products to potential customers, design custom solutions, provide technical pre-sales support. Bridge between AI product teams and enterprise buyers.
Key Responsibilities Technical demos, PoC building, customer requirements analysis, solution architecture, competitive positioning, technical proposal writing
Must-Have Skills Broad AI/ML/GenAI knowledge, excellent communication, demo skills, RAG/agents understanding, API integration, customer empathy
Nice-to-Have Cloud certifications, industry domain expertise, CRM tools, prior consulting or customer-facing experience
Salary (US) Mid: $120–180K + commission · Senior: $160–250K+ OTE
Salary (India) Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies OpenAI, Anthropic, Cohere, AWS (Bedrock), Google Cloud (Vertex AI), Databricks, every AI SaaS vendor
Job Availability 🟢 High — every AI vendor needs sales engineers; growing with enterprise AI adoption
Entry Requirements Bachelor's in CS/business. Prior sales/consulting experience valued. Broad AI knowledge required, not deep specialization.
Career Progression → AI Consultant · → AI PM · → VP Sales (AI) · → Solutions Practice Lead
Related Roles AI Consultant, AI Integration Engineer, AI PM
Key Differentiator Customer-facing + technical — requires demo skills and business acumen alongside AI knowledge

4. AI Consultant / AI Strategist 🟢

Field Details
Stack Layer Layer 6 (Application) — strategic
What You Do Advise companies on AI adoption strategy. Assess use cases, recommend architectures, build PoCs, guide implementation.
Key Responsibilities AI readiness assessment, use case identification, PoC development, vendor evaluation, ROI analysis, AI roadmap creation
Must-Have Skills Broad AI/ML knowledge, RAG/agents/fine-tuning understanding, presentation skills, business acumen, PoC building
Nice-to-Have Industry expertise, cloud certifications, project management, consulting experience
Salary (US) Mid: $130–200K · Senior: $180–280K+
Salary (India) Mid: ₹15–35 LPA · Senior: ₹35–65+ LPA
Hiring Companies McKinsey, BCG, Deloitte, Accenture, PwC (AI practices), boutique AI consultancies
Job Availability 🟢 High — enterprise AI adoption is exploding
Entry Requirements Bachelor's + 2–4 years in tech/consulting. Consulting methodology knowledge. AI/ML breadth more important than depth.
Career Progression → AI Practice Lead · → Chief AI Officer · → Independent AI Consultant · → AI startup founder
Related Roles AI Sales Engineer, AI Architect, AI PM
Key Differentiator Strategy + PoC focus — designs the "what" and "why" of AI adoption, not the "how" of production systems

5. AI Product Manager 🟢

Field Details
Stack Layer Layer 6 (Application)
What You Do Define vision for AI products. Prioritize features, manage stakeholders, translate business needs to AI capabilities.
Key Responsibilities Product roadmap, feature prioritization, user research, AI capability assessment, go-to-market, metrics definition
Must-Have Skills Understanding of AI/LLM capabilities and limitations, product thinking, user research, stakeholder management
Nice-to-Have Hands-on prompt engineering, RAG understanding, evaluation metrics knowledge, competitive landscape awareness
Salary (US) Mid: $150–220K · Senior: $200–300K+
Salary (India) Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies Every tech company, SaaS, enterprise, AI startups
Job Availability 🟢 High — strong demand for AI-literate PMs
Entry Requirements Bachelor's + 3–5 years product management experience. AI literacy required, coding optional. MBA common but not required.
Career Progression → Director of Product (AI) · → VP Product · → Chief Product Officer · → AI startup founder
Related Roles AI Consultant, AI Architect, AI Sales Engineer
Key Differentiator Owns the "what to build" — product strategy, not implementation. Must understand AI capabilities without necessarily coding.

6. Conversational AI Engineer 🟡

Field Details
Stack Layer Layer 6 (Application)
What You Do Build dialogue systems, voice assistants, and enterprise AI chatbots. Design multi-turn conversation architectures, intent tracking, and speech integration.
Key Responsibilities Multi-turn dialogue design, context management, intent disambiguation, ASR/TTS integration (Whisper, Google STT), persona design, conversation analytics
Must-Have Skills Python, LLM APIs, NLU (intent detection, entity extraction), dialogue state tracking, speech recognition integration, prompt engineering
Nice-to-Have Google Dialogflow, ADK, voice UX design, WebSocket streaming, multilingual dialogue, sentiment analysis
Salary (US) Mid: $140–210K · Senior: $190–300K+
Salary (India) Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Google, Amazon (Alexa), Apple (Siri), Salesforce, startups building AI assistants
Job Availability 🟡 Medium — growing with enterprise AI assistant adoption
Entry Requirements Bachelor's in CS. 2–4 years in NLP/dialogue systems. Experience with speech APIs and multi-turn conversation design.
Career Progression → AI Architect · → AI PM (voice/chat products) · → VP Engineering (conversational AI)
Related Roles NLP Engineer, AI Engineer, GenAI Engineer
Key Differentiator Speech + dialogue specialization — requires ASR/TTS integration and multi-turn context management beyond standard LLM work

7. AI Technical Writer / Developer Relations Engineer 🟢

Field Details
Stack Layer Layer 6 (Application)
What You Do Create documentation, tutorials, and developer education content for AI products. Build developer communities, give talks, and evangelize AI tools.
Key Responsibilities API documentation, tutorials, code samples, blog posts, conference talks, community management, SDK guides, developer onboarding
Must-Have Skills Strong writing, Python, LLM APIs, RAG understanding, Git, Markdown, ability to explain complex AI concepts simply
Nice-to-Have Public speaking, video creation, open-source contribution, community building, TypeScript
Salary (US) Mid: $110–170K · Senior: $150–220K+
Salary (India) Mid: ₹12–25 LPA · Senior: ₹25–45+ LPA
Hiring Companies Hugging Face, LangChain, OpenAI, Anthropic, Google (Cloud DevRel), Cohere, Weaviate, Pinecone
Job Availability 🟢 High — every AI company needs developer education; often overlooked by applicants
Entry Requirements Bachelor's in CS/technical writing. Strong AI knowledge breadth + excellent communication. Portfolio of technical content.
Career Progression → Head of DevRel · → Developer Advocacy Director · → AI Educator / Course Creator · → VP Developer Experience
Related Roles AI Consultant, Prompt Engineer, AI Trainer
Key Differentiator Communication-first role — explains AI to developers. Broad knowledge breadth matters more than implementation depth.

Layer 5 — Orchestration (6 Roles)


8. AI Engineer (LinkedIn's #1 Fastest-Growing Title 2026) 🟢

Field Details
Stack Layer Layer 5–6 (Orchestration / Application)
What You Do Design, build, and deploy AI-powered features. Orchestrate LLMs, agents, and multi-model systems into production applications.
Key Responsibilities Build AI pipelines, integrate LLMs into products, manage multi-agent workflows, evaluate model quality, optimize cost/latency
Must-Have Skills Python, PyTorch/TensorFlow, LLM APIs (OpenAI/Gemini/Claude), RAG, prompt engineering, Docker/K8s, Git
Nice-to-Have Fine-tuning (LoRA/QLoRA), agentic frameworks (LangGraph, CrewAI), MCP/A2A protocols, cloud (AWS/GCP/Azure)
Salary (US) Entry: $100–140K · Mid: $140–211K · Senior: $195–350K+
Salary (India) Entry: ₹5–12 LPA · Mid: ₹18–32 LPA · Senior: ₹35–60+ LPA
Hiring Companies Every tech company, SaaS startups, enterprise AI teams, FAANG
Job Availability 🟢 Very High — LinkedIn's #1 fastest-growing title
Entry Requirements Bachelor's in CS/SE. 1–2 years software engineering. LLM/AI project experience. Fastest entry into AI for SWEs.
Career Progression → GenAI Engineer · → AI Architect · → Staff AI Engineer · → Principal Engineer · → CTO
Related Roles GenAI Engineer, Full-Stack AI Engineer, ML Engineer
Key Differentiator Broadest L5 role — integrates existing models into products (vs ML Eng who trains models, vs GenAI Eng who builds GenAI-specific systems)

9. Generative AI Engineer 🟢

Field Details
Stack Layer Layer 5 (Orchestration)
What You Do Build enterprise-grade GenAI solutions end-to-end. Design RAG systems, fine-tune models, build agent architectures, deploy to production.
Key Responsibilities RAG pipelines, LLM integration, prompt engineering, fine-tuning, model evaluation, building AI agents, production deployment
Must-Have Skills Python, LLM APIs, RAG (chunking, embedding, vector DBs), prompt engineering, LangChain/LlamaIndex, evaluation metrics
Nice-to-Have Graph RAG, agentic protocols (MCP/A2A/ADK), Unsloth/Axolotl for fine-tuning, multimodal AI
Salary (US) Entry: $120–160K · Mid: $180–250K · Senior: $220–350K+
Salary (India) Entry: ₹8–15 LPA · Mid: ₹25–45 LPA · Senior: ₹50–80+ LPA (top-tier companies)
Hiring Companies Google, Meta, Microsoft, Amazon, Anthropic, AI startups, consulting firms
Job Availability 🟢 High — exploding demand across all sectors
Entry Requirements Bachelor's in CS. 1–3 years with LLMs, RAG, and GenAI frameworks. Production GenAI project experience strongly preferred.
Career Progression → LLM Engineer · → AI Architect · → Staff GenAI Engineer · → Founding AI Engineer at startup
Related Roles AI Engineer, LLM Engineer, RAG Engineer
Key Differentiator GenAI-specific depth — RAG, agents, fine-tuning, evaluation. ~80% overlap with AI Engineer but deeper on GenAI stack.

10. Agentic AI Engineer / AI Agent Developer 🟡

Field Details
Stack Layer Layer 5 (Orchestration)
What You Do Design and orchestrate autonomous AI agents. Gartner predicts 40% of enterprise apps will embed agents by end of 2026.
Key Responsibilities Multi-agent system design, tool use orchestration, agent memory/state management, safety guardrails, cost controls for autonomous systems
Must-Have Skills Python, LangGraph/CrewAI/AutoGen, function calling, MCP/A2A, RAG, vector DBs, async programming
Nice-to-Have ADK (Google), OpenAI Agents SDK, agent observability, human-in-the-loop patterns
Salary (US) Mid: $170–250K · Senior: $220–350K+
Salary (India) Mid: ₹25–45 LPA · Senior: ₹45–75+ LPA
Hiring Companies Apple, Disney, Salesforce, every enterprise building agent workflows
Job Availability 🟡 Medium-High — fastest growing sub-specialization within AI Engineering
Entry Requirements Bachelor's in CS. 2–3 years AI/GenAI engineering. Strong async programming skills. Multi-agent project portfolio.
Career Progression → AI Architect · → Staff AI Engineer · → AI Platform Lead · → VP Engineering (AI)
Related Roles AI Engineer, GenAI Engineer, AI DevTools Engineer
Key Differentiator Agent-specific — multi-agent orchestration, tool use, safety guardrails. Emerging specialization, not yet a separate title at most companies.

11. Prompt Engineer / AI Interaction Specialist 🟢

Field Details
Stack Layer Layer 5–6 (Orchestration / Application)
What You Do Craft, test, and optimize prompts and agent instructions. Bridge between human intent and LLM execution.
Key Responsibilities Prompt design (zero-shot, few-shot, CoT), structured output (JSON), reducing hallucinations, multi-step workflows, agent-based prompting, testing
Must-Have Skills Deep LLM understanding, prompt patterns, function calling, structured output, evaluation methods
Nice-to-Have Python scripting, RAG integration, tool/function calling, prompt playgrounds, LangChain/LlamaIndex
Salary (US) Entry: $80–120K · Mid: $120–180K · Senior: $160–250K
Salary (India) Entry: ₹5–10 LPA · Mid: ₹15–30 LPA · Senior: ₹30–50+ LPA
Hiring Companies OpenAI, Anthropic, consulting firms, legal/healthcare AI, enterprise AI
Job Availability 🟢 High — though evolving into broader AI/GenAI Engineering roles
Entry Requirements Bachelor's (any field). Strong analytical thinking. 0–1 year with LLMs. Lowest technical barrier of any AI engineering role.
Career Progression → AI Engineer · → GenAI Engineer · → AI Consultant · → AI PM
Related Roles AI Engineer, GenAI Engineer, AI Consultant
Key Differentiator Prompt-first — deep expertise in getting optimal LLM behavior. Role is merging into broader AI Eng at many companies.

12. AI Solutions Architect 🟡

Field Details
Stack Layer Layer 5–6 (Orchestration / Application)
What You Do Design enterprise AI architectures. Connect business goals with practical AI systems. Select frameworks, tools, and define blueprints.
Key Responsibilities Solution design, tech stack selection, scalability planning, cost modeling, vendor evaluation, team mentoring, stakeholder communication
Must-Have Skills Broad AI/ML knowledge, cloud architecture (AWS/GCP/Azure), system design, LLM systems, RAG, agents, MLOps understanding
Nice-to-Have Multi-agent architecture, MCP/A2A protocols, security & compliance, enterprise integration patterns
Salary (US) Mid: $160–230K · Senior: $200–320K+
Salary (India) Mid: ₹25–45 LPA · Senior: ₹45–75+ LPA
Hiring Companies Cloud providers (AWS/GCP/Azure), consulting firms, large enterprises
Job Availability 🟡 Medium — senior role, less entry-level
Entry Requirements Bachelor's + 5–7 years software engineering + 2+ years AI/ML. Cloud certifications highly valued. System design expertise required.
Career Progression → Principal Architect · → VP Engineering · → CTO · → Chief AI Officer
Related Roles AI Consultant, AI Engineer, AI PM
Key Differentiator Architecture-first — designs the blueprint that teams implement. Senior role requiring both technical depth and business communication.

13. AI Developer Tools Engineer 🟡

Field Details
Stack Layer Layer 5 (Orchestration)
What You Do Build AI-powered developer tools — IDEs, CLI tools, copilots, SDKs. The people who build Cursor, Gemini CLI, GitHub Copilot, Windsurf.
Key Responsibilities AI copilot development, SDK/API design, AI-assisted code generation pipelines, developer experience (DX) optimization, testing AI-generated code
Must-Have Skills Python, TypeScript/JavaScript, SDK/API design, LLM APIs, prompt engineering, testing frameworks, Git, open-source development
Nice-to-Have VS Code extension development, LSP (Language Server Protocol), tree-sitter, AST parsing, developer experience research
Salary (US) Mid: $150–220K · Senior: $200–300K+
Salary (India) Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies Google (Gemini CLI), Anthropic (Claude Code), Cursor, Replit, Vercel, GitHub
Job Availability 🟡 Growing fast — every dev tool company is building AI features
Entry Requirements Bachelor's in CS. 3–5 years software engineering + SDK/API design experience. Understanding of developer workflows. TypeScript proficiency.
Career Progression → Staff DevTools Engineer · → Head of Developer Experience · → VP Engineering · → CTO at DevTools company
Related Roles AI Engineer, Full-Stack AI Engineer, GenAI Engineer
Key Differentiator Developer-tool-specific — requires SDK design, DX thinking, and understanding of developer workflows beyond just AI/LLM integration

Layer 4 — Fine-tuning & Evaluation (8 Roles)


14. LLM Engineer 🟡

Field Details
Stack Layer Layer 4–5 (Fine-tuning / Orchestration)
What You Do Specialize in building, fine-tuning, evaluating, and deploying LLM-based applications. System designer who integrates foundation models into products.
Key Responsibilities Fine-tuning (LoRA, QLoRA, DPO), model evaluation, hallucination mitigation, latency/cost optimization, inference serving, model selection
Must-Have Skills Transformer architecture, fine-tuning techniques, tokenization, inference optimization (quantization, KV-cache), evaluation benchmarks
Nice-to-Have Training infrastructure (multi-GPU), scaling laws, RLHF/GRPO, distillation, custom tokenizers
Salary (US) Mid: $180–260K · Senior: $240–400K+
Salary (India) Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies OpenAI, Anthropic, Google, Cohere, AI21 Labs, Hugging Face, enterprise AI
Job Availability 🟡 Medium-High — growing fast, more specialized than AI Engineer
Entry Requirements Master's preferred. 2–4 years ML/AI experience. Deep understanding of transformer internals and fine-tuning techniques.
Career Progression → Foundation Model Engineer · → Staff LLM Engineer · → AI Research Scientist · → ML Platform Lead
Related Roles GenAI Engineer, ML Engineer, Foundation Model Engineer
Key Differentiator LLM-depth — fine-tuning, tokenization, inference optimization. Deeper on model internals than GenAI Eng, less broad than AI Eng.

15. RAG Engineer 🟡

Field Details
Stack Layer Layer 4–5 (Fine-tuning / Orchestration)
What You Do Build intelligent search and synthesis systems. Connect LLMs to external knowledge via embeddings, vector databases, and retrieval pipelines.
Key Responsibilities Document processing, chunking strategies, embedding pipelines, vector DB management, hybrid search (BM25 + semantic), re-ranking, RAG evaluation
Must-Have Skills Embeddings (text-embedding-3-large, Gemini Embedding), vector DBs (Pinecone, Weaviate, Chroma, pgvector), chunking, RAGAS metrics
Nice-to-Have Graph RAG, agentic RAG, multimodal RAG, context caching, query transformation, privacy-preserving techniques
Salary (US) Mid: $150–220K · Senior: $200–300K+
Salary (India) Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Enterprise AI teams, SaaS companies, consulting firms, legal/finance AI
Job Availability 🟡 Medium-High — every enterprise needs RAG for internal knowledge
Entry Requirements Bachelor's in CS. 1–3 years with embeddings, vector DBs, and search systems. RAG is an emerging specialization within broader GenAI/AI Eng roles.
Career Progression → GenAI Engineer · → AI Architect · → Staff AI Engineer · → Search/Knowledge Platform Lead
Related Roles GenAI Engineer, AI Engineer, AI Data Engineer
Key Differentiator Retrieval-specialist — deep expertise in search, embeddings, and knowledge integration. Often a specialization within GenAI Eng rather than a standalone title.

16. AI Data Engineer 🟢

Field Details
Stack Layer Layer 4 (Fine-tuning & Evaluation)
What You Do Design data architecture for AI/ML/GenAI. Ensure data is trusted, secure, and AI-ready. Build data pipelines for LLM training and RAG.
Key Responsibilities Data pipelines, ETL/ELT for AI, data quality, embedding generation at scale, synthetic data pipelines, data governance
Must-Have Skills Python, SQL, data engineering tools (Spark, Airflow), cloud data services, embeddings, vector DBs
Nice-to-Have Synthetic data generation, data labeling pipelines, privacy-preserving techniques, data versioning
Salary (US) Mid: $130–190K · Senior: $175–260K+
Salary (India) Mid: ₹15–28 LPA · Senior: ₹28–50+ LPA
Hiring Companies Data-heavy enterprises, fintech, healthcare, e-commerce, AI startups
Job Availability 🟢 High — every AI project needs data infrastructure
Entry Requirements Bachelor's in CS/data engineering. 2–3 years data engineering experience. Spark, Airflow, SQL proficiency. AI data pipeline experience preferred.
Career Progression → Senior Data Engineer · → Data Platform Lead · → AI Architect · → Chief Data Officer
Related Roles Data Scientist, ML Engineer, AI Data Governance Manager
Key Differentiator Data-pipeline-first — focuses on making data AI-ready, not building models. Traditional data engineering + AI-specific pipelines (embeddings, synthetic data).

17. NLP Engineer 🟡

Field Details
Stack Layer Layer 4 (Fine-tuning & Evaluation)
What You Do Build language understanding systems. In 2026, overlaps heavily with LLM engineering but retains classical NLP specialization.
Key Responsibilities Named entity recognition, sentiment analysis, text classification, tokenization, multilingual NLP, fine-tuning language models
Must-Have Skills Python, PyTorch, Hugging Face, spaCy/NLTK, tokenization, embeddings, fine-tuning
Nice-to-Have Multilingual models, classical NLP metrics (BLEU, ROUGE), speech processing, knowledge graphs
Salary (US) Mid: $130–200K · Senior: $180–280K+
Salary (India) Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies Google, Amazon, Apple, Microsoft, enterprise AI, healthcare/legal AI
Job Availability 🟡 Medium — merging with LLM/GenAI Eng at many companies
Entry Requirements Master's preferred. 2–4 years NLP experience. Deep understanding of linguistics and language models.
Career Progression → LLM Engineer · → GenAI Engineer · → AI Research Scientist (NLP) · → NLP Team Lead
Related Roles LLM Engineer, GenAI Engineer, Conversational AI Engineer
Key Differentiator Language-specialist — classical NLP (NER, sentiment, tokenization) + modern LLMs. Distinct from GenAI Eng in its linguistic depth.

18. Computer Vision Engineer 🟡

Field Details
Stack Layer Layer 4 (Fine-tuning & Evaluation)
What You Do Design algorithms for machines to "see" — image classification, object detection, video analysis, 3D vision.
Key Responsibilities Image/video classification, object detection, segmentation, OCR, 3D vision, model optimization for edge devices
Must-Have Skills Python, PyTorch, CNNs, Vision Transformers (ViT), OpenCV, transfer learning
Nice-to-Have YOLO/DETR, 3D vision, edge deployment (TensorRT, ONNX), multimodal models, medical imaging
Salary (US) Mid: $137–200K · Senior: $200–350K+ · Top 1%: $579K+
Salary (India) Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies Tesla, NVIDIA, Apple, Google, Meta, medical imaging companies, autonomous vehicle companies
Job Availability 🟡 Medium — specialized but stable demand
Entry Requirements Master's preferred. 2–4 years CV experience. Strong math + deep learning fundamentals. Published research helpful.
Career Progression → Senior CV Engineer · → CV Team Lead · → AI Research Scientist (Vision) · → VP Engineering (Perception)
Related Roles ML Engineer, Deep Learning Engineer, AI Research Scientist
Key Differentiator Vision-specialist — completely distinct skill set (CNNs, OpenCV, 3D) from NLP/GenAI roles.

19. Data Scientist (GenAI-Augmented) 🟢

Field Details
Stack Layer Layer 4 (Fine-tuning & Evaluation)
What You Do Classical data science + GenAI. Build predictive models, leverage LLMs for analysis, use RAG for data insights. The role is evolving from manual analysis to designing intelligent systems.
Key Responsibilities Predictive modeling, statistical analysis, LLM-augmented insights, RAG for internal data, experiment design, business strategy through AI
Must-Have Skills Python, R/SQL, statistics (Bayesian, regression), scikit-learn, PyTorch, LLM APIs, RAG, data visualization
Nice-to-Have LangChain/LlamaIndex, vector DBs, causal inference, A/B testing, Spark, cloud ML services
Salary (US) Entry: $95–130K · Mid: $130–200K · Senior: $180–280K+
Salary (India) Entry: ₹6–14 LPA · Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Every company with data — finance, healthcare, e-commerce, tech
Job Availability 🟢 Very High — one of the most common AI-adjacent roles
Entry Requirements Bachelor's (Master's preferred). Strong statistics + programming. 1–2 years data analysis experience.
Career Progression → Senior Data Scientist · → ML Engineer · → AI PM · → Head of Data Science · → Chief Analytics Officer
Related Roles ML Engineer, AI Data Engineer, AI Consultant
Key Differentiator Statistics + business insight focus — answers "what should we do?" vs engineers who build "how to do it." GenAI augments but doesn't replace core stats skills.

20. AI Safety / Red Team Engineer 🔴

Field Details
Stack Layer Cross-cutting (all layers)
What You Do Adversarially test AI for vulnerabilities. The "white hat hacker" of AI — find prompt injections, jailbreaks, data leaks, and bias before bad actors do.
Key Responsibilities Adversarial testing, prompt injection attacks, jailbreak research, bias auditing, guardrail design, evaluation pipeline design
Must-Have Skills Python, adversarial ML, prompt injection techniques, OWASP LLM Top 10, evaluation pipeline design
Nice-to-Have Pentesting (Burp Suite, Metasploit), RLHF/alignment, agent security, purple teaming
Salary (US) Mid: $160–220K · Senior: $200–300K+
Salary (India) Mid: ₹20–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Anthropic, OpenAI, Google DeepMind, Microsoft, government agencies
Job Availability 🔴 Niche — few openings but growing with AI regulation
Entry Requirements Master's preferred. 3–5 years in security/ML. Published adversarial research helpful. Unique blend of security + AI expertise.
Career Progression → AI Security Lead · → Head of AI Safety · → AI Ethics & Governance Lead · → Chief Trust Officer
Related Roles AI Ethics Lead, ML Engineer, AI Research Scientist
Key Differentiator Security-focused — adversarial mindset applied to AI. Distinct from AI Ethics (which is policy/governance) — this is technical attack/defense.

21. AI Trainer / RLHF Data Annotator 🟢

Field Details
Stack Layer Layer 4 (Fine-tuning & Evaluation)
What You Do Train and evaluate AI models through human feedback. Create RLHF/DPO training data, assess model outputs for quality, safety, and factual accuracy. The human-in-the-loop for alignment.
Key Responsibilities Response ranking, preference labeling, red-teaming prompts, model output evaluation, annotation guideline creation, quality assurance for training data
Must-Have Skills Strong language skills, critical thinking, attention to detail, understanding of AI model behavior, basic prompt engineering
Nice-to-Have RLHF/DPO theory, domain expertise (coding, math, science), Python, evaluation frameworks
Salary (US) Entry: $45–75K · Mid: $75–120K · Senior/Lead: $120–180K+
Salary (India) Entry: ₹3–8 LPA · Mid: ₹8–15 LPA · Senior: ₹15–30+ LPA
Hiring Companies Scale AI, Surge AI, Outlier, Anthropic, OpenAI, Google, Cohere, Labelbox
Job Availability 🟢 Very High — LinkedIn's 2026 "Jobs on the Rise" list; massive scaling need for alignment
Entry Requirements No degree strictly required. Strong analytical skills + domain expertise (coding, writing, math, science). Lowest barrier entry into AI. 1–3 months training.
Career Progression → Annotation Team Lead · → AI Quality Manager · → AI Ethics Specialist · → Prompt Engineer
Related Roles Prompt Engineer, AI Ethics Lead, Data Scientist
Key Differentiator Human feedback role — not engineering. Evaluates AI outputs and creates training data. Lowest technical barrier but critical for model quality.

Layer 3 — Inference & Serving (3 Roles)


22. MLOps / LLMOps Engineer 🟢

Field Details
Stack Layer Layer 3 (Inference & Serving)
What You Do Ensure AI/LLM systems run reliably in production. Deployment, monitoring, cost optimization, guardrails, and incident response.
Key Responsibilities Model deployment, CI/CD for ML, monitoring & observability (LangSmith, Arize Phoenix), prompt versioning, guardrails, cost controls, scaling
Must-Have Skills Docker, Kubernetes, CI/CD, cloud platforms (AWS/GCP/Azure), monitoring tools, Python, API development (FastAPI)
Nice-to-Have LLM evaluation strategies, RAG system monitoring, semantic caching, A/B testing for models, Terraform/IaC
Salary (US) Mid: $140–200K · Senior: $180–280K+
Salary (India) Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies Cloud providers, SaaS companies, ML-heavy enterprises, AI startups
Job Availability 🟢 Very High — every production AI team needs MLOps
Entry Requirements Bachelor's in CS/SE. 2–4 years DevOps/SRE/backend experience. Docker + K8s hands-on required. Cloud certs valued.
Career Progression → Senior MLOps · → ML Platform Lead · → AI Infrastructure Engineer · → VP Engineering (Platform)
Related Roles ML Engineer, AI Infrastructure Engineer, DevOps Engineer
Key Differentiator Ops-focused — keeps AI running in production. DevOps skills applied to ML/LLM systems. Distinct from ML Eng (who builds models) and AI Infra (who builds the platform).

23. ML Engineer (Highest Job Volume) 🟢

Field Details
Stack Layer Layer 3 (Inference & Serving)
What You Do Design, build, train, deploy, and maintain ML systems in production. Bridge between data science and software engineering. Most established AI role.
Key Responsibilities Model development (training, tuning), data pipeline design, MLOps (versioning, monitoring, CI/CD), scaling models for millions of users, A/B testing
Must-Have Skills Python, PyTorch/TensorFlow, scikit-learn, SQL, data structures & algorithms, cloud (AWS SageMaker/GCP Vertex AI/Azure ML), Git, Docker
Nice-to-Have GenAI/LLM fine-tuning, Spark, Kubernetes, C++, CUDA, feature stores, experiment tracking (MLflow, W&B)
Salary (US) Entry: $96–132K · Mid: $149–200K · Senior: $175–240K · FAANG TC: $320–550K
Salary (India) Entry: ₹8–15 LPA · Mid: ₹20–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Every tech company, FAANG, finance, healthcare, autonomous vehicles
Job Availability 🟢 Very High — 31% projected growth through 2030. 3.2:1 demand-to-supply ratio
Entry Requirements Bachelor's (Master's preferred for top companies). 2–4 years. Strong DSA + ML fundamentals. LeetCode preparation needed.
Career Progression → Senior ML Eng · → Staff ML Eng · → Principal Eng · → ML Platform Lead · → VP Engineering
Related Roles AI Engineer, Data Scientist, MLOps Engineer
Key Differentiator Model-training + production focus — trains models from data (vs AI Eng who integrates pre-trained models). Most established and well-defined AI engineering role.

24. Inference Optimization Engineer 🔴

Field Details
Stack Layer Layer 3 (Inference & Serving) — deepest engineering
What You Do Maximize throughput, minimize latency, cut cost of LLM inference. Most technically deep engineering role in the AI stack.
Key Responsibilities Quantization, KV-cache optimization, kernel fusion, batching strategies, model serving architecture, cost-per-token optimization
Must-Have Skills Python, C/C++, CUDA, PyTorch internals, vLLM, TensorRT, ONNX Runtime, Triton Inference Server
Nice-to-Have GPU profiling (Nsight), custom CUDA kernels, FlashAttention internals, speculative decoding, hardware-aware optimization
Salary (US) Mid: $167–209K · Senior: $200–350K+ · NVIDIA: $287K+
Salary (India) Mid: ₹25–45 LPA · Senior: ₹45–80+ LPA
Hiring Companies NVIDIA, Anyscale, Together AI, Fireworks AI, Modal, Groq
Job Availability 🔴 Niche — few openings but extremely high pay
Entry Requirements Master's/PhD preferred. 3–5 years systems programming. Deep CUDA + C++ expertise required. Published optimization research valued.
Career Progression → Staff Inference Eng · → AI Compiler Engineer · → Principal Systems Engineer · → VP Engineering (Inference)
Related Roles AI Compiler/Kernel Engineer, ML Engineer, Foundation Model Engineer
Key Differentiator Performance-obsessed — measures everything in tokens/second and $/million-tokens. Requires systems programming (C++, CUDA) that most AI roles don't.

Layer 2 — Foundation Model (3 Roles)


25. Foundation Model / Pre-Training Engineer ⚫

Field Details
Stack Layer Layer 2 (Foundation Model)
What You Do Train and build large foundation models from scratch. Design model architectures, manage distributed training across thousands of GPUs.
Key Responsibilities Pre-training at scale, architecture design (transformers, MoE), distributed training (FSDP, DeepSpeed), data curation for pre-training, scaling laws
Must-Have Skills PyTorch internals, C++, CUDA, distributed computing, transformer architectures, training infrastructure
Nice-to-Have JAX/Flax (DeepMind), custom optimizer design, model parallelism strategies, hardware co-design
Salary (US) Mid: $160–250K · Senior: $250–400K+ · Staff at frontier: $600K–$943K TC
Salary (India) Mid: ₹25–45 LPA · Senior: ₹50–80+ LPA
Hiring Companies OpenAI, Google DeepMind, Anthropic, Meta FAIR, xAI, Mistral, Cohere
Job Availability 🔴 Very Few — only frontier labs and well-funded startups
Entry Requirements Master's/PhD required. 3–5+ years ML research. Published papers. CUDA + distributed training expertise.
Career Progression → Staff Research Engineer · → Research Lead · → Chief Scientist · → VP Research
Related Roles AI Research Scientist, Inference Optimization Eng, AI Compiler Eng
Key Differentiator Trains models from scratch — vs LLM Eng (fine-tunes existing models). Requires distributed systems + hardware-level optimization.

26. AI Research Scientist ⚫

Field Details
Stack Layer Layer 2 (Foundation Model)
What You Do Push the boundaries of AI. Design new architectures, discover novel training methods, publish papers, define the future of the field.
Key Responsibilities Research design, paper writing, experiment design, novel architecture exploration, benchmark creation, peer review
Must-Have Skills Deep mathematics (optimization, probability, linear algebra), PyTorch, experiment design, scientific writing
Nice-to-Have JAX, C++, CUDA, distributed training, specific domain expertise (NLP, vision, RL, alignment)
Salary (US) Entry/postdoc: $115K · Mid: $160–260K · Senior: $220–400K+ · Top: $600K–$943K TC
Salary (India) Research fellow: ₹15–30 LPA · Senior: ₹30–50 LPA · MNC labs: ₹40–80+ LPA
Hiring Companies OpenAI, Google DeepMind, Anthropic, Meta FAIR, Microsoft Research, university labs
Job Availability 🔴 Niche — highly competitive, few positions globally
Entry Requirements PhD strongly preferred. 3+ years research experience. Published papers at top venues (NeurIPS, ICML, ICLR, ACL).
Career Progression → Senior Research Scientist · → Research Lead · → Chief Scientist · → VP Research · → Lab Director
Related Roles Applied AI Scientist, Foundation Model Engineer
Key Differentiator Research-first — publishes papers, advances the field. Does not primarily build products (vs Applied Scientist who does).

27. Applied AI Scientist 🟡

Field Details
Stack Layer Layer 2–3 (Foundation / Inference)
What You Do Apply cutting-edge research to solve real-world business problems. Bridge between research and production — the "practical researcher."
Key Responsibilities Research-to-production pipeline, novel model adaptation, experiment design, prototype building, cross-team collaboration
Must-Have Skills ML algorithms, PyTorch, experiment design, statistical analysis, software engineering, communication
Nice-to-Have GenAI/LLM expertise, domain specialization, distributed systems, paper writing
Salary (US) Mid: $150–220K · Senior: $200–400K+
Salary (India) Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies Amazon, Apple, Microsoft, Google, Meta, Netflix, Spotify, finance/healthcare AI
Job Availability 🟡 Medium — many listings at FAANG and large enterprises
Entry Requirements Master's/PhD. 2–5 years combining research + production engineering. Published research helpful but not required.
Career Progression → Senior Applied Scientist · → Principal Scientist · → AI Research Scientist · → Head of Applied AI
Related Roles AI Research Scientist, ML Engineer, Data Scientist
Key Differentiator Research + production — same rigor as Research Scientist but focused on shipping products, not publishing papers. Amazon's signature AI role.

Layer 1 — Infrastructure & Hardware (2 Roles)


28. AI Infrastructure / ML Platform Engineer ⚫

Field Details
Stack Layer Layer 1 (Infrastructure)
What You Do Build the platform that all ML/AI teams run on. Design compute clusters, training infrastructure, model registries, and serving systems.
Key Responsibilities GPU cluster management, training infrastructure, model registry, serving platform, cost optimization, developer experience
Must-Have Skills Kubernetes (advanced), distributed systems, Docker, cloud (AWS/GCP), Python, Go/Rust, networking
Nice-to-Have GPU scheduling, custom K8s operators, Ray, multi-cloud, NVIDIA NCCL, InfiniBand
Salary (US) Mid: $140–220K · Senior: $192–320K+
Salary (India) Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies Google, Meta, Microsoft, NVIDIA, Anyscale, Modal, cloud providers
Job Availability 🔴 Niche — specialized infrastructure role
Entry Requirements Bachelor's + 4–6 years systems/infrastructure engineering. Deep K8s + cloud expertise. No ML knowledge required — this is systems engineering.
Career Progression → Staff Platform Eng · → Principal Eng · → VP Infrastructure · → CTO
Related Roles MLOps Engineer, DevOps Engineer, Cloud Platform Engineer
Key Differentiator Platform-builder — builds the infrastructure all ML teams use. Pure systems engineering, no model development.

29. AI Compiler / Kernel Engineer ⚫

Field Details
Stack Layer Layer 1 (Infrastructure) — most specialized
What You Do Write compiler passes and GPU kernels for AI workloads. The most technically elite role in the entire AI stack.
Key Responsibilities Custom CUDA kernels, compiler optimization (XLA, Triton, TVM), hardware-specific optimization, operator fusion, memory optimization
Must-Have Skills C++, CUDA, compiler design, GPU architecture, low-level systems programming, linear algebra
Nice-to-Have MLIR, Triton compiler, custom hardware (TPU, Gaudi), hardware simulation, assembly
Salary (US) $250K–$400K+ (one of the highest-paid AI roles)
Salary (India) ₹45–80+ LPA
Hiring Companies NVIDIA, Google (TPU), AMD, Intel, Cerebras, Groq, Tenstorrent
Job Availability 🔴 Ultra-Niche — very few openings worldwide, extreme specialization
Entry Requirements Master's/PhD in CS/EE. 5+ years systems programming. Compiler design + CUDA expertise mandatory.
Career Progression → Staff Compiler Eng · → Distinguished Engineer · → VP Hardware/Software Co-design · → CTO at AI chip company
Related Roles Inference Optimization Engineer, AI Infrastructure Engineer
Key Differentiator Lowest-level AI role — writes the code that runs on the GPU. Requires compiler + hardware expertise that no other AI role needs.

Cross-cutting (2 Roles)


30. AI Ethics & Governance Lead 🟡

Field Details
Stack Layer Cross-cutting (all layers)
What You Do Ensure AI systems are fair, transparent, and compliant. Build governance frameworks, audit for bias, navigate regulations (EU AI Act, NIST AI RMF).
Key Responsibilities AI policy development, bias auditing, regulatory compliance, responsible AI frameworks, stakeholder education, model documentation
Must-Have Skills AI/ML understanding, regulatory knowledge (EU AI Act, NIST), risk assessment, policy writing, bias metrics
Nice-to-Have Python for auditing, fairness tools (Aequitas, IBM AI Fairness 360), law degree, public policy experience
Salary (US) Mid: $140–200K · Senior: $180–280K+
Salary (India) Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies Google, Microsoft, Meta, government agencies, large enterprises, consulting firms
Job Availability 🟡 Medium — growing with EU AI Act enforcement and corporate AI governance mandates
Entry Requirements Master's preferred (CS, law, or public policy). 3–5 years in AI governance, compliance, or related field. Blend of technical + policy expertise.
Career Progression → Head of Responsible AI · → Chief Ethics Officer · → VP Trust & Safety · → AI Policy Advisor
Related Roles AI Safety/Red Team Eng, AI Data Governance Manager, AI PM
Key Differentiator Policy + governance focus — designs the rules AI systems must follow. Distinct from AI Safety (which is technical testing).

31. AI Data Governance Manager 🟡

Field Details
Stack Layer Cross-cutting (all layers)
What You Do Ensure data used in AI systems is compliant, high-quality, and ethically sourced. Bridge between data engineering, legal, and AI teams.
Key Responsibilities Data compliance (GDPR, CCPA), training data audits, data lineage documentation, privacy impact assessments, vendor data agreements
Must-Have Skills Data governance frameworks, regulatory knowledge, data quality tools, SQL, communication
Nice-to-Have Privacy-enhancing technologies, synthetic data strategies, AI model documentation, legal background
Salary (US) Mid: $130–190K · Senior: $170–260K+
Salary (India) Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies Regulated industries (finance, healthcare), large enterprises, government
Job Availability 🟡 Medium — growing with data regulation enforcement
Entry Requirements Bachelor's + 3–5 years data governance/compliance experience. Understanding of AI/ML data pipelines. Legal knowledge valued.
Career Progression → Head of Data Governance · → Chief Data Officer · → VP Compliance · → AI Ethics Lead
Related Roles AI Ethics Lead, AI Data Engineer, Data Scientist
Key Differentiator Data-compliance focus — ensures the data AI uses is legal, ethical, and high-quality. Not a technical AI role — governance and compliance.

★ Roles by Entry Difficulty

Difficulty Roles Typical Background
🟢 Accessible (0–1 yr) AI Trainer, Prompt Engineer, AI Technical Writer/DevRel, AI Sales Engineer Any field + self-study + portfolio
🟡 Moderate (1–3 yr) AI Integration Eng, Full-Stack AI Eng, AI Consultant, GenAI Eng, AI Eng, RAG Eng, Agentic AI Eng, Data Scientist, AI Data Eng, AI Data Governance Mgr CS degree + SWE experience + AI projects
🔴 Advanced (3–5 yr) LLM Eng, MLOps Eng, ML Eng, NLP Eng, CV Eng, AI Architect, AI PM, AI Ethics Lead, AI DevTools Eng, Conversational AI Eng, AI Safety Eng CS degree + domain experience + advanced skills
Elite (5+ yr / PhD) Inference Optimization Eng, Foundation Model Eng, AI Research Scientist, Applied Scientist, AI Infra/Platform Eng, AI Compiler/Kernel Eng PhD or 5+ yrs + cutting-edge expertise + publications

★ Career Pathways

DEPTH TRACK (specialization):
  GenAI Engineer → LLM Engineer → Foundation Model Engineer → Research Scientist

BREADTH TRACK (architecture):
  AI Engineer → AI Solutions Architect → Chief AI Officer

PRODUCT TRACK (business + AI):
  AI Engineer / Data Scientist → AI Product Manager → VP Product → CPO

CONTENT TRACK (education + advocacy):
  AI Engineer → AI Technical Writer/DevRel → Head of DevRel → AI Educator

BUSINESS TRACK (customer-facing):
  AI Integration Engineer → AI Consultant → AI Sales Engineer → Practice Lead

RESEARCH TRACK (academic → industry):
  PhD → Applied Scientist → Research Scientist → Chief Scientist → Lab Director

STARTUP TRACK (entrepreneurial):
  Any L5-6 role → Founding AI Engineer at startup → CTO → CEO

CAREER LADDER (seniority progression):
  Junior (0-2 yr) → Mid (2-4 yr) → Senior (4-7 yr) → Staff (7-10 yr)
    → Principal (10+ yr) → Distinguished / Fellow

★ Skills × Roles Matrix

Skill Cluster Most Important For Why It Matters
Application engineering Full-Stack AI Engineer, AI Integration Engineer, AI Engineer Shipping useful AI features still depends on APIs, backend reliability, UX, and product integration.
Orchestration and agents AI Engineer, GenAI Engineer, Agentic AI Engineer, RAG Engineer Many modern GenAI roles are about combining models, retrieval, tools, and workflows instead of training models from scratch.
Evaluation and safety LLM Engineer, RAG Engineer, AI Safety / Red Team Engineer, MLOps / LLMOps Engineer Weak evaluation is one of the fastest ways to ship unreliable, unsafe, or expensive systems.
Production systems ML Engineer, MLOps / LLMOps Engineer, Inference Optimization Engineer, AI Infra / Platform Engineer Real-world AI systems fail on latency, observability, cost, and deployment complexity long before they fail on theory.
Research depth Foundation Model Engineer, Applied AI Scientist, AI Research Scientist These roles demand deeper command of transformers, optimization, experimental design, and paper-level reasoning.
Governance and policy AI Ethics & Governance Lead, AI Data Governance Manager, AI Consultant / Strategist In regulated or high-risk environments, governance, compliance, and stakeholder communication are as important as the model itself.

★ Interview Preparation Map

Technical Round 1: AI/ML Fundamentals (L4-L2 roles)

Topics: Transformer architecture, attention mechanisms, tokenization, fine-tuning
        techniques (LoRA, QLoRA, DPO), RAG, embeddings, evaluation metrics

Technical Round 2: System Design (L3-L5 roles)

Topics: "Design a RAG system for 10M documents", "Design an AI agent platform",
        "Design a model serving system for 1000 QPS", cost optimization, latency SLOs

Technical Round 3: Coding / DSA (All engineering roles)

Topics: LeetCode medium-level, Python data structures, API design, ML pipeline coding
Note: Even GenAI roles at Google/Meta/Amazon require DSA interviews

Technical Round 4: Domain-Specific (specialized roles)

ML Engineer: model training pipeline design, feature engineering
MLOps: Kubernetes architecture, CI/CD for ML, monitoring setup
Inference Opt: CUDA programming, quantization, kernel optimization
CV Engineer: CNN architectures, object detection, edge deployment
NLP Engineer: tokenization, multilingual NLP, language model evaluation

Behavioral Round (ALL roles — eliminatory at FAANG)

Format: STAR method (Situation, Task, Action, Result)
Amazon: Leadership Principles (Customer Obsession, Bias for Action, Dive Deep)
Google: Googleyness (intellectual humility, collaboration, learning)
Meta: Move Fast, Be Bold, Focus on Impact
Common: "Tell me about a complex technical problem you solved"
        "How do you handle disagreements with teammates?"
        "Describe a project that failed and what you learned"

Take-Home Assignments (Common at startups + L5-6 roles)

L6 roles: Build a RAG chatbot / AI feature integration (48-72 hrs)
L5 roles: Multi-agent system / evaluation pipeline
L4 roles: Fine-tune a model on provided dataset + eval report
L3 roles: Deploy a model with monitoring + CI/CD
Portfolio review: GitHub, live demos, blog posts, open-source PRs

Ethics / Culture Round (cross-cutting)

Topics: Bias mitigation, guardrails, EU AI Act, responsible AI, red teaming, OWASP LLM Top 10

★ Job Search Keywords

LAYER 6: "AI integration engineer", "full-stack AI", "AI-powered app developer",
         "AI product manager", "AI consultant", "AI solutions consultant",
         "conversational AI", "AI chatbot developer", "developer advocate AI",
         "AI technical writer", "AI sales engineer"

LAYER 5: "AI engineer", "GenAI engineer", "generative AI developer",
         "LLM application developer", "prompt engineer", "AI architect",
         "AI agent developer", "agentic AI", "AI developer tools"

LAYER 4: "LLM engineer", "RAG engineer", "NLP engineer", "AI data engineer",
         "computer vision engineer", "data scientist GenAI", "AI safety",
         "AI red team", "AI trainer", "RLHF", "data annotator AI"

LAYER 3: "MLOps engineer", "LLMOps", "ML engineer", "machine learning engineer",
         "inference optimization", "model serving engineer"

LAYER 2: "foundation model engineer", "pre-training engineer",
         "AI research scientist", "applied scientist", "research engineer ML"

LAYER 1: "ML platform engineer", "AI infrastructure", "CUDA engineer",
         "AI compiler engineer", "GPU kernel engineer"

CROSS:   "AI ethics", "responsible AI", "AI governance", "AI compliance",
         "AI data governance"

★ Frontier Lab Requirements

To work at frontier labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR, xAI, Mistral):

RESEARCH ROLES (L2):
  ✅ PhD (or equivalent research output)
  ✅ Published papers at NeurIPS, ICML, ICLR, ACL, CVPR, or EMNLP
  ✅ Novel research contributions
  ✅ Deep math (optimization, probability, linear algebra)
  ✅ PyTorch + JAX (for DeepMind)
  ✅ Open-source contributions or reproduced papers

ENGINEERING ROLES (L3-L5):
  ✅ Strong software engineering (system design, APIs, distributed systems)
  ✅ Production ML experience (deployed models serving real traffic)
  ✅ Understanding of transformer architecture and training
  ✅ LeetCode-style coding (medium-hard level)
  ✅ Cloud + Docker + Kubernetes
  ✅ Open-source contributions (LangChain, vLLM, Hugging Face, etc.)

WHAT MAKES YOU STAND OUT:
  → Published technical blog posts or tutorials
  → Merged PRs in popular AI open-source projects
  → Novel research direction or technique
  → Production system serving millions of users
  → Founded/contributed to an AI startup

★ Target Companies by Tier

TIER 1 — FRONTIER LABS (highest pay, hardest to enter)
  OpenAI, Anthropic, Google DeepMind, Meta FAIR, Microsoft Research,
  Mistral AI, xAI, Cohere, AI21 Labs

TIER 2 — BIG TECH AI TEAMS (high pay, production focus)
  Google (Gemini), Apple (ML), Amazon (Bedrock), Microsoft (Copilot),
  NVIDIA, Salesforce (Einstein), Netflix, Uber, Airbnb AI teams

TIER 3 — AI-FIRST STARTUPS (equity upside, fast learning)
  Anyscale, Together AI, Fireworks AI, Modal, Groq, Perplexity,
  Hugging Face, LangChain Inc, Weights & Biases, Replit, Cursor,
  Stability AI, Scale AI, Databricks, Runway, ElevenLabs, Character.ai

TIER 4 — ENTERPRISES BUILDING AI (volume of jobs)
  Deloitte, Accenture, McKinsey (AI), Goldman Sachs,
  JPMorgan, Walmart, any Fortune 500 AI team

TIER 5 — AI CONSULTING & SERVICES (accessible entry)
  TCS, Infosys, Wipro (AI practices), Fractal Analytics,
  Tiger Analytics, Mu Sigma, LatentView

INDIA-SPECIFIC AI COMPANIES:
  AI-Native: Sarvam AI (sovereign LLM), Ola Krutrim, Neysa (AI cloud),
    AI4Bharat (IIT Madras), Qure.ai (health), TWO AI, BharatGen
  Product Cos: Flipkart AI, PhonePe ML, Swiggy ML, Zomato AI,
    Razorpay AI, CRED AI, Reliance Jio AI
  Services: Fractal Analytics, LatentView, Tiger Analytics, Mu Sigma
  MNC India Labs: Microsoft IDC (Hyderabad), Google India (Bangalore),
    Amazon India ML, Walmart Labs India, NVIDIA India, Apple India ML
  Research Labs: IIT Madras (Robert Bosch Center), IIIT Hyderabad,
    Microsoft Research India, Intel AI Lab (IIT Hyderabad), Wipro-IISc

INDIA JOB PLATFORMS:
  Naukri.com, Instahyre, CutShort, LinkedIn India, AngelList India,
  Hirect, iimjobs.com (PM roles), Wellfound India

INDIA SALARY CONTEXT:
  → Service cos (TCS/Infosys/Wipro): ₹5-15 LPA for AI roles
  → Product cos (Flipkart/PhonePe/CRED): ₹12-40 LPA
  → MNC India labs (Google/Microsoft/Amazon): ₹15-60+ LPA
  → Bangalore/Hyderabad pay 30-50% above other cities
  → Remote US-company roles: ₹40-80 LPA (growing trend)
  → IndiaAI Mission: ₹10,000 crore govt initiative providing
    subsidized GPU access (~₹65/hr) to startups and researchers

★ Salary Table (All 31 Roles)

                           UNITED STATES ($K/yr)         INDIA (₹ LPA)
                       Entry    Mid    Senior+      Entry   Mid   Senior+
──────────────────────────────────────────────────────────────────────────
LAYER 6 — APPLICATION:
Full-Stack AI Eng.       88    120-180  168-250+    6-12  15-30  30-55+
AI Integration Eng.       —    120-180  160-250+      —   12-25  25-50+
AI Sales Engineer         —    120-180  160-250+      —   15-30  30-55+
AI Consultant/Strategist  —    130-200  180-280+      —   15-35  35-65+
AI Product Manager        —    150-220  200-300+      —   20-40  40-70+
Conversational AI Eng     —    140-210  190-300+      —   18-35  35-60+
AI Tech Writer/DevRel     —    110-170  150-220+      —   12-25  25-45+
──────────────────────────────────────────────────────────────────────────
LAYER 5 — ORCHESTRATION:
AI Engineer             100    140-211  195-350+    5-12  18-32  35-60+
GenAI Engineer          120    180-250  220-350+    8-15  25-45  50-80+
Agentic AI Engineer       —    170-250  220-350+      —   25-45  45-75+
Prompt Engineer          80    120-180  160-250    5-10  15-30  30-50+
AI Solutions Architect    —    160-230  200-320+      —   25-45  45-75+
AI DevTools Engineer      —    150-220  200-300+      —   20-40  40-70+
──────────────────────────────────────────────────────────────────────────
LAYER 4 — FINE-TUNING:
LLM Engineer              —    180-260  240-400+      —   20-40  40-70+
RAG Engineer              —    150-220  200-300+      —   18-35  35-60+
AI Data Engineer          —    130-190  175-260+      —   15-28  28-50+
NLP Engineer              —    130-200  180-280+      —   15-30  30-55+
Computer Vision Eng.      —    137-200  200-350+      —   15-30  30-55+
Data Scientist (GenAI)   95    130-200  180-280+    6-14  18-35  35-60+
AI Safety/Red Team        —    160-220  200-300+      —   20-35  35-60+
AI Trainer/RLHF          45     75-120  120-180+    3-8   8-15   15-30+
──────────────────────────────────────────────────────────────────────────
LAYER 3 — INFERENCE:
MLOps/LLMOps Eng.         —    140-200  180-280+      —   15-30  30-55+
ML Engineer              96    149-200  175-240+    8-15  20-35  35-60+
Inference Opt Eng.        —    167-209  200-350+      —   25-45  45-80+
──────────────────────────────────────────────────────────────────────────
LAYER 2 — FOUNDATION:
Foundation Model Eng.     —    160-250  250-400+      —   25-45  50-80+
Applied Scientist         —    150-220  200-400+      —   20-40  40-70+
AI Research Scientist   115    160-260  220-400+      —   30-50  40-80+
──────────────────────────────────────────────────────────────────────────
LAYER 1 — INFRASTRUCTURE:
AI Infra/Platform Eng.    —    140-220  192-320+      —   20-40  40-70+
AI Compiler/Kernel Eng.   —       —     250-400+      —      —   45-80+
──────────────────────────────────────────────────────────────────────────
CROSS-CUTTING:
AI Ethics/Governance      —    140-200  180-280+      —   18-35  35-60+
AI Data Governance Mgr.   —    130-190  170-260+      —   15-30  30-55+

FAANG Senior TC (total comp with equity): $320-550K+
Staff/Principal at frontier labs: up to $943K (outlier)
GenAI premium: +40-60% over traditional ML salaries
India: Service cos pay 40-60% less than product cos for same role

★ Certification Roadmap

Certification Applicable Roles Priority Notes
AWS ML Engineer – Associate (MLA-C01) ML Eng, MLOps, AI Architect, AI Data Eng 🔴 High Replaces retired AWS ML Specialty
AWS Generative AI Developer – Professional (AIP-C01) GenAI Eng, AI Eng, RAG Eng, LLM Eng 🔴 High Covers RAG, Bedrock, prompt eng
GCP Professional ML Engineer ML Eng, MLOps, GenAI Eng 🔴 High
Google Cloud GenAI (Professional) GenAI Eng, AI Eng, Prompt Eng 🔴 High Directly relevant for GenAI roles
Azure AI Engineer Associate (AI-102) AI Integration Eng, Full-Stack AI, AI Consultant 🟡 Medium Microsoft-heavy enterprises
DeepLearning.AI Short Courses All GenAI roles 🟡 Medium LangChain, LlamaIndex, RAG courses
Kubernetes (CKA/CKAD) MLOps, AI Infra, Inference Opt 🟡 Medium
NVIDIA NCP-AAI (Agentic AI) Agentic AI Eng, AI Eng, GenAI Eng 🟡 Medium Professional agentic AI cert (2026)
NVIDIA Deep Learning Institute (DLI) Inference Opt, Foundation Model, AI Compiler 🟡 Medium GPU-specific training
Google AI Professional Certificate All non-coding roles 🟢 Nice-to-have Practical AI skills for non-coders
AWS AI Practitioner (AIF-C01) AI PM, AI Consultant, AI Sales Eng 🟢 Nice-to-have Entry-level; non-engineering roles

Note: Certifications matter most for Tier 4-5 companies (enterprises, consulting). Frontier labs (Tier 1-2) care more about projects, papers, and open-source contributions. DeepLearning.AI short courses are often more valued than formal certs for GenAI-specific roles.


★ Portfolio Project Ideas

Project Target Roles Layer Differentiation Tip
RAG system for legal contract analysis with citation verification, hybrid search, RAGAS eval RAG Eng, GenAI Eng, AI Integration Eng L4-5 Domain-specific RAG with evaluation > generic "RAG chatbot"
Multi-agent code review system (LangGraph) analyzing PRs across repos Agentic AI Eng, AI Eng, GenAI Eng L5 Real utility > toy agents; add observability + cost tracking
Fine-tuned medical NER model (Unsloth/LoRA) with eval dashboard LLM Eng, NLP Eng, Data Scientist L4 Domain-specific + evaluation pipeline shows production thinking
AI-powered web app (Next.js + LLM API + RAG + auth + deploy) Full-Stack AI Eng, AI Integration Eng L6 Must be deployed, not just local; add streaming + monitoring
LLM evaluation pipeline comparing 5+ models on custom benchmark GenAI Eng, LLM Eng, AI Safety Eng L4-5 Custom benchmarks > reporting others'
Prompt library + A/B testing framework with version control Prompt Eng, AI Consultant L5-6 Testing framework shows engineering rigor
Voice assistant with multi-turn memory (Whisper + LLM + TTS) Conversational AI Eng L6 Multi-turn context is the differentiator
MLOps pipeline (Docker + K8s + CI/CD) with canary deployment MLOps Eng, ML Eng L3 Canary deployment + monitoring shows production maturity
SDK/CLI tool for LLM API with caching, retry, streaming AI DevTools Eng L5 Ship as npm/pip package for real validation
Model inference benchmark (vLLM vs TensorRT vs ONNX) with cost analysis Inference Opt Eng L3 Cost-per-token alongside latency
Data pipeline (Airflow + embeddings at scale) with quality checks AI Data Eng, Data Scientist L4 Data quality monitoring differentiates
AI safety red-team report with reproducible attack PoCs AI Safety Eng, AI Ethics Cross Reproducible PoCs > theoretical reports
Research paper reproduction with novel ablation + blog post AI Research Scientist, Applied Scientist L2 Own ablation results show research capability
Open-source contribution to LangChain, vLLM, or Hugging Face All roles All Merged PRs = strongest hiring signal
AI tutorial series (blog or video) on GenAI topics AI Tech Writer/DevRel, Prompt Eng L5-6 Public content = instant portfolio

★ Sources

  • LinkedIn "Skills on the Rise 2026" and "Jobs on the Rise 2026" reports (AI Engineer #1)
  • Indeed, Glassdoor, Naukri job postings analysis (March 2026)
  • Levels.fyi, BuiltIn.com, Wellfound compensation data
  • OpenAI, Anthropic, Google DeepMind, Meta FAIR, AMD career pages (March 2026)
  • Gartner "40% enterprise apps embed agents by end 2026" prediction
  • NVIDIA, Anyscale, Together AI, Fireworks AI, Poolside AI job postings
  • Signify Technology ML Engineer salary report 2026
  • Vercel, Cursor, Replit AI DevTools team job descriptions
  • India AI Impact Summit 2026, IndiaAI Mission documentation
  • Sarvam AI, Neysa, Krutrim press releases and funding data
  • Tracxn, Crunchbase Indian AI startup data (March 2026)
  • AWS, Google Cloud, Azure, NVIDIA certification pages (March 2026)
  • a16z, NVIDIA, Sequoia Capital AI stack frameworks
  • Forbes, Coursera, Tredence GenAI career role guides (2025-2026)