ai-engineer
career
genai
job-roles
llm-engineer
rag-engineer
salary
skills
GenAI Career Roles — Complete Reference (2026)
✨ "AI Engineer" was LinkedIn's #1 fastest-growing job title in 2026. This document covers 31 roles across a 6-layer AI stack — from Application (easiest entry) to Infrastructure & Hardware (highest pay). Salary data for both US and India markets.
Note on "AI/ML Developer" : This is NOT a distinct job role. It's used interchangeably with "AI Engineer" or "ML Engineer" in job postings. Read the JD — it maps to one of the 31 roles below.
Last researched : 2026-03. Treat compensation and hiring examples as a market snapshot, not a permanent truth.
Dedicated Role Guides
Grouped Role Guides
Table of Contents
The 6-Layer AI Stack
Role Overview Table
Role-by-Role Breakdown
Layer 6 — Application
Layer 5 — Orchestration
Layer 4 — Fine-tuning & Evaluation
Layer 3 — Inference & Serving
Layer 2 — Foundation Model
Layer 1 — Infrastructure & Hardware
Cross-cutting
Roles by Entry Difficulty
Career Pathways
Skills × Roles Matrix
Interview Preparation Map
Job Search Keywords
Frontier Lab Requirements
Target Companies by Tier
Salary Table (All 31 Roles)
Certification Roadmap
Portfolio Project Ideas
Sources
★ The 6-Layer AI Stack
Note : This is a career-planning model adapted from industry frameworks (a16z, NVIDIA, Sequoia). Standard industry models use 4-5 layers; this 6-layer version provides finer granularity for mapping roles.
┌─────────────────────────────────────────────────────────────────────┐
│ LAYER 6: APPLICATION │
│ Integrating AI into products, workflows, and user-facing features │
│ Roles: Full-Stack AI, AI Integration, AI Sales, AI Consultant, │
│ AI PM, Conversational AI, AI Tech Writer/DevRel │
├─────────────────────────────────────────────────────────────────────┤
│ LAYER 5: ORCHESTRATION │
│ Building AI systems: agents, RAG pipelines, multi-model workflows │
│ Roles: AI Engineer, GenAI Engineer, Agentic AI, Prompt Engineer, │
│ AI Architect, AI DevTools Engineer │
├─────────────────────────────────────────────────────────────────────┤
│ LAYER 4: FINE-TUNING & EVALUATION │
│ Adapting models: fine-tuning, evaluation, domain-specific training │
│ Roles: LLM Engineer, RAG Engineer, AI Data Eng, NLP Eng, CV Eng, │
│ Data Scientist, AI Safety/Red Team, AI Trainer │
├─────────────────────────────────────────────────────────────────────┤
│ LAYER 3: INFERENCE & SERVING │
│ Production: deployment, monitoring, optimization, cost control │
│ Roles: MLOps/LLMOps, ML Engineer, Inference Optimization Eng │
├─────────────────────────────────────────────────────────────────────┤
│ LAYER 2: FOUNDATION MODEL │
│ Building models: pre-training, architecture design, research │
│ Roles: Foundation Model Eng, AI Research Scientist, Applied Sci │
├─────────────────────────────────────────────────────────────────────┤
│ LAYER 1: INFRASTRUCTURE & HARDWARE │
│ Compute: GPU clusters, compilers, kernels, distributed systems │
│ Roles: AI Infra/Platform Eng, AI Compiler/Kernel Eng │
└─────────────────────────────────────────────────────────────────────┘
★ Role Overview Table (31 Roles)
#
Role
Layer
Entry Difficulty
Availability
Salary (US Range)
Min Education
1
Full-Stack AI Engineer
L6
🟡 Moderate
🟢 Very High
$88K–$250K+
Bachelor's
2
AI Integration Engineer
L6
🟡 Moderate
🟢 Very High
$120K–$250K+
Bachelor's
3
AI Sales Engineer
L6
🟢 Accessible
🟢 High
$120K–$250K+
Bachelor's
4
AI Consultant / Strategist
L6
🟡 Moderate
🟢 High
$130K–$280K+
Bachelor's
5
AI Product Manager
L6
🔴 Advanced
🟢 High
$150K–$300K+
Bachelor's
6
Conversational AI Engineer
L6
🔴 Advanced
🟡 Medium
$140K–$300K+
Bachelor's
7
AI Technical Writer / DevRel
L6
🟢 Accessible
🟢 High
$110K–$220K+
Bachelor's
8
AI Engineer
L5
🟡 Moderate
🟢 Very High
$100K–$350K+
Bachelor's
9
Generative AI Engineer
L5
🟡 Moderate
🟢 High
$120K–$350K+
Bachelor's
10
Agentic AI Engineer
L5
🟡 Moderate
🟡 Medium-High
$170K–$350K+
Bachelor's
11
Prompt Engineer
L5
🟢 Accessible
🟢 High
$80K–$250K
Bachelor's
12
AI Solutions Architect
L5
🔴 Advanced
🟡 Medium
$160K–$320K+
Bachelor's
13
AI Developer Tools Engineer
L5
🔴 Advanced
🟡 Growing
$150K–$300K+
Bachelor's
14
LLM Engineer
L4
🔴 Advanced
🟡 Medium-High
$180K–$400K+
Master's pref
15
RAG Engineer
L4
🟡 Moderate
🟡 Medium-High
$150K–$300K+
Bachelor's
16
AI Data Engineer
L4
🟡 Moderate
🟢 High
$130K–$260K+
Bachelor's
17
NLP Engineer
L4
🔴 Advanced
🟡 Medium
$130K–$280K+
Master's pref
18
Computer Vision Engineer
L4
🔴 Advanced
🟡 Medium
$137K–$350K+
Master's pref
19
Data Scientist (GenAI)
L4
🟡 Moderate
🟢 Very High
$95K–$280K+
Bachelor's
20
AI Safety / Red Team Eng
L4
⚫ Elite
🔴 Niche
$160K–$300K+
Master's pref
21
AI Trainer / RLHF Annotator
L4
🟢 Accessible
🟢 Very High
$45K–$180K+
None/Bachelor's
22
MLOps / LLMOps Engineer
L3
🔴 Advanced
🟢 Very High
$140K–$280K+
Bachelor's
23
ML Engineer
L3
🔴 Advanced
🟢 Very High
$96K–$550K TC
Bachelor's
24
Inference Optimization Eng
L3
⚫ Elite
🔴 Niche
$167K–$350K+
Master's/PhD
25
Foundation Model Engineer
L2
⚫ Elite
🔴 Very Few
$160K–$400K+
Master's/PhD
26
AI Research Scientist
L2
⚫ Elite
🔴 Niche
$115K–$400K+
PhD preferred
27
Applied AI Scientist
L2
⚫ Elite
🟡 Medium
$150K–$400K+
Master's/PhD
28
AI Infra / Platform Engineer
L1
⚫ Elite
🔴 Niche
$140K–$320K+
Bachelor's
29
AI Compiler / Kernel Engineer
L1
⚫ Elite
🔴 Ultra-Niche
$250K–$400K+
Master's/PhD
30
AI Ethics & Governance Lead
Cross
🔴 Advanced
🟡 Medium
$140K–$280K+
Master's pref
31
AI Data Governance Manager
Cross
🔴 Advanced
🟡 Medium
$130K–$260K+
Bachelor's
★ Role-by-Role Breakdown
Layer 6 — Application (7 Roles)
1. Full-Stack AI Engineer 🟢
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Build complete AI-powered applications end-to-end — frontend, backend, and AI integration. The most in-demand "generalist" AI role.
Key Responsibilities
Build AI-powered web/mobile apps, integrate LLM APIs into products, design RAG systems for apps, build AI agent UIs, handle model serving and latency optimization
Must-Have Skills
Python, TypeScript/JavaScript, React/Next.js, LLM APIs (OpenAI/Gemini/Claude), RAG, SQL + vector DBs, Docker, cloud (AWS/GCP)
Nice-to-Have
AI agent frameworks, embeddings, streaming responses, real-time AI features, product thinking
Salary (US)
Entry: $88–120K · Mid: $120–180K · Senior: $168–250K+
Salary (India)
Entry: ₹6–12 LPA · Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
Every SaaS company, every startup adding AI features, every enterprise
Job Availability
🟢 Highest volume — this is where most AI jobs are right now
Entry Requirements
Bachelor's in CS/SE. 1–2 years full-stack + AI/LLM project experience. Strong portfolio.
Career Progression
→ AI Engineer (L5) · → AI Architect · → AI PM · → Founding Engineer at AI startup
Related Roles
AI Integration Engineer, AI Engineer, GenAI Engineer
Key Differentiator
Requires frontend (React/Next.js) + backend + AI — true full-stack, not just backend+LLM
2. AI Integration Engineer 🟢
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Integrate AI into existing enterprise products. Add AI features to CRMs, ERPs, SaaS platforms. The "glue" between AI capabilities and business systems.
Key Responsibilities
LLM API integration, RAG pipelines for enterprise data, AI feature design, latency/cost/hallucination guardrails, testing AI features, stakeholder communication
Must-Have Skills
Python, API development (REST/GraphQL), LLM APIs, RAG, prompt engineering, SQL, enterprise integration patterns
Nice-to-Have
Domain expertise (finance, healthcare, legal), Salesforce/ServiceNow integrations, data governance
Salary (US)
Mid: $120–180K · Senior: $160–250K+
Salary (India)
Mid: ₹12–25 LPA · Senior: ₹25–50+ LPA
Hiring Companies
Accenture, Deloitte, TCS, Infosys, every enterprise, every SaaS company
Job Availability
🟢 Very High — every company integrating AI needs this role
Entry Requirements
Bachelor's in CS/SE. 1–3 years backend/integration experience. LLM API experience preferred.
Career Progression
→ AI Consultant · → AI Architect · → AI Sales Engineer · → AI PM
Related Roles
Full-Stack AI Engineer, AI Consultant, AI Engineer
Key Differentiator
Focused on integrating AI into existing systems, not building new AI-native apps
3. AI Sales Engineer / Solutions Engineer 🟢
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Demo AI products to potential customers, design custom solutions, provide technical pre-sales support. Bridge between AI product teams and enterprise buyers.
Key Responsibilities
Technical demos, PoC building, customer requirements analysis, solution architecture, competitive positioning, technical proposal writing
Must-Have Skills
Broad AI/ML/GenAI knowledge, excellent communication, demo skills, RAG/agents understanding, API integration, customer empathy
Nice-to-Have
Cloud certifications, industry domain expertise, CRM tools, prior consulting or customer-facing experience
Salary (US)
Mid: $120–180K + commission · Senior: $160–250K+ OTE
Salary (India)
Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
OpenAI, Anthropic, Cohere, AWS (Bedrock), Google Cloud (Vertex AI), Databricks, every AI SaaS vendor
Job Availability
🟢 High — every AI vendor needs sales engineers; growing with enterprise AI adoption
Entry Requirements
Bachelor's in CS/business. Prior sales/consulting experience valued. Broad AI knowledge required, not deep specialization.
Career Progression
→ AI Consultant · → AI PM · → VP Sales (AI) · → Solutions Practice Lead
Related Roles
AI Consultant, AI Integration Engineer, AI PM
Key Differentiator
Customer-facing + technical — requires demo skills and business acumen alongside AI knowledge
4. AI Consultant / AI Strategist 🟢
Field
Details
Stack Layer
Layer 6 (Application) — strategic
What You Do
Advise companies on AI adoption strategy. Assess use cases, recommend architectures, build PoCs, guide implementation.
Key Responsibilities
AI readiness assessment, use case identification, PoC development, vendor evaluation, ROI analysis, AI roadmap creation
Must-Have Skills
Broad AI/ML knowledge, RAG/agents/fine-tuning understanding, presentation skills, business acumen, PoC building
Nice-to-Have
Industry expertise, cloud certifications, project management, consulting experience
Salary (US)
Mid: $130–200K · Senior: $180–280K+
Salary (India)
Mid: ₹15–35 LPA · Senior: ₹35–65+ LPA
Hiring Companies
McKinsey, BCG, Deloitte, Accenture, PwC (AI practices), boutique AI consultancies
Job Availability
🟢 High — enterprise AI adoption is exploding
Entry Requirements
Bachelor's + 2–4 years in tech/consulting. Consulting methodology knowledge. AI/ML breadth more important than depth.
Career Progression
→ AI Practice Lead · → Chief AI Officer · → Independent AI Consultant · → AI startup founder
Related Roles
AI Sales Engineer, AI Architect, AI PM
Key Differentiator
Strategy + PoC focus — designs the "what" and "why" of AI adoption, not the "how" of production systems
5. AI Product Manager 🟢
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Define vision for AI products. Prioritize features, manage stakeholders, translate business needs to AI capabilities.
Key Responsibilities
Product roadmap, feature prioritization, user research, AI capability assessment, go-to-market, metrics definition
Must-Have Skills
Understanding of AI/LLM capabilities and limitations, product thinking, user research, stakeholder management
Nice-to-Have
Hands-on prompt engineering, RAG understanding, evaluation metrics knowledge, competitive landscape awareness
Salary (US)
Mid: $150–220K · Senior: $200–300K+
Salary (India)
Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies
Every tech company, SaaS, enterprise, AI startups
Job Availability
🟢 High — strong demand for AI-literate PMs
Entry Requirements
Bachelor's + 3–5 years product management experience. AI literacy required, coding optional. MBA common but not required.
Career Progression
→ Director of Product (AI) · → VP Product · → Chief Product Officer · → AI startup founder
Related Roles
AI Consultant, AI Architect, AI Sales Engineer
Key Differentiator
Owns the "what to build" — product strategy, not implementation. Must understand AI capabilities without necessarily coding.
6. Conversational AI Engineer 🟡
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Build dialogue systems, voice assistants, and enterprise AI chatbots. Design multi-turn conversation architectures, intent tracking, and speech integration.
Key Responsibilities
Multi-turn dialogue design, context management, intent disambiguation, ASR/TTS integration (Whisper, Google STT), persona design, conversation analytics
Must-Have Skills
Python, LLM APIs, NLU (intent detection, entity extraction), dialogue state tracking, speech recognition integration, prompt engineering
Nice-to-Have
Google Dialogflow, ADK, voice UX design, WebSocket streaming, multilingual dialogue, sentiment analysis
Salary (US)
Mid: $140–210K · Senior: $190–300K+
Salary (India)
Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Google, Amazon (Alexa), Apple (Siri), Salesforce, startups building AI assistants
Job Availability
🟡 Medium — growing with enterprise AI assistant adoption
Entry Requirements
Bachelor's in CS. 2–4 years in NLP/dialogue systems. Experience with speech APIs and multi-turn conversation design.
Career Progression
→ AI Architect · → AI PM (voice/chat products) · → VP Engineering (conversational AI)
Related Roles
NLP Engineer, AI Engineer, GenAI Engineer
Key Differentiator
Speech + dialogue specialization — requires ASR/TTS integration and multi-turn context management beyond standard LLM work
7. AI Technical Writer / Developer Relations Engineer 🟢
Field
Details
Stack Layer
Layer 6 (Application)
What You Do
Create documentation, tutorials, and developer education content for AI products. Build developer communities, give talks, and evangelize AI tools.
Key Responsibilities
API documentation, tutorials, code samples, blog posts, conference talks, community management, SDK guides, developer onboarding
Must-Have Skills
Strong writing, Python, LLM APIs, RAG understanding, Git, Markdown, ability to explain complex AI concepts simply
Nice-to-Have
Public speaking, video creation, open-source contribution, community building, TypeScript
Salary (US)
Mid: $110–170K · Senior: $150–220K+
Salary (India)
Mid: ₹12–25 LPA · Senior: ₹25–45+ LPA
Hiring Companies
Hugging Face, LangChain, OpenAI, Anthropic, Google (Cloud DevRel), Cohere, Weaviate, Pinecone
Job Availability
🟢 High — every AI company needs developer education; often overlooked by applicants
Entry Requirements
Bachelor's in CS/technical writing. Strong AI knowledge breadth + excellent communication. Portfolio of technical content.
Career Progression
→ Head of DevRel · → Developer Advocacy Director · → AI Educator / Course Creator · → VP Developer Experience
Related Roles
AI Consultant, Prompt Engineer, AI Trainer
Key Differentiator
Communication-first role — explains AI to developers. Broad knowledge breadth matters more than implementation depth.
Layer 5 — Orchestration (6 Roles)
8. AI Engineer (LinkedIn's #1 Fastest-Growing Title 2026) 🟢
Field
Details
Stack Layer
Layer 5–6 (Orchestration / Application)
What You Do
Design, build, and deploy AI-powered features. Orchestrate LLMs, agents, and multi-model systems into production applications.
Key Responsibilities
Build AI pipelines, integrate LLMs into products, manage multi-agent workflows, evaluate model quality, optimize cost/latency
Must-Have Skills
Python, PyTorch/TensorFlow, LLM APIs (OpenAI/Gemini/Claude), RAG, prompt engineering, Docker/K8s, Git
Nice-to-Have
Fine-tuning (LoRA/QLoRA), agentic frameworks (LangGraph, CrewAI), MCP/A2A protocols, cloud (AWS/GCP/Azure)
Salary (US)
Entry: $100–140K · Mid: $140–211K · Senior: $195–350K+
Salary (India)
Entry: ₹5–12 LPA · Mid: ₹18–32 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Every tech company, SaaS startups, enterprise AI teams, FAANG
Job Availability
🟢 Very High — LinkedIn's #1 fastest-growing title
Entry Requirements
Bachelor's in CS/SE. 1–2 years software engineering. LLM/AI project experience. Fastest entry into AI for SWEs.
Career Progression
→ GenAI Engineer · → AI Architect · → Staff AI Engineer · → Principal Engineer · → CTO
Related Roles
GenAI Engineer, Full-Stack AI Engineer, ML Engineer
Key Differentiator
Broadest L5 role — integrates existing models into products (vs ML Eng who trains models, vs GenAI Eng who builds GenAI-specific systems)
9. Generative AI Engineer 🟢
Field
Details
Stack Layer
Layer 5 (Orchestration)
What You Do
Build enterprise-grade GenAI solutions end-to-end. Design RAG systems, fine-tune models, build agent architectures, deploy to production.
Key Responsibilities
RAG pipelines, LLM integration, prompt engineering, fine-tuning, model evaluation, building AI agents, production deployment
Must-Have Skills
Python, LLM APIs, RAG (chunking, embedding, vector DBs), prompt engineering, LangChain/LlamaIndex, evaluation metrics
Nice-to-Have
Graph RAG, agentic protocols (MCP/A2A/ADK), Unsloth/Axolotl for fine-tuning, multimodal AI
Salary (US)
Entry: $120–160K · Mid: $180–250K · Senior: $220–350K+
Salary (India)
Entry: ₹8–15 LPA · Mid: ₹25–45 LPA · Senior: ₹50–80+ LPA (top-tier companies)
Hiring Companies
Google, Meta, Microsoft, Amazon, Anthropic, AI startups, consulting firms
Job Availability
🟢 High — exploding demand across all sectors
Entry Requirements
Bachelor's in CS. 1–3 years with LLMs, RAG, and GenAI frameworks. Production GenAI project experience strongly preferred.
Career Progression
→ LLM Engineer · → AI Architect · → Staff GenAI Engineer · → Founding AI Engineer at startup
Related Roles
AI Engineer, LLM Engineer, RAG Engineer
Key Differentiator
GenAI-specific depth — RAG, agents, fine-tuning, evaluation. ~80% overlap with AI Engineer but deeper on GenAI stack.
10. Agentic AI Engineer / AI Agent Developer 🟡
Field
Details
Stack Layer
Layer 5 (Orchestration)
What You Do
Design and orchestrate autonomous AI agents. Gartner predicts 40% of enterprise apps will embed agents by end of 2026.
Key Responsibilities
Multi-agent system design, tool use orchestration, agent memory/state management, safety guardrails, cost controls for autonomous systems
Must-Have Skills
Python, LangGraph/CrewAI/AutoGen, function calling, MCP/A2A, RAG, vector DBs, async programming
Nice-to-Have
ADK (Google), OpenAI Agents SDK, agent observability, human-in-the-loop patterns
Salary (US)
Mid: $170–250K · Senior: $220–350K+
Salary (India)
Mid: ₹25–45 LPA · Senior: ₹45–75+ LPA
Hiring Companies
Apple, Disney, Salesforce, every enterprise building agent workflows
Job Availability
🟡 Medium-High — fastest growing sub-specialization within AI Engineering
Entry Requirements
Bachelor's in CS. 2–3 years AI/GenAI engineering. Strong async programming skills. Multi-agent project portfolio.
Career Progression
→ AI Architect · → Staff AI Engineer · → AI Platform Lead · → VP Engineering (AI)
Related Roles
AI Engineer, GenAI Engineer, AI DevTools Engineer
Key Differentiator
Agent-specific — multi-agent orchestration, tool use, safety guardrails. Emerging specialization, not yet a separate title at most companies.
11. Prompt Engineer / AI Interaction Specialist 🟢
Field
Details
Stack Layer
Layer 5–6 (Orchestration / Application)
What You Do
Craft, test, and optimize prompts and agent instructions. Bridge between human intent and LLM execution.
Key Responsibilities
Prompt design (zero-shot, few-shot, CoT), structured output (JSON), reducing hallucinations, multi-step workflows, agent-based prompting, testing
Must-Have Skills
Deep LLM understanding, prompt patterns, function calling, structured output, evaluation methods
Nice-to-Have
Python scripting, RAG integration, tool/function calling, prompt playgrounds, LangChain/LlamaIndex
Salary (US)
Entry: $80–120K · Mid: $120–180K · Senior: $160–250K
Salary (India)
Entry: ₹5–10 LPA · Mid: ₹15–30 LPA · Senior: ₹30–50+ LPA
Hiring Companies
OpenAI, Anthropic, consulting firms, legal/healthcare AI, enterprise AI
Job Availability
🟢 High — though evolving into broader AI/GenAI Engineering roles
Entry Requirements
Bachelor's (any field). Strong analytical thinking. 0–1 year with LLMs. Lowest technical barrier of any AI engineering role.
Career Progression
→ AI Engineer · → GenAI Engineer · → AI Consultant · → AI PM
Related Roles
AI Engineer, GenAI Engineer, AI Consultant
Key Differentiator
Prompt-first — deep expertise in getting optimal LLM behavior. Role is merging into broader AI Eng at many companies.
12. AI Solutions Architect 🟡
Field
Details
Stack Layer
Layer 5–6 (Orchestration / Application)
What You Do
Design enterprise AI architectures. Connect business goals with practical AI systems. Select frameworks, tools, and define blueprints.
Key Responsibilities
Solution design, tech stack selection, scalability planning, cost modeling, vendor evaluation, team mentoring, stakeholder communication
Must-Have Skills
Broad AI/ML knowledge, cloud architecture (AWS/GCP/Azure), system design, LLM systems, RAG, agents, MLOps understanding
Nice-to-Have
Multi-agent architecture, MCP/A2A protocols, security & compliance, enterprise integration patterns
Salary (US)
Mid: $160–230K · Senior: $200–320K+
Salary (India)
Mid: ₹25–45 LPA · Senior: ₹45–75+ LPA
Hiring Companies
Cloud providers (AWS/GCP/Azure), consulting firms, large enterprises
Job Availability
🟡 Medium — senior role, less entry-level
Entry Requirements
Bachelor's + 5–7 years software engineering + 2+ years AI/ML. Cloud certifications highly valued. System design expertise required.
Career Progression
→ Principal Architect · → VP Engineering · → CTO · → Chief AI Officer
Related Roles
AI Consultant, AI Engineer, AI PM
Key Differentiator
Architecture-first — designs the blueprint that teams implement. Senior role requiring both technical depth and business communication.
Field
Details
Stack Layer
Layer 5 (Orchestration)
What You Do
Build AI-powered developer tools — IDEs, CLI tools, copilots, SDKs. The people who build Cursor, Gemini CLI, GitHub Copilot, Windsurf.
Key Responsibilities
AI copilot development, SDK/API design, AI-assisted code generation pipelines, developer experience (DX) optimization, testing AI-generated code
Must-Have Skills
Python, TypeScript/JavaScript, SDK/API design, LLM APIs, prompt engineering, testing frameworks, Git, open-source development
Nice-to-Have
VS Code extension development, LSP (Language Server Protocol), tree-sitter, AST parsing, developer experience research
Salary (US)
Mid: $150–220K · Senior: $200–300K+
Salary (India)
Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies
Google (Gemini CLI), Anthropic (Claude Code), Cursor, Replit, Vercel, GitHub
Job Availability
🟡 Growing fast — every dev tool company is building AI features
Entry Requirements
Bachelor's in CS. 3–5 years software engineering + SDK/API design experience. Understanding of developer workflows. TypeScript proficiency.
Career Progression
→ Staff DevTools Engineer · → Head of Developer Experience · → VP Engineering · → CTO at DevTools company
Related Roles
AI Engineer, Full-Stack AI Engineer, GenAI Engineer
Key Differentiator
Developer-tool-specific — requires SDK design, DX thinking, and understanding of developer workflows beyond just AI/LLM integration
Layer 4 — Fine-tuning & Evaluation (8 Roles)
14. LLM Engineer 🟡
Field
Details
Stack Layer
Layer 4–5 (Fine-tuning / Orchestration)
What You Do
Specialize in building, fine-tuning, evaluating, and deploying LLM-based applications. System designer who integrates foundation models into products.
Key Responsibilities
Fine-tuning (LoRA, QLoRA, DPO), model evaluation, hallucination mitigation, latency/cost optimization, inference serving, model selection
Must-Have Skills
Transformer architecture, fine-tuning techniques, tokenization, inference optimization (quantization, KV-cache), evaluation benchmarks
Nice-to-Have
Training infrastructure (multi-GPU), scaling laws, RLHF/GRPO, distillation, custom tokenizers
Salary (US)
Mid: $180–260K · Senior: $240–400K+
Salary (India)
Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies
OpenAI, Anthropic, Google, Cohere, AI21 Labs, Hugging Face, enterprise AI
Job Availability
🟡 Medium-High — growing fast, more specialized than AI Engineer
Entry Requirements
Master's preferred. 2–4 years ML/AI experience. Deep understanding of transformer internals and fine-tuning techniques.
Career Progression
→ Foundation Model Engineer · → Staff LLM Engineer · → AI Research Scientist · → ML Platform Lead
Related Roles
GenAI Engineer, ML Engineer, Foundation Model Engineer
Key Differentiator
LLM-depth — fine-tuning, tokenization, inference optimization. Deeper on model internals than GenAI Eng, less broad than AI Eng.
15. RAG Engineer 🟡
Field
Details
Stack Layer
Layer 4–5 (Fine-tuning / Orchestration)
What You Do
Build intelligent search and synthesis systems. Connect LLMs to external knowledge via embeddings, vector databases, and retrieval pipelines.
Key Responsibilities
Document processing, chunking strategies, embedding pipelines, vector DB management, hybrid search (BM25 + semantic), re-ranking, RAG evaluation
Must-Have Skills
Embeddings (text-embedding-3-large, Gemini Embedding), vector DBs (Pinecone, Weaviate, Chroma, pgvector), chunking, RAGAS metrics
Nice-to-Have
Graph RAG, agentic RAG, multimodal RAG, context caching, query transformation, privacy-preserving techniques
Salary (US)
Mid: $150–220K · Senior: $200–300K+
Salary (India)
Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Enterprise AI teams, SaaS companies, consulting firms, legal/finance AI
Job Availability
🟡 Medium-High — every enterprise needs RAG for internal knowledge
Entry Requirements
Bachelor's in CS. 1–3 years with embeddings, vector DBs, and search systems. RAG is an emerging specialization within broader GenAI/AI Eng roles.
Career Progression
→ GenAI Engineer · → AI Architect · → Staff AI Engineer · → Search/Knowledge Platform Lead
Related Roles
GenAI Engineer, AI Engineer, AI Data Engineer
Key Differentiator
Retrieval-specialist — deep expertise in search, embeddings, and knowledge integration. Often a specialization within GenAI Eng rather than a standalone title.
16. AI Data Engineer 🟢
Field
Details
Stack Layer
Layer 4 (Fine-tuning & Evaluation)
What You Do
Design data architecture for AI/ML/GenAI. Ensure data is trusted, secure, and AI-ready. Build data pipelines for LLM training and RAG.
Key Responsibilities
Data pipelines, ETL/ELT for AI, data quality, embedding generation at scale, synthetic data pipelines, data governance
Must-Have Skills
Python, SQL, data engineering tools (Spark, Airflow), cloud data services, embeddings, vector DBs
Nice-to-Have
Synthetic data generation, data labeling pipelines, privacy-preserving techniques, data versioning
Salary (US)
Mid: $130–190K · Senior: $175–260K+
Salary (India)
Mid: ₹15–28 LPA · Senior: ₹28–50+ LPA
Hiring Companies
Data-heavy enterprises, fintech, healthcare, e-commerce, AI startups
Job Availability
🟢 High — every AI project needs data infrastructure
Entry Requirements
Bachelor's in CS/data engineering. 2–3 years data engineering experience. Spark, Airflow, SQL proficiency. AI data pipeline experience preferred.
Career Progression
→ Senior Data Engineer · → Data Platform Lead · → AI Architect · → Chief Data Officer
Related Roles
Data Scientist, ML Engineer, AI Data Governance Manager
Key Differentiator
Data-pipeline-first — focuses on making data AI-ready, not building models. Traditional data engineering + AI-specific pipelines (embeddings, synthetic data).
17. NLP Engineer 🟡
Field
Details
Stack Layer
Layer 4 (Fine-tuning & Evaluation)
What You Do
Build language understanding systems. In 2026, overlaps heavily with LLM engineering but retains classical NLP specialization.
Key Responsibilities
Named entity recognition, sentiment analysis, text classification, tokenization, multilingual NLP, fine-tuning language models
Must-Have Skills
Python, PyTorch, Hugging Face, spaCy/NLTK, tokenization, embeddings, fine-tuning
Nice-to-Have
Multilingual models, classical NLP metrics (BLEU, ROUGE), speech processing, knowledge graphs
Salary (US)
Mid: $130–200K · Senior: $180–280K+
Salary (India)
Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
Google, Amazon, Apple, Microsoft, enterprise AI, healthcare/legal AI
Job Availability
🟡 Medium — merging with LLM/GenAI Eng at many companies
Entry Requirements
Master's preferred. 2–4 years NLP experience. Deep understanding of linguistics and language models.
Career Progression
→ LLM Engineer · → GenAI Engineer · → AI Research Scientist (NLP) · → NLP Team Lead
Related Roles
LLM Engineer, GenAI Engineer, Conversational AI Engineer
Key Differentiator
Language-specialist — classical NLP (NER, sentiment, tokenization) + modern LLMs. Distinct from GenAI Eng in its linguistic depth.
18. Computer Vision Engineer 🟡
Field
Details
Stack Layer
Layer 4 (Fine-tuning & Evaluation)
What You Do
Design algorithms for machines to "see" — image classification, object detection, video analysis, 3D vision.
Key Responsibilities
Image/video classification, object detection, segmentation, OCR, 3D vision, model optimization for edge devices
Must-Have Skills
Python, PyTorch, CNNs, Vision Transformers (ViT), OpenCV, transfer learning
Nice-to-Have
YOLO/DETR, 3D vision, edge deployment (TensorRT, ONNX), multimodal models, medical imaging
Salary (US)
Mid: $137–200K · Senior: $200–350K+ · Top 1%: $579K+
Salary (India)
Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
Tesla, NVIDIA, Apple, Google, Meta, medical imaging companies, autonomous vehicle companies
Job Availability
🟡 Medium — specialized but stable demand
Entry Requirements
Master's preferred. 2–4 years CV experience. Strong math + deep learning fundamentals. Published research helpful.
Career Progression
→ Senior CV Engineer · → CV Team Lead · → AI Research Scientist (Vision) · → VP Engineering (Perception)
Related Roles
ML Engineer, Deep Learning Engineer, AI Research Scientist
Key Differentiator
Vision-specialist — completely distinct skill set (CNNs, OpenCV, 3D) from NLP/GenAI roles.
19. Data Scientist (GenAI-Augmented) 🟢
Field
Details
Stack Layer
Layer 4 (Fine-tuning & Evaluation)
What You Do
Classical data science + GenAI. Build predictive models, leverage LLMs for analysis, use RAG for data insights. The role is evolving from manual analysis to designing intelligent systems.
Key Responsibilities
Predictive modeling, statistical analysis, LLM-augmented insights, RAG for internal data, experiment design, business strategy through AI
Must-Have Skills
Python, R/SQL, statistics (Bayesian, regression), scikit-learn, PyTorch, LLM APIs, RAG, data visualization
Nice-to-Have
LangChain/LlamaIndex, vector DBs, causal inference, A/B testing, Spark, cloud ML services
Salary (US)
Entry: $95–130K · Mid: $130–200K · Senior: $180–280K+
Salary (India)
Entry: ₹6–14 LPA · Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Every company with data — finance, healthcare, e-commerce, tech
Job Availability
🟢 Very High — one of the most common AI-adjacent roles
Entry Requirements
Bachelor's (Master's preferred). Strong statistics + programming. 1–2 years data analysis experience.
Career Progression
→ Senior Data Scientist · → ML Engineer · → AI PM · → Head of Data Science · → Chief Analytics Officer
Related Roles
ML Engineer, AI Data Engineer, AI Consultant
Key Differentiator
Statistics + business insight focus — answers "what should we do?" vs engineers who build "how to do it." GenAI augments but doesn't replace core stats skills.
20. AI Safety / Red Team Engineer 🔴
Field
Details
Stack Layer
Cross-cutting (all layers)
What You Do
Adversarially test AI for vulnerabilities. The "white hat hacker" of AI — find prompt injections, jailbreaks, data leaks, and bias before bad actors do.
Key Responsibilities
Adversarial testing, prompt injection attacks, jailbreak research, bias auditing, guardrail design, evaluation pipeline design
Must-Have Skills
Python, adversarial ML, prompt injection techniques, OWASP LLM Top 10, evaluation pipeline design
Nice-to-Have
Pentesting (Burp Suite, Metasploit), RLHF/alignment, agent security, purple teaming
Salary (US)
Mid: $160–220K · Senior: $200–300K+
Salary (India)
Mid: ₹20–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Anthropic, OpenAI, Google DeepMind, Microsoft, government agencies
Job Availability
🔴 Niche — few openings but growing with AI regulation
Entry Requirements
Master's preferred. 3–5 years in security/ML. Published adversarial research helpful. Unique blend of security + AI expertise.
Career Progression
→ AI Security Lead · → Head of AI Safety · → AI Ethics & Governance Lead · → Chief Trust Officer
Related Roles
AI Ethics Lead, ML Engineer, AI Research Scientist
Key Differentiator
Security-focused — adversarial mindset applied to AI. Distinct from AI Ethics (which is policy/governance) — this is technical attack/defense.
21. AI Trainer / RLHF Data Annotator 🟢
Field
Details
Stack Layer
Layer 4 (Fine-tuning & Evaluation)
What You Do
Train and evaluate AI models through human feedback. Create RLHF/DPO training data, assess model outputs for quality, safety, and factual accuracy. The human-in-the-loop for alignment.
Key Responsibilities
Response ranking, preference labeling, red-teaming prompts, model output evaluation, annotation guideline creation, quality assurance for training data
Must-Have Skills
Strong language skills, critical thinking, attention to detail, understanding of AI model behavior, basic prompt engineering
Nice-to-Have
RLHF/DPO theory, domain expertise (coding, math, science), Python, evaluation frameworks
Salary (US)
Entry: $45–75K · Mid: $75–120K · Senior/Lead: $120–180K+
Salary (India)
Entry: ₹3–8 LPA · Mid: ₹8–15 LPA · Senior: ₹15–30+ LPA
Hiring Companies
Scale AI, Surge AI, Outlier, Anthropic, OpenAI, Google, Cohere, Labelbox
Job Availability
🟢 Very High — LinkedIn's 2026 "Jobs on the Rise" list; massive scaling need for alignment
Entry Requirements
No degree strictly required. Strong analytical skills + domain expertise (coding, writing, math, science). Lowest barrier entry into AI. 1–3 months training.
Career Progression
→ Annotation Team Lead · → AI Quality Manager · → AI Ethics Specialist · → Prompt Engineer
Related Roles
Prompt Engineer, AI Ethics Lead, Data Scientist
Key Differentiator
Human feedback role — not engineering. Evaluates AI outputs and creates training data. Lowest technical barrier but critical for model quality.
Layer 3 — Inference & Serving (3 Roles)
22. MLOps / LLMOps Engineer 🟢
Field
Details
Stack Layer
Layer 3 (Inference & Serving)
What You Do
Ensure AI/LLM systems run reliably in production. Deployment, monitoring, cost optimization, guardrails, and incident response.
Key Responsibilities
Model deployment, CI/CD for ML, monitoring & observability (LangSmith, Arize Phoenix), prompt versioning, guardrails, cost controls, scaling
Must-Have Skills
Docker, Kubernetes, CI/CD, cloud platforms (AWS/GCP/Azure), monitoring tools, Python, API development (FastAPI)
Nice-to-Have
LLM evaluation strategies, RAG system monitoring, semantic caching, A/B testing for models, Terraform/IaC
Salary (US)
Mid: $140–200K · Senior: $180–280K+
Salary (India)
Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
Cloud providers, SaaS companies, ML-heavy enterprises, AI startups
Job Availability
🟢 Very High — every production AI team needs MLOps
Entry Requirements
Bachelor's in CS/SE. 2–4 years DevOps/SRE/backend experience. Docker + K8s hands-on required. Cloud certs valued.
Career Progression
→ Senior MLOps · → ML Platform Lead · → AI Infrastructure Engineer · → VP Engineering (Platform)
Related Roles
ML Engineer, AI Infrastructure Engineer, DevOps Engineer
Key Differentiator
Ops-focused — keeps AI running in production. DevOps skills applied to ML/LLM systems. Distinct from ML Eng (who builds models) and AI Infra (who builds the platform).
23. ML Engineer (Highest Job Volume) 🟢
Field
Details
Stack Layer
Layer 3 (Inference & Serving)
What You Do
Design, build, train, deploy, and maintain ML systems in production. Bridge between data science and software engineering. Most established AI role.
Key Responsibilities
Model development (training, tuning), data pipeline design, MLOps (versioning, monitoring, CI/CD), scaling models for millions of users, A/B testing
Must-Have Skills
Python, PyTorch/TensorFlow, scikit-learn, SQL, data structures & algorithms, cloud (AWS SageMaker/GCP Vertex AI/Azure ML), Git, Docker
Nice-to-Have
GenAI/LLM fine-tuning, Spark, Kubernetes, C++, CUDA, feature stores, experiment tracking (MLflow, W&B)
Salary (US)
Entry: $96–132K · Mid: $149–200K · Senior: $175–240K · FAANG TC: $320–550K
Salary (India)
Entry: ₹8–15 LPA · Mid: ₹20–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Every tech company, FAANG, finance, healthcare, autonomous vehicles
Job Availability
🟢 Very High — 31% projected growth through 2030. 3.2:1 demand-to-supply ratio
Entry Requirements
Bachelor's (Master's preferred for top companies). 2–4 years. Strong DSA + ML fundamentals. LeetCode preparation needed.
Career Progression
→ Senior ML Eng · → Staff ML Eng · → Principal Eng · → ML Platform Lead · → VP Engineering
Related Roles
AI Engineer, Data Scientist, MLOps Engineer
Key Differentiator
Model-training + production focus — trains models from data (vs AI Eng who integrates pre-trained models). Most established and well-defined AI engineering role.
24. Inference Optimization Engineer 🔴
Field
Details
Stack Layer
Layer 3 (Inference & Serving) — deepest engineering
What You Do
Maximize throughput, minimize latency, cut cost of LLM inference. Most technically deep engineering role in the AI stack.
Key Responsibilities
Quantization, KV-cache optimization, kernel fusion, batching strategies, model serving architecture, cost-per-token optimization
Must-Have Skills
Python, C/C++, CUDA, PyTorch internals, vLLM, TensorRT, ONNX Runtime, Triton Inference Server
Nice-to-Have
GPU profiling (Nsight), custom CUDA kernels, FlashAttention internals, speculative decoding, hardware-aware optimization
Salary (US)
Mid: $167–209K · Senior: $200–350K+ · NVIDIA: $287K+
Salary (India)
Mid: ₹25–45 LPA · Senior: ₹45–80+ LPA
Hiring Companies
NVIDIA, Anyscale, Together AI, Fireworks AI, Modal, Groq
Job Availability
🔴 Niche — few openings but extremely high pay
Entry Requirements
Master's/PhD preferred. 3–5 years systems programming. Deep CUDA + C++ expertise required. Published optimization research valued.
Career Progression
→ Staff Inference Eng · → AI Compiler Engineer · → Principal Systems Engineer · → VP Engineering (Inference)
Related Roles
AI Compiler/Kernel Engineer, ML Engineer, Foundation Model Engineer
Key Differentiator
Performance-obsessed — measures everything in tokens/second and $/million-tokens. Requires systems programming (C++, CUDA) that most AI roles don't.
Layer 2 — Foundation Model (3 Roles)
25. Foundation Model / Pre-Training Engineer ⚫
Field
Details
Stack Layer
Layer 2 (Foundation Model)
What You Do
Train and build large foundation models from scratch. Design model architectures, manage distributed training across thousands of GPUs.
Key Responsibilities
Pre-training at scale, architecture design (transformers, MoE), distributed training (FSDP, DeepSpeed), data curation for pre-training, scaling laws
Must-Have Skills
PyTorch internals, C++, CUDA, distributed computing, transformer architectures, training infrastructure
Nice-to-Have
JAX/Flax (DeepMind), custom optimizer design, model parallelism strategies, hardware co-design
Salary (US)
Mid: $160–250K · Senior: $250–400K+ · Staff at frontier: $600K–$943K TC
Salary (India)
Mid: ₹25–45 LPA · Senior: ₹50–80+ LPA
Hiring Companies
OpenAI, Google DeepMind, Anthropic, Meta FAIR, xAI, Mistral, Cohere
Job Availability
🔴 Very Few — only frontier labs and well-funded startups
Entry Requirements
Master's/PhD required. 3–5+ years ML research. Published papers. CUDA + distributed training expertise.
Career Progression
→ Staff Research Engineer · → Research Lead · → Chief Scientist · → VP Research
Related Roles
AI Research Scientist, Inference Optimization Eng, AI Compiler Eng
Key Differentiator
Trains models from scratch — vs LLM Eng (fine-tunes existing models). Requires distributed systems + hardware-level optimization.
26. AI Research Scientist ⚫
Field
Details
Stack Layer
Layer 2 (Foundation Model)
What You Do
Push the boundaries of AI. Design new architectures, discover novel training methods, publish papers, define the future of the field.
Key Responsibilities
Research design, paper writing, experiment design, novel architecture exploration, benchmark creation, peer review
Must-Have Skills
Deep mathematics (optimization, probability, linear algebra), PyTorch, experiment design, scientific writing
Nice-to-Have
JAX, C++, CUDA, distributed training, specific domain expertise (NLP, vision, RL, alignment)
Salary (US)
Entry/postdoc: $115K · Mid: $160–260K · Senior: $220–400K+ · Top: $600K–$943K TC
Salary (India)
Research fellow: ₹15–30 LPA · Senior: ₹30–50 LPA · MNC labs: ₹40–80+ LPA
Hiring Companies
OpenAI, Google DeepMind, Anthropic, Meta FAIR, Microsoft Research, university labs
Job Availability
🔴 Niche — highly competitive, few positions globally
Entry Requirements
PhD strongly preferred. 3+ years research experience. Published papers at top venues (NeurIPS, ICML, ICLR, ACL).
Career Progression
→ Senior Research Scientist · → Research Lead · → Chief Scientist · → VP Research · → Lab Director
Related Roles
Applied AI Scientist, Foundation Model Engineer
Key Differentiator
Research-first — publishes papers, advances the field. Does not primarily build products (vs Applied Scientist who does).
27. Applied AI Scientist 🟡
Field
Details
Stack Layer
Layer 2–3 (Foundation / Inference)
What You Do
Apply cutting-edge research to solve real-world business problems. Bridge between research and production — the "practical researcher."
Key Responsibilities
Research-to-production pipeline, novel model adaptation, experiment design, prototype building, cross-team collaboration
Must-Have Skills
ML algorithms, PyTorch, experiment design, statistical analysis, software engineering, communication
Nice-to-Have
GenAI/LLM expertise, domain specialization, distributed systems, paper writing
Salary (US)
Mid: $150–220K · Senior: $200–400K+
Salary (India)
Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies
Amazon, Apple, Microsoft, Google, Meta, Netflix, Spotify, finance/healthcare AI
Job Availability
🟡 Medium — many listings at FAANG and large enterprises
Entry Requirements
Master's/PhD. 2–5 years combining research + production engineering. Published research helpful but not required.
Career Progression
→ Senior Applied Scientist · → Principal Scientist · → AI Research Scientist · → Head of Applied AI
Related Roles
AI Research Scientist, ML Engineer, Data Scientist
Key Differentiator
Research + production — same rigor as Research Scientist but focused on shipping products, not publishing papers. Amazon's signature AI role.
Layer 1 — Infrastructure & Hardware (2 Roles)
Field
Details
Stack Layer
Layer 1 (Infrastructure)
What You Do
Build the platform that all ML/AI teams run on. Design compute clusters, training infrastructure, model registries, and serving systems.
Key Responsibilities
GPU cluster management, training infrastructure, model registry, serving platform, cost optimization, developer experience
Must-Have Skills
Kubernetes (advanced), distributed systems, Docker, cloud (AWS/GCP), Python, Go/Rust, networking
Nice-to-Have
GPU scheduling, custom K8s operators, Ray, multi-cloud, NVIDIA NCCL, InfiniBand
Salary (US)
Mid: $140–220K · Senior: $192–320K+
Salary (India)
Mid: ₹20–40 LPA · Senior: ₹40–70+ LPA
Hiring Companies
Google, Meta, Microsoft, NVIDIA, Anyscale, Modal, cloud providers
Job Availability
🔴 Niche — specialized infrastructure role
Entry Requirements
Bachelor's + 4–6 years systems/infrastructure engineering. Deep K8s + cloud expertise. No ML knowledge required — this is systems engineering.
Career Progression
→ Staff Platform Eng · → Principal Eng · → VP Infrastructure · → CTO
Related Roles
MLOps Engineer, DevOps Engineer, Cloud Platform Engineer
Key Differentiator
Platform-builder — builds the infrastructure all ML teams use. Pure systems engineering, no model development.
29. AI Compiler / Kernel Engineer ⚫
Field
Details
Stack Layer
Layer 1 (Infrastructure) — most specialized
What You Do
Write compiler passes and GPU kernels for AI workloads. The most technically elite role in the entire AI stack.
Key Responsibilities
Custom CUDA kernels, compiler optimization (XLA, Triton, TVM), hardware-specific optimization, operator fusion, memory optimization
Must-Have Skills
C++, CUDA, compiler design, GPU architecture, low-level systems programming, linear algebra
Nice-to-Have
MLIR, Triton compiler, custom hardware (TPU, Gaudi), hardware simulation, assembly
Salary (US)
$250K–$400K+ (one of the highest-paid AI roles)
Salary (India)
₹45–80+ LPA
Hiring Companies
NVIDIA, Google (TPU), AMD, Intel, Cerebras, Groq, Tenstorrent
Job Availability
🔴 Ultra-Niche — very few openings worldwide, extreme specialization
Entry Requirements
Master's/PhD in CS/EE. 5+ years systems programming. Compiler design + CUDA expertise mandatory.
Career Progression
→ Staff Compiler Eng · → Distinguished Engineer · → VP Hardware/Software Co-design · → CTO at AI chip company
Related Roles
Inference Optimization Engineer, AI Infrastructure Engineer
Key Differentiator
Lowest-level AI role — writes the code that runs on the GPU . Requires compiler + hardware expertise that no other AI role needs.
Cross-cutting (2 Roles)
30. AI Ethics & Governance Lead 🟡
Field
Details
Stack Layer
Cross-cutting (all layers)
What You Do
Ensure AI systems are fair, transparent, and compliant. Build governance frameworks, audit for bias, navigate regulations (EU AI Act, NIST AI RMF).
Key Responsibilities
AI policy development, bias auditing, regulatory compliance, responsible AI frameworks, stakeholder education, model documentation
Must-Have Skills
AI/ML understanding, regulatory knowledge (EU AI Act, NIST), risk assessment, policy writing, bias metrics
Nice-to-Have
Python for auditing, fairness tools (Aequitas, IBM AI Fairness 360), law degree, public policy experience
Salary (US)
Mid: $140–200K · Senior: $180–280K+
Salary (India)
Mid: ₹18–35 LPA · Senior: ₹35–60+ LPA
Hiring Companies
Google, Microsoft, Meta, government agencies, large enterprises, consulting firms
Job Availability
🟡 Medium — growing with EU AI Act enforcement and corporate AI governance mandates
Entry Requirements
Master's preferred (CS, law, or public policy). 3–5 years in AI governance, compliance, or related field. Blend of technical + policy expertise.
Career Progression
→ Head of Responsible AI · → Chief Ethics Officer · → VP Trust & Safety · → AI Policy Advisor
Related Roles
AI Safety/Red Team Eng, AI Data Governance Manager, AI PM
Key Differentiator
Policy + governance focus — designs the rules AI systems must follow. Distinct from AI Safety (which is technical testing).
31. AI Data Governance Manager 🟡
Field
Details
Stack Layer
Cross-cutting (all layers)
What You Do
Ensure data used in AI systems is compliant, high-quality, and ethically sourced. Bridge between data engineering, legal, and AI teams.
Key Responsibilities
Data compliance (GDPR, CCPA), training data audits, data lineage documentation, privacy impact assessments, vendor data agreements
Must-Have Skills
Data governance frameworks, regulatory knowledge, data quality tools, SQL, communication
Nice-to-Have
Privacy-enhancing technologies, synthetic data strategies, AI model documentation, legal background
Salary (US)
Mid: $130–190K · Senior: $170–260K+
Salary (India)
Mid: ₹15–30 LPA · Senior: ₹30–55+ LPA
Hiring Companies
Regulated industries (finance, healthcare), large enterprises, government
Job Availability
🟡 Medium — growing with data regulation enforcement
Entry Requirements
Bachelor's + 3–5 years data governance/compliance experience. Understanding of AI/ML data pipelines. Legal knowledge valued.
Career Progression
→ Head of Data Governance · → Chief Data Officer · → VP Compliance · → AI Ethics Lead
Related Roles
AI Ethics Lead, AI Data Engineer, Data Scientist
Key Differentiator
Data-compliance focus — ensures the data AI uses is legal, ethical, and high-quality. Not a technical AI role — governance and compliance.
★ Roles by Entry Difficulty
Difficulty
Roles
Typical Background
🟢 Accessible (0–1 yr)
AI Trainer, Prompt Engineer, AI Technical Writer/DevRel, AI Sales Engineer
Any field + self-study + portfolio
🟡 Moderate (1–3 yr)
AI Integration Eng, Full-Stack AI Eng, AI Consultant, GenAI Eng, AI Eng, RAG Eng, Agentic AI Eng, Data Scientist, AI Data Eng, AI Data Governance Mgr
CS degree + SWE experience + AI projects
🔴 Advanced (3–5 yr)
LLM Eng, MLOps Eng, ML Eng, NLP Eng, CV Eng, AI Architect, AI PM, AI Ethics Lead, AI DevTools Eng, Conversational AI Eng, AI Safety Eng
CS degree + domain experience + advanced skills
⚫ Elite (5+ yr / PhD)
Inference Optimization Eng, Foundation Model Eng, AI Research Scientist, Applied Scientist, AI Infra/Platform Eng, AI Compiler/Kernel Eng
PhD or 5+ yrs + cutting-edge expertise + publications
★ Career Pathways
DEPTH TRACK (specialization):
GenAI Engineer → LLM Engineer → Foundation Model Engineer → Research Scientist
BREADTH TRACK (architecture):
AI Engineer → AI Solutions Architect → Chief AI Officer
PRODUCT TRACK (business + AI):
AI Engineer / Data Scientist → AI Product Manager → VP Product → CPO
CONTENT TRACK (education + advocacy):
AI Engineer → AI Technical Writer/DevRel → Head of DevRel → AI Educator
BUSINESS TRACK (customer-facing):
AI Integration Engineer → AI Consultant → AI Sales Engineer → Practice Lead
RESEARCH TRACK (academic → industry):
PhD → Applied Scientist → Research Scientist → Chief Scientist → Lab Director
STARTUP TRACK (entrepreneurial):
Any L5-6 role → Founding AI Engineer at startup → CTO → CEO
CAREER LADDER (seniority progression):
Junior (0-2 yr) → Mid (2-4 yr) → Senior (4-7 yr) → Staff (7-10 yr)
→ Principal (10+ yr) → Distinguished / Fellow
★ Skills × Roles Matrix
Skill Cluster
Most Important For
Why It Matters
Application engineering
Full-Stack AI Engineer, AI Integration Engineer, AI Engineer
Shipping useful AI features still depends on APIs, backend reliability, UX, and product integration.
Orchestration and agents
AI Engineer, GenAI Engineer, Agentic AI Engineer, RAG Engineer
Many modern GenAI roles are about combining models, retrieval, tools, and workflows instead of training models from scratch.
Evaluation and safety
LLM Engineer, RAG Engineer, AI Safety / Red Team Engineer, MLOps / LLMOps Engineer
Weak evaluation is one of the fastest ways to ship unreliable, unsafe, or expensive systems.
Production systems
ML Engineer, MLOps / LLMOps Engineer, Inference Optimization Engineer, AI Infra / Platform Engineer
Real-world AI systems fail on latency, observability, cost, and deployment complexity long before they fail on theory.
Research depth
Foundation Model Engineer, Applied AI Scientist, AI Research Scientist
These roles demand deeper command of transformers, optimization, experimental design, and paper-level reasoning.
Governance and policy
AI Ethics & Governance Lead, AI Data Governance Manager, AI Consultant / Strategist
In regulated or high-risk environments, governance, compliance, and stakeholder communication are as important as the model itself.
★ Interview Preparation Map
Technical Round 1: AI/ML Fundamentals (L4-L2 roles)
Topics: Transformer architecture, attention mechanisms, tokenization, fine-tuning
techniques (LoRA, QLoRA, DPO), RAG, embeddings, evaluation metrics
Technical Round 2: System Design (L3-L5 roles)
Topics: "Design a RAG system for 10M documents", "Design an AI agent platform",
"Design a model serving system for 1000 QPS", cost optimization, latency SLOs
Technical Round 3: Coding / DSA (All engineering roles)
Topics: LeetCode medium-level, Python data structures, API design, ML pipeline coding
Note: Even GenAI roles at Google/Meta/Amazon require DSA interviews
Technical Round 4: Domain-Specific (specialized roles)
ML Engineer: model training pipeline design, feature engineering
MLOps: Kubernetes architecture, CI/CD for ML, monitoring setup
Inference Opt: CUDA programming, quantization, kernel optimization
CV Engineer: CNN architectures, object detection, edge deployment
NLP Engineer: tokenization, multilingual NLP, language model evaluation
Behavioral Round (ALL roles — eliminatory at FAANG)
Format: STAR method (Situation, Task, Action, Result)
Amazon: Leadership Principles (Customer Obsession, Bias for Action, Dive Deep)
Google: Googleyness (intellectual humility, collaboration, learning)
Meta: Move Fast, Be Bold, Focus on Impact
Common: "Tell me about a complex technical problem you solved"
"How do you handle disagreements with teammates?"
"Describe a project that failed and what you learned"
Take-Home Assignments (Common at startups + L5-6 roles)
L6 roles: Build a RAG chatbot / AI feature integration (48-72 hrs)
L5 roles: Multi-agent system / evaluation pipeline
L4 roles: Fine-tune a model on provided dataset + eval report
L3 roles: Deploy a model with monitoring + CI/CD
Portfolio review: GitHub, live demos, blog posts, open-source PRs
Ethics / Culture Round (cross-cutting)
Topics: Bias mitigation, guardrails, EU AI Act, responsible AI, red teaming, OWASP LLM Top 10
★ Job Search Keywords
LAYER 6: "AI integration engineer", "full-stack AI", "AI-powered app developer",
"AI product manager", "AI consultant", "AI solutions consultant",
"conversational AI", "AI chatbot developer", "developer advocate AI",
"AI technical writer", "AI sales engineer"
LAYER 5: "AI engineer", "GenAI engineer", "generative AI developer",
"LLM application developer", "prompt engineer", "AI architect",
"AI agent developer", "agentic AI", "AI developer tools"
LAYER 4: "LLM engineer", "RAG engineer", "NLP engineer", "AI data engineer",
"computer vision engineer", "data scientist GenAI", "AI safety",
"AI red team", "AI trainer", "RLHF", "data annotator AI"
LAYER 3: "MLOps engineer", "LLMOps", "ML engineer", "machine learning engineer",
"inference optimization", "model serving engineer"
LAYER 2: "foundation model engineer", "pre-training engineer",
"AI research scientist", "applied scientist", "research engineer ML"
LAYER 1: "ML platform engineer", "AI infrastructure", "CUDA engineer",
"AI compiler engineer", "GPU kernel engineer"
CROSS: "AI ethics", "responsible AI", "AI governance", "AI compliance",
"AI data governance"
★ Frontier Lab Requirements
To work at frontier labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR, xAI, Mistral):
RESEARCH ROLES (L2):
✅ PhD (or equivalent research output)
✅ Published papers at NeurIPS, ICML, ICLR, ACL, CVPR, or EMNLP
✅ Novel research contributions
✅ Deep math (optimization, probability, linear algebra)
✅ PyTorch + JAX (for DeepMind)
✅ Open-source contributions or reproduced papers
ENGINEERING ROLES (L3-L5):
✅ Strong software engineering (system design, APIs, distributed systems)
✅ Production ML experience (deployed models serving real traffic)
✅ Understanding of transformer architecture and training
✅ LeetCode-style coding (medium-hard level)
✅ Cloud + Docker + Kubernetes
✅ Open-source contributions (LangChain, vLLM, Hugging Face, etc.)
WHAT MAKES YOU STAND OUT:
→ Published technical blog posts or tutorials
→ Merged PRs in popular AI open-source projects
→ Novel research direction or technique
→ Production system serving millions of users
→ Founded/contributed to an AI startup
★ Target Companies by Tier
TIER 1 — FRONTIER LABS (highest pay, hardest to enter)
OpenAI, Anthropic, Google DeepMind, Meta FAIR, Microsoft Research,
Mistral AI, xAI, Cohere, AI21 Labs
TIER 2 — BIG TECH AI TEAMS (high pay, production focus)
Google (Gemini), Apple (ML), Amazon (Bedrock), Microsoft (Copilot),
NVIDIA, Salesforce (Einstein), Netflix, Uber, Airbnb AI teams
TIER 3 — AI-FIRST STARTUPS (equity upside, fast learning)
Anyscale, Together AI, Fireworks AI, Modal, Groq, Perplexity,
Hugging Face, LangChain Inc, Weights & Biases, Replit, Cursor,
Stability AI, Scale AI, Databricks, Runway, ElevenLabs, Character.ai
TIER 4 — ENTERPRISES BUILDING AI (volume of jobs)
Deloitte, Accenture, McKinsey (AI), Goldman Sachs,
JPMorgan, Walmart, any Fortune 500 AI team
TIER 5 — AI CONSULTING & SERVICES (accessible entry)
TCS, Infosys, Wipro (AI practices), Fractal Analytics,
Tiger Analytics, Mu Sigma, LatentView
INDIA-SPECIFIC AI COMPANIES:
AI-Native: Sarvam AI (sovereign LLM), Ola Krutrim, Neysa (AI cloud),
AI4Bharat (IIT Madras), Qure.ai (health), TWO AI, BharatGen
Product Cos: Flipkart AI, PhonePe ML, Swiggy ML, Zomato AI,
Razorpay AI, CRED AI, Reliance Jio AI
Services: Fractal Analytics, LatentView, Tiger Analytics, Mu Sigma
MNC India Labs: Microsoft IDC (Hyderabad), Google India (Bangalore),
Amazon India ML, Walmart Labs India, NVIDIA India, Apple India ML
Research Labs: IIT Madras (Robert Bosch Center), IIIT Hyderabad,
Microsoft Research India, Intel AI Lab (IIT Hyderabad), Wipro-IISc
INDIA JOB PLATFORMS:
Naukri.com, Instahyre, CutShort, LinkedIn India, AngelList India,
Hirect, iimjobs.com (PM roles), Wellfound India
INDIA SALARY CONTEXT:
→ Service cos (TCS/Infosys/Wipro): ₹5-15 LPA for AI roles
→ Product cos (Flipkart/PhonePe/CRED): ₹12-40 LPA
→ MNC India labs (Google/Microsoft/Amazon): ₹15-60+ LPA
→ Bangalore/Hyderabad pay 30-50% above other cities
→ Remote US-company roles: ₹40-80 LPA (growing trend)
→ IndiaAI Mission: ₹10,000 crore govt initiative providing
subsidized GPU access (~₹65/hr) to startups and researchers
★ Salary Table (All 31 Roles)
UNITED STATES ($K/yr) INDIA (₹ LPA)
Entry Mid Senior+ Entry Mid Senior+
──────────────────────────────────────────────────────────────────────────
LAYER 6 — APPLICATION:
Full-Stack AI Eng. 88 120-180 168-250+ 6-12 15-30 30-55+
AI Integration Eng. — 120-180 160-250+ — 12-25 25-50+
AI Sales Engineer — 120-180 160-250+ — 15-30 30-55+
AI Consultant/Strategist — 130-200 180-280+ — 15-35 35-65+
AI Product Manager — 150-220 200-300+ — 20-40 40-70+
Conversational AI Eng — 140-210 190-300+ — 18-35 35-60+
AI Tech Writer/DevRel — 110-170 150-220+ — 12-25 25-45+
──────────────────────────────────────────────────────────────────────────
LAYER 5 — ORCHESTRATION:
AI Engineer 100 140-211 195-350+ 5-12 18-32 35-60+
GenAI Engineer 120 180-250 220-350+ 8-15 25-45 50-80+
Agentic AI Engineer — 170-250 220-350+ — 25-45 45-75+
Prompt Engineer 80 120-180 160-250 5-10 15-30 30-50+
AI Solutions Architect — 160-230 200-320+ — 25-45 45-75+
AI DevTools Engineer — 150-220 200-300+ — 20-40 40-70+
──────────────────────────────────────────────────────────────────────────
LAYER 4 — FINE-TUNING:
LLM Engineer — 180-260 240-400+ — 20-40 40-70+
RAG Engineer — 150-220 200-300+ — 18-35 35-60+
AI Data Engineer — 130-190 175-260+ — 15-28 28-50+
NLP Engineer — 130-200 180-280+ — 15-30 30-55+
Computer Vision Eng. — 137-200 200-350+ — 15-30 30-55+
Data Scientist (GenAI) 95 130-200 180-280+ 6-14 18-35 35-60+
AI Safety/Red Team — 160-220 200-300+ — 20-35 35-60+
AI Trainer/RLHF 45 75-120 120-180+ 3-8 8-15 15-30+
──────────────────────────────────────────────────────────────────────────
LAYER 3 — INFERENCE:
MLOps/LLMOps Eng. — 140-200 180-280+ — 15-30 30-55+
ML Engineer 96 149-200 175-240+ 8-15 20-35 35-60+
Inference Opt Eng. — 167-209 200-350+ — 25-45 45-80+
──────────────────────────────────────────────────────────────────────────
LAYER 2 — FOUNDATION:
Foundation Model Eng. — 160-250 250-400+ — 25-45 50-80+
Applied Scientist — 150-220 200-400+ — 20-40 40-70+
AI Research Scientist 115 160-260 220-400+ — 30-50 40-80+
──────────────────────────────────────────────────────────────────────────
LAYER 1 — INFRASTRUCTURE:
AI Infra/Platform Eng. — 140-220 192-320+ — 20-40 40-70+
AI Compiler/Kernel Eng. — — 250-400+ — — 45-80+
──────────────────────────────────────────────────────────────────────────
CROSS-CUTTING:
AI Ethics/Governance — 140-200 180-280+ — 18-35 35-60+
AI Data Governance Mgr. — 130-190 170-260+ — 15-30 30-55+
FAANG Senior TC (total comp with equity): $320-550K+
Staff/Principal at frontier labs: up to $943K (outlier)
GenAI premium: +40-60% over traditional ML salaries
India: Service cos pay 40-60% less than product cos for same role
★ Certification Roadmap
Certification
Applicable Roles
Priority
Notes
AWS ML Engineer – Associate (MLA-C01)
ML Eng, MLOps, AI Architect, AI Data Eng
🔴 High
Replaces retired AWS ML Specialty
AWS Generative AI Developer – Professional (AIP-C01)
GenAI Eng, AI Eng, RAG Eng, LLM Eng
🔴 High
Covers RAG, Bedrock, prompt eng
GCP Professional ML Engineer
ML Eng, MLOps, GenAI Eng
🔴 High
Google Cloud GenAI (Professional)
GenAI Eng, AI Eng, Prompt Eng
🔴 High
Directly relevant for GenAI roles
Azure AI Engineer Associate (AI-102)
AI Integration Eng, Full-Stack AI, AI Consultant
🟡 Medium
Microsoft-heavy enterprises
DeepLearning.AI Short Courses
All GenAI roles
🟡 Medium
LangChain, LlamaIndex, RAG courses
Kubernetes (CKA/CKAD)
MLOps, AI Infra, Inference Opt
🟡 Medium
NVIDIA NCP-AAI (Agentic AI)
Agentic AI Eng, AI Eng, GenAI Eng
🟡 Medium
Professional agentic AI cert (2026)
NVIDIA Deep Learning Institute (DLI)
Inference Opt, Foundation Model, AI Compiler
🟡 Medium
GPU-specific training
Google AI Professional Certificate
All non-coding roles
🟢 Nice-to-have
Practical AI skills for non-coders
AWS AI Practitioner (AIF-C01)
AI PM, AI Consultant, AI Sales Eng
🟢 Nice-to-have
Entry-level; non-engineering roles
Note : Certifications matter most for Tier 4-5 companies (enterprises, consulting). Frontier labs (Tier 1-2) care more about projects, papers, and open-source contributions . DeepLearning.AI short courses are often more valued than formal certs for GenAI-specific roles.
★ Portfolio Project Ideas
Project
Target Roles
Layer
Differentiation Tip
RAG system for legal contract analysis with citation verification, hybrid search, RAGAS eval
RAG Eng, GenAI Eng, AI Integration Eng
L4-5
Domain-specific RAG with evaluation > generic "RAG chatbot"
Multi-agent code review system (LangGraph) analyzing PRs across repos
Agentic AI Eng, AI Eng, GenAI Eng
L5
Real utility > toy agents; add observability + cost tracking
Fine-tuned medical NER model (Unsloth/LoRA) with eval dashboard
LLM Eng, NLP Eng, Data Scientist
L4
Domain-specific + evaluation pipeline shows production thinking
AI-powered web app (Next.js + LLM API + RAG + auth + deploy)
Full-Stack AI Eng, AI Integration Eng
L6
Must be deployed, not just local; add streaming + monitoring
LLM evaluation pipeline comparing 5+ models on custom benchmark
GenAI Eng, LLM Eng, AI Safety Eng
L4-5
Custom benchmarks > reporting others'
Prompt library + A/B testing framework with version control
Prompt Eng, AI Consultant
L5-6
Testing framework shows engineering rigor
Voice assistant with multi-turn memory (Whisper + LLM + TTS)
Conversational AI Eng
L6
Multi-turn context is the differentiator
MLOps pipeline (Docker + K8s + CI/CD) with canary deployment
MLOps Eng, ML Eng
L3
Canary deployment + monitoring shows production maturity
SDK/CLI tool for LLM API with caching, retry, streaming
AI DevTools Eng
L5
Ship as npm/pip package for real validation
Model inference benchmark (vLLM vs TensorRT vs ONNX) with cost analysis
Inference Opt Eng
L3
Cost-per-token alongside latency
Data pipeline (Airflow + embeddings at scale) with quality checks
AI Data Eng, Data Scientist
L4
Data quality monitoring differentiates
AI safety red-team report with reproducible attack PoCs
AI Safety Eng, AI Ethics
Cross
Reproducible PoCs > theoretical reports
Research paper reproduction with novel ablation + blog post
AI Research Scientist, Applied Scientist
L2
Own ablation results show research capability
Open-source contribution to LangChain, vLLM, or Hugging Face
All roles
All
Merged PRs = strongest hiring signal
AI tutorial series (blog or video) on GenAI topics
AI Tech Writer/DevRel, Prompt Eng
L5-6
Public content = instant portfolio
★ Sources
LinkedIn "Skills on the Rise 2026" and "Jobs on the Rise 2026" reports (AI Engineer #1)
Indeed, Glassdoor, Naukri job postings analysis (March 2026)
Levels.fyi, BuiltIn.com, Wellfound compensation data
OpenAI, Anthropic, Google DeepMind, Meta FAIR, AMD career pages (March 2026)
Gartner "40% enterprise apps embed agents by end 2026" prediction
NVIDIA, Anyscale, Together AI, Fireworks AI, Poolside AI job postings
Signify Technology ML Engineer salary report 2026
Vercel, Cursor, Replit AI DevTools team job descriptions
India AI Impact Summit 2026, IndiaAI Mission documentation
Sarvam AI, Neysa, Krutrim press releases and funding data
Tracxn, Crunchbase Indian AI startup data (March 2026)
AWS, Google Cloud, Azure, NVIDIA certification pages (March 2026)
a16z, NVIDIA, Sequoia Capital AI stack frameworks
Forbes, Coursera, Tredence GenAI career role guides (2025-2026)