Gen AI and Agentic AI Interview Preparation Guide — Universal

I am sharing topics, which are a must read before any Gen AI and Agentic AI. So lets start.
Gen AI
- Deep Learning [ RNN, LSTM, Neural Network]
- Transformer Architecture [Self Attention(Q,K,V concept)]
- How does Temperature work at the core of transformer architecture?
- RAG [ Its not only you learn high level process like loading, parsing, chunking, embedding, retrieval, prompting and generation]. You need to deep dive in each and every component. Lets see below in sub pointers.
[Loading] Adding Authentication, Guardrails, Queue management, load balancer, async processing of documents/records from the source.
[Parsing] Which parser you are going to use and how are you going to parse different element of the document.
[Chunking] How do you decide chunking strategy? Which chunk technique you use and do you use same chunking technique for every element like tables, image, scanned pages, graphs, flowchart, text? Also prepare on choosing chunk size and overlap size.
[Embedding] How do we create index, which type of metadata we shall consider, how to implement RBAC, how many index we need to create based on use cases, which embedding model we need to select and what embedding dimension is ideal.
[Retrieval] How do you implement filter and RBAC in the retrieval? Do you know how HSNW (Vector Search works)? What is role of Recall and Precision in retrieval? When do we apply reranking, when we apply hybrid search? How to evaluate retrieved context? what is RRF? What is BM25? What is TF-IDF?
[Prompting] How do you define a good optimized prompt? Types of prompting, how do you ground your prompt?
[Generation] LLM, Parameter, structured output etc.
Agentic AI
- Agent — Types of agents, Reflection, Critic, planner, executor, ReAct, Supervisor, Tool Calling, Chain of Thought etc
- Orchestrator : Langgraph [ StateGraph, Memory Checkpointer, FAN Out, Fan In, parallel processing, Reducers, interrupt, Resume, graph.invoke(), Seesion, thread, Memory Management.
- Gemini ADK, Open AI SDK.
Evaluation
- How to evaluate Gen Ai/Agentic AI system pre production(offline), After deployment (Online)
- Evaluation of RAG, Deterministic LLM response.
- To evaluate Agents Lifecycle (Planning, trajectory, tool calling, RAG quality, iteration, fallback hits, guardrail hits etc)
- Structured output (
Observability
- Application telemetry
- Latency (Agents, Retriever, Tool communication, LLM response etc)
- Spans of each stage
- Input tokens, output tokens, Cost, etc.
Scenario Based
How to process millions of documents in scaled way?
How to ingest data with high scale?
How to implement RBAC based ingestion?
How to process PDF with different elements in it?
Create a chatbot for different types of doc stored in Vector DB, where millions of user does the query on it.
Python coding
- Reverse a string
- Fibonacci
- Sorting of list without sort function
- Frequency calculation in dictionary
- Palindrome numbers
- Finding of longest substring in a string
- Find the elements from the list whose sum/difference is equals to target
Deployment
- Docker/Kubernetes based deployment in any cloud.
- Service account, API Gateway, DB management, Memory management, CI/CD.
- Deployment through Dev, QA, Production
Project Explanation, Architecture of Project
Written by Ritesh Sinha
👋 Hi, I’m Ritesh Sinha Generative AI Engineer | AI Content Creator | Helping people decode the future of artificial intelligence.

0 Comments