Maths for GenAI · RL for LMs: policy gradient & PPO

Indian Institute of Technology Madras

BS Degree Programme · Examination & Study Paper

Mathematical Foundations of Generative AI

RL for LMs: policy gradient & PPO

Official Paper

Examination Instructions & Guidelines

Solve on notebook/paper first before checking solutions.
MCQ: Exactly 1 option is correct. Negative marking applies.
Scientific calculator allowed for all calculations.
Official answer key is sealed at the end of this sheet.

End Term · 31 Aug 2025 (FN)End Term

Q1MCQ5 Marks·Choose one option
Key ↓
1. A2.62
2. B2.00
3. C2.81
4. D1.90
Q2MCQ5 Marks·Choose one option
Key ↓
An AR-LM can be viewed as an MDP by
1. AState = token prefix, action = next token
2. BState = next token, action = prefix
3. CState = vocabulary, action = logits
4. DImpossible
Q3MCQ5 Marks·Choose one option
Asked 2 times Key ↓
1. A0.600
2. B0.750
3. C0.500
4. D0.300

End Term · 31 Aug 2025 (AN)End Term

Q4MCQ5 Marks·Choose one option
Key ↓
1. A
2. B
3. C
4. D
Q5MCQ5 Marks·Choose one option
Asked 2 times Key ↓
1. A−0.85
2. B−0.80
3. C−0.20
4. D−1.00
Q6MCQ5 Marks·Choose one option
Key ↓
1. A
2. B
3. C
4. D

Official Key

Master Answer Key & Explanations

Official answer keys from IIT Madras BS past papers. Click any question to review.