Indian Institute of Technology Madras
BS Degree Programme · Examination & Study Paper
Mathematical Foundations of Generative AI
Transformers, attention & decoding
Official Paper
Examination Instructions & Guidelines
- Solve on notebook/paper first before checking solutions.
- MCQ: Exactly 1 option is correct. Negative marking applies.
- Scientific calculator allowed for all calculations.
- Official answer key is sealed at the end of this sheet.
End Term · 31 Aug 2025 (FN)End Term
- Q1MCQ5 Marks·Choose one option

- A0.6
- B0.5
- C0.67
- D0.75
- Q2MCQ5 Marks·Choose one option

- A≈ 1.670
- B1.500
- C2.000
- D≈ 1.333
- Q3MCQ5 Marks·Choose one option

- A768 × 768 = 589,824
- B768 × 64 = 49,152
- C64 × 64 = 4,096
- D12 × 64 = 768
- Q4MCQ5 Marks·Choose one option

- A(3,−1)
- B(2, 0)
- C(1,−1)
- D(0, 0)
End Term · 31 Aug 2025 (AN)End Term
- Q5MCQ5 Marks·Choose one option

- ASize = 4, prob ≈ 0.105
- BSize = 3, prob = 0
- CSize = 5, prob = 0.1
- DSize = 4, prob = 0.1
- Q6MCQ5 Marks·Choose one option

- A1,048,576 params
- B786,432 params
- C524,288 params
- D262,144 params
- Q7MCQ5 Marks·Choose one option

- A

- B

- C

- D

- A
- Q8MCQ5 Marks·Choose one option

- A

- B

- C

- D

- A