BTechibtechi.in
Loading Loading
Free IIT Madras BS notes, PYQs and mock tests at btechi.in

Deep Learning · Transformers & self-attention

13 questions · 22 marks · 3 papers

Answer key

Indian Institute of Technology Madras

BS Degree Programme · Examination & Study Paper

Deep Learning

Transformers & self-attention

Official Paper

Examination Instructions & Guidelines

Solve on notebook/paper first before checking solutions.
MCQ: Exactly 1 option is correct. Negative marking applies.
NAT: Numerical response. No negative marking.
Scientific calculator allowed for all calculations.
Official answer key is sealed at the end of this sheet.

End Term · 31 Aug 2025 (FN)End Term

Read the passage below, then answer Q1–Q3
Based on the above data, answer the given subquestions.
Q1NAT3 Marks·Write the number
Key ↓
Your answer:
Q2NAT3 Marks·Write the number
Key ↓
Your answer:
Q3NAT2 Marks·Write the number
Key ↓
Your answer:

End Term · 31 Aug 2025 (AN)End Term

Read the passage below, then answer Q4–Q6
Based on the above data, answer the given subquestions.
Q4NAT2 Marks·Write the number
Asked 2 times Key ↓
Your answer:
Q5NAT2 Marks·Write the number
Key ↓
Your answer:
Q6NAT1 Mark·Write the number
Key ↓
Your answer:

End Term · 13 Apr 2025 (AN)End Term

Q7MCQ3 Marks·Choose one option
Key ↓
In the transformer architecture, which of the following are true regarding cross attention in the decoder?
1. AThe query vectors come from the decoder stack, while the key and value vectors come from the encoder stack.
2. BThe query and value vectors come from the decoder stack, while the key vectors come from the encoder stack.
3. CThe query, key and value vectors come from the decoder stack.
4. DThe query, key and value vectors come from the encoder stack.
Read the passage below, then answer Q8–Q10
Consider the multi-head self-attention mechanism in the encoder of a transformer with 8 heads. The word embedding dimension is 32. In a given head, the query, key and value vectors have the same dimension and each of them is 4. The sequence length is 5.
Based on the above data, answer the given subquestions.
Q8MCQ1 Mark·Choose one option
Key ↓
In any given head, what is the dimension of the W_Q matrix?
1. A32 × 4
2. B32 × 32
3. C4 × 4
4. D32 × 8
5. E5 × 5
Q9MCQ1 Mark·Choose one option
Asked 2 times Key ↓
In any given head, what is the dimension of the query-key product matrix?
1. A5 × 5
2. B4 × 4
3. C8 × 8
4. D32 × 32
Q10NAT1 Mark·Write the number
Key ↓
Your answer:
Read the passage below, then answer Q11–Q13
Based on the above data, answer the given subquestions.
Q11MCQ1 Mark·Choose one option
Key ↓
1. A
2. B
3. C
4. D
Q12MCQ1 Mark·Choose one option
Key ↓
1. A
2. B
3. C
4. D
Q13MCQ1 Mark·Choose one option
Key ↓
Which of the following is true?
1. AThe mask matrix is added to the query-key product matrix before applying softmax.
2. BThe mask matrix is added to the query-key product matrix after applying softmax.
3. CThe mask matrix could be added either before or after the softmax.

Official Key

Master Answer Key & Explanations

Official answer keys from IIT Madras BS past papers. Click any question to review.

Reveal Key

Q110

Q21.52 to 1.6

Q33.95 to 4.03

Q4512

Q512288

Q633088

Q7A

Q8A

Q9A

Q1032

Q11A

Q12A

Q13A

Questions and answer keys are reproduced from the official IIT Madras BS papers. Topics and repeated question types are BTechi’s own grouping. BTechi is not affiliated with IIT Madras.