Indian Institute of Technology Madras
BS Degree Programme · Examination & Study Paper
Deep Learning
Gradient descent & optimizers
Examination Instructions & Guidelines
- Solve on notebook/paper first before checking solutions.
- MCQ: Exactly 1 option is correct. Negative marking applies.
- MSQ: One or more options correct. Select all to score.
- NAT: Numerical response. No negative marking.
- Scientific calculator allowed for all calculations.
- Official answer key is sealed at the end of this sheet.
Quiz 1 · 26 Oct 2025 (AN)Quiz 1
- Q1MCQ3 Marks·Choose one option

- AA → 0.01 , B → 0.001 , C → 1.0
- BA → 0.001 , B → 0.01 , C → 1.0
- CA → 1.0 , B → 0.001 , C → 0.01
- DA → 0.01 , B → 1.0 , C → 0.001
- Q2MCQ3 Marks·Choose one option
A data scientist is training a deep learning model on a massive dataset containing billions of data points. They find that using traditional Batch Gradient Descent (GD) is computationally infeasible. What is the primary reason that makes Batch GD impractical for this task, thus requiring an alternative like Stochastic Gradient Descent (SGD)?
- AIt is impossible to fit the entire large dataset into the computer’s memory (RAM) at once.
- BThe gradient calculated by Batch GD is often too noisy and inaccurate, leading to poor convergence.
- CBatch GD is guaranteed to get stuck in sharp local minima, whereas SGD can escape them.
- DBatch GD requires calculating the gradient of the loss function with respect to the parameters over the entire dataset for a single update, which is computationally very expensive.
- Q3MCQ3 Marks·Choose one option

- A

- B

- C

- D

- A
- Q4NAT4 Marks·Write the number
Your answer:
End Term · 31 Aug 2025 (FN)End Term
- Q5MSQ3 Marks·Choose all correct options

- A

- B

- C

- D

- E

- F

- A
End Term · 31 Aug 2025 (AN)End Term
- Q6MSQ2 Marks·Choose all correct options

- A

- B

- C

- D

- E

- A
Quiz 2 · 3 Aug 2025 (AN)Quiz 2
- Q7MSQ3 Marks·Choose all correct options
Which of the following optimizers use an adaptive learning rate?
- AADAM
- BRMSprop
- CMomentum based GD
- DNesterov accelerated gradient descent
End Term · 13 Apr 2025 (AN)End Term
Read the passage below, then answer Q8–Q10

Based on the above data, answer the given subquestions.
Q8MCQ2 Marks·Choose one optionWhich of these is the correct ordering among the learning rates?
- A

- B

- C

- D

- A
- Q9MCQ2 Marks·Choose one option

- A0.5
- B0.9
- C0.1
- D1
- Q10NAT2 Marks·Write the number
Your answer: