CS8004 Deep Learning

• Course curriculum is simple till midsem evaluation
• Learning curve scales up gradually, doable
• Last month is intensive, covers AutoEncoders, GAN's, Transformers and Vision Transformers
• Last Lecture was on Explainable AI, an interesting topic

Resources

• Khapra IITM Playlist (only part1, part2 was very vague) very extensive, can skip out certain parts
• Bryce Playlist{:target = "_blank"} condensed, quick
• cheatsheet{:target = "_blank"}

Other fun topics to explore

• Weight Initialization{:target = "_blank"}
• What even is tSNE
• PCA vs SVD
• Deep Dream{:target = "_blank"}
• Activation maps
• Positional Encoding for transformers{:target = "_blank"}
• Bilingual Evaluation Understudy (evaluation scheme for NLP tasks)
• Teacher Forcing

Other

• Dropout for CNN based architechtures KDnuggets{:target = "_blank"}, Blog by chlis{:target = "_blank"}