Applied Deep Learning and Artificial Intelligence

M3 - Applied Deep Learning and Artificial Intelligence

Note: M3 - Final Assignment Deadline: Friday, 8 March 2024, 12:00 PM

This course provides a practical and applied introduction to deep learning, specifically tailored for economics students. It covers the fundamentals of deep learning, including foundational concepts, tensors, typical architectures, and applications in economics. The course will also delve into various training paradigms and tools prevalent in deep learning.

Initially, the course focuses on traditional neural network architectures such as ANNs, CNNs, RNNs, and LSTMs, exploring their utility in addressing economic challenges like forecasting. As the course progresses, students will delve into advanced topics like GNNs, Transformer models, and GPT models, with a focus on the attention mechanism and its role in enhancing model performance. Practical insights will be shared on tools within the GNN, Transformer, and GPT ecosystems, and their applications in real-world economic scenarios, particularly in patent research.

Real-world examples from economics will be used to illustrate the concepts and techniques taught throughout the course. By the end, students will have a robust understanding of deep learning and its applications in economics, having collaborated on four mini-projects to apply these concepts to real-world economic research scenarios, ultimately curating a portfolio to showcase their skills.

Content for this module

  • Part 1: Intro to Traditional Deep Learning (Wednesday 31st of Januray, 08.15-12.00)
  • Workshop 1: Intro to Traditional Deep Learning (Monday 5th of February, 14.00-17.45)
  • Part 2: Intro to Large Language Models - Transformer Models (Wednesday 7th of February, 08.15-12.00)
  • Workshop 2: Intro to Large Language Models - Transformer Models (Monday 12th of February, 14.00-16.45)
  • Part 3: Intro to Large Language Models - Generative Pre-Trained Models (Wednesday 14th of February, 08.15-12.00)
  • Workshop 3: Intro to Large Language Models - Generative Pre-Trained Models (Monday 26th of February, 14.00-16.45)
  • Part 4: Intro to Graph Neural Networks (Wednesday 28th of February, 09.15-12.00)