TensorTrack
Sign In
Section: LLM•ID #161

GELU Activation Function

Step 1: TheoryTheory Article

GELU Activation Function

Study the core concepts and background material for this learning item.

Step 2: PracticeDeep-ML Challenge

GELU Activation Exercise

Solve the challenges and apply your knowledge interactively.

Easy15 min estimated study

Overview

Implement GELU activation functions weighting inputs by normal probability thresholds.

Learning Objectives

  • Formulate Gaussian Error Linear Unit activation rules
  • Derive standard GELU backpropagation gradients

Prerequisites

Item #63Softplus Activation Function
Locked

Tracking Control

Completion Reward+150 XP
Study Checklist
Studied theory resource
Completed practice exercise