Skip to main content

University faculty member — Ph.D. in Artificial Intelligence and Robotics

اللّهُمَّ عَجِّلْ لِوَلِیِّکَ الْفَرَج

Interactive AI Lab

See important AI algorithms come alive and experiment with them: a genetic algorithm that evolves a solution to the N-Queens puzzle generation by generation, an algorithm that uncovers hidden groups in a social network, search algorithms that find their way out of a maze, and chess against an AI that thinks with adversarial search (minimax and alpha-beta) and shows you its thoughts. Everything runs in your browser.

Click a cell: empty → wall → trap

Run console q-learning.log
    Episode
    0
    Steps (last)
    —
    Reward (last)
    —
    Success (last 20)
    —

    How it works

    Nobody tells the agent where the goal is: it only gets a reward (+10 at the goal, −10 in a trap, a small cost for every step) and keeps, for every cell and move, an estimate Q of the total reward to come. After each move it nudges that estimate: Q(s,a) ← Q(s,a) + α[r + γ·max Q(s′) − Q(s,a)]. The goal's reward spreads back cell by cell, and the arrows come to point the way.

    ε is the explore-or-exploit dilemma: with ε = 0 the agent repeats what it knows and may never find a better way; with ε = 1 it only wanders. γ is patience: how much a reward later is worth now. AI course materials