Out of context Meta-Learning in LLMs

This website contains experiments we did and the results we obtained while investigating the phenomena of out of context meta learning in LLMs through the lens of mechanistic interpretability.

Highlights

What is out of context meta-learning?

Ok so what is it and why is it?
Resolving confusion 1 WIP

Let's do some experiments to resolve some confusions
Resolving confusion 2 WIP

What is happening?
Resolving confusion 3 WIP

Why is happening?
Resolving confusion 4 WIP

When is happening?
Resolving confusion 5 WIP

How is happening?