Circuits in Transformer Language Models

Machine Learning

Reverse-engineering specific algorithms implemented by transformer models, such as induction heads, indirect object identification, and greater-than comparisons. Focuses on finding interpretable computational circuits within neural network activations.

1 active controversy

canopy

Lost in papers?

See the forest for the trees

Free Energy Principle and Active Inference

Neuroscience

Explores how biological systems minimize prediction error through active inference. Investigates the brain as a hierarchical generative model that actively samples the world to confirm predictions and minimize surprise.

1 active controversy

Emergent Abilities in Large Language Models

Machine Learning

Investigating capabilities that appear suddenly at specific model scales, including multi-step reasoning, instruction following, and few-shot learning. Questions whether these are genuine phase transitions or measurement artifacts.

1 active controversy

Surface Codes for Fault-Tolerant Quantum Computing

Quantum Computing

Implementation and optimization of surface code error correction schemes for stabilizing logical qubits. Focuses on achieving fault-tolerant quantum computation through topological codes with local check operators.

Lipid Nanoparticle Delivery Systems for mRNA

Biotechnology

Development of ionizable lipid nanoparticles (LNPs) that enable efficient cellular uptake and endosomal escape of mRNA therapeutics. Critical breakthrough enabling COVID-19 vaccines and next-generation gene therapies.

Modified Gravity as Dark Energy Alternative

Cosmology

Testing whether cosmic acceleration arises from modifications to general relativity rather than a cosmological constant. Includes f(R) gravity, galileons, and massive gravity theories with observational constraints from structure formation.

2 active controversies

Measuring Integrated Information in Neural Systems

Neuroscience

Developing practical methods to compute Φ (phi) from neural recordings and test Integrated Information Theory predictions. Addresses computational intractability through approximations and identifies empirical signatures of consciousness.

3 active controversies

AlphaFold and Protein Structure Prediction

Computational Biology

Deep learning approaches to predict protein 3D structure from sequence alone, achieving experimental accuracy. Explores attention mechanisms, multiple sequence alignments, and iterative refinement for structural biology applications.