Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: zdevito/ATen
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: o9nn/ATenTree
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 3 commits
  • 7 files changed
  • 2 contributors

Commits on Dec 19, 2025

  1. Add ATen[a(n)] hyper-chatbot attention architecture

    Implement a novel attention mechanism where each head corresponds to
    a rooted tree from OEIS A000081 (number of unlabeled rooted trees).
    
    - rooted_trees.py: Generate rooted trees with Butcher coefficients
      (order, symmetry σ, density γ, α coefficient)
    - attention_heads.py: Map trees to attention head specifications
    - elementary_differentials.py: Tensor contraction patterns from
      Runge-Kutta theory's elementary differentials
    - hyper_attention.py: Full transformer with tree-structured attention
      - ATen(n) layer has a(n) heads: 1,1,2,4,9,20,48,...
      - Tree topology induces attention patterns (sequential/parallel)
      - Optional PyTorch implementation with TreeHead modules
    - demo.py: Comprehensive demonstration of the architecture
    
    The architecture encodes combinatorial structure directly into
    attention, with each tree's properties determining tensor dimensions.
    claude committed Dec 19, 2025
    Configuration menu
    Copy the full SHA
    fc65de4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    787175f View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2025

  1. Merge pull request #1 from o9nn/claude/attention-tensor-trees-MuNjD

    Claude/attention tensor trees mu nj d
    drzo authored Dec 20, 2025
    Configuration menu
    Copy the full SHA
    865a562 View commit details
    Browse the repository at this point in the history
Loading