Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
det.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Mastodon Server des Unterhaltungsfernsehen Ehrenfeld zum dezentralen Diskurs.

Administered by:

Server stats:

2.2K
active users

det.social: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.2

#attention

1 post1 participant0 posts today
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
Public *
Alex Silver

Continuing to try to figure out the internet and information in 2025. Access to information has changed a lot in 20 years—it now seems that individuals have an intense responsibility as "executives" of their own attention.

I'm threading together my new place online: for my art, for my political discourse, for my support of quality press institutions, etc.

Mastadon is a decentralized social network: let's not let that mean "siloed."

#internet#attention#civicengagement
Continued thread
Public *
Coach Pāṇini ®

Young people today navigate unprecedented challenges: economic precarity, geopolitical instability, the erosion of traditional pathways in work and #education, AI's looming disruption of career prospects, and accelerating climate catastrophes.

Banning phones is a superficial solution to profound problems.

The evidence is unignorable and demands our #attention.

5/6

Public
Hacker News

Multi-Token Attention

arxiv.org/abs/2504.00927

#HackerNews #Multi-Token #Attention #research #AI #advancements #attentionmechanism #deeplearning #NLP

arXiv logo
arXiv.orgMulti-Token AttentionSoft attention is a critical mechanism powering LLMs to locate relevant parts within a given context. However, individual attention weights are determined by the similarity of only a single query and key token vector. This "single token attention" bottlenecks the amount of information used in distinguishing a relevant part from the rest of the context. To address this issue, we propose a new attention method, Multi-Token Attention (MTA), which allows LLMs to condition their attention weights on multiple query and key vectors simultaneously. This is achieved by applying convolution operations over queries, keys and heads, allowing nearby queries and keys to affect each other's attention weights for more precise attention. As a result, our method can locate relevant context using richer, more nuanced information that can exceed a single vector's capacity. Through extensive evaluations, we demonstrate that MTA achieves enhanced performance on a range of popular benchmarks. Notably, it outperforms Transformer baseline models on standard language modeling tasks, and on tasks that require searching for information within long contexts, where our method's ability to leverage richer information proves particularly beneficial.
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
Public
Doug Webb

Logging in to say how happy and grateful I am to be able to make annotations on #EPUB on my e-reader running #KOReader, and to then be able to import and read those same EPUBs and annotations on my laptop in @zotero

💌 💌 💌

This allows me to read long-form (I really struggle to do so on my laptop) and still take digital notes (not having to manually copy afterwards.)

#FOSS#focus#attention
Public
Emeritus Prof Christopher May

Henry Farrell's consideration of the attention economy & political science's failure to really see it, is an important read; he asks

'How might the attention economy remake the underlying structures of democracy? If there is a political scientist who predicted how Musk could effectively leverage his position to eliminate US-AID despite the legal and political barriers, I don’t know who she or he is'!

The political economy of attention *needs* our attention!

#attention
programmablemutter.com/p/the-a

Programmable Mutter · The attention economy is devouring politicsBy Henry Farrell
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
Public
Blender Dumbass ( J.Y.Amihud )

From: blenderdumbass . org

Doing those Dumbass Blender tutorials was supposed be a way for me to get noticed. But no matter how utterly insane my ideas were, I just fell deeper and deeper into despair.

Read or listen: blenderdumbass.org/articles/th

blenderdumbass . orgThe Impossible Task of Famousing Myself
More from Blender Dumbass ( J.Y.Amihud )
#YouTube#LBRY#Odysee
ExploreLive feeds
About