Papers
Deep, long-form breakdowns of recent research in AI, machine learning, security & programming languages.
199 results on this page · clear filters
Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data
by Atindra Jha, Margaret Li, Jure Leskovec, Percy Liang, Luke Zettlemoyer
Distance generalization in transformers: why bother with positional encoding?
by Daniel Henrik Nevermann, Claudius Gros
From Protocols to Evidence: Bounded Claims for AI in Service of the Common Good
by Nitesh V. Chawla, Paulo Benanti
TART: A Modular Tool for Technique-Aware Audio-to-Tablature Guitar Transcription
by Akshaj Gupta, Hwi Joo Park, Andrea Guzman, Shamak Gowda, Samhita Konduri, Jiachen Lian, Robin Netzorg, Gopala Anumanchipalli
CoRA-NAS: Coarse Ranking and Anchor-Residual Refinement for Neural Architecture Search
by Yifan Yang, Zhaoyan Wang, Zheng Gao, Xiaoyu Li, Jiaojiao Jiang
The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
by Yi Duan, Ying Liu, Zirui Tang, Haodong Chen, Jun Zhou, Yumou Liu, Bangrui Xu, Yukai Wu, Sidi Chen, Yuhan Zhou, Haoyu Wang, Xiaoyou Yu, Shaokun Han, Xuzhou Zhu, Le Zhou, Bolin Lu, Wei Zhou, Jiachen Liu, Nuozhou Fang, Jiaxin Tian, Ruoyu Chen, Yuxuan Li, Kai Zuo, Kaiyan Zhang, Jiantao Qiu, Conghui He, Guoliang Li, Bowen Zhou, Zhiyuan Liu, Zhoufutu Wen, Jihua Kang, Xuanhe Zhou, Fan Wu
AdamX: Cosine similarity meets gradient descent
by Francisco Caldas, Ruben Belo, Cláudia Soares
IndicTriMix: Developing Language Identification Datasets and Models for Tri-Language Code-Mixing
by Pruthwik Mishra, Rudra Trivedi, Avi Patel, Ashok Urlana, Shrikant Malviya
Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport
by Luyi Jia, Boyan Zhang, Yilun Liu, Steffen Rulands
Generative Late-Interaction Embeddings For Visual Document Retrieval
by Mohamed Eltahir, Talal Aloushan, Rose Khairoalsendi, Jana Shata, Mohammed Alhassan, Leen Alrehaili, Tanveer Hussain, Naeemullah Khan