Machine Learning

Authors and titles for October 2024

[551] arXiv:2410.04916 [pdf, html, other]

Title: Defense-as-a-Service: Black-box Shielding against Backdoored Graph Models

Xiao Yang, Kai Zhou, Yuni Lai, Gaolei Li

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[552] arXiv:2410.04940 [pdf, html, other]

Title: Next state prediction gives rise to entangled, yet compositional representations of objects

Tankred Saanum, Luca M. Schulze Buschoff, Peter Dayan, Eric Schulz

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[553] arXiv:2410.04941 [pdf, html, other]

Title: Detecting and Approximating Redundant Computational Blocks in Neural Networks

Irene Cannistraci, Emanuele Rodolà, Bastian Rieck

Comments: 9 pages, 10 figures, 7 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[554] arXiv:2410.04959 [pdf, html, other]

Title: Failure-Proof Non-Contrastive Self-Supervised Learning

Emanuele Sansone, Tim Lebailly, Tinne Tuytelaars

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[555] arXiv:2410.04988 [pdf, html, other]

Title: Efficient Model-Based Reinforcement Learning Through Optimistic Thompson Sampling

Jasmine Bayrooti, Carl Henrik Ek, Amanda Prorok

Subjects: Machine Learning (cs.LG); Robotics (cs.RO)

[556] arXiv:2410.05016 [pdf, html, other]

Title: T-JEPA: Augmentation-Free Self-Supervised Learning for Tabular Data

Hugo Thimonier, José Lucas De Melo Costa, Fabrice Popineau, Arpad Rimmel, Bich-Liên Doan

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[557] arXiv:2410.05020 [pdf, html, other]

Title: FRIDA: Free-Rider Detection using Privacy Attacks

Pol G. Recasens, Ádám Horváth, Alberto Gutierrez-Torre, Jordi Torres, Josep Ll.Berral, Balázs Pejó

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[558] arXiv:2410.05021 [pdf, html, other]

Title: DEPT: Decoupled Embeddings for Pre-training Language Models

Alex Iacob, Lorenzo Sani, Meghdad Kurmanji, William F. Shen, Xinchi Qiu, Dongqi Cai, Yan Gao, Nicholas D. Lane

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[559] arXiv:2410.05026 [pdf, html, other]

Title: Active Fine-Tuning of Generalist Policies

Marco Bagatella, Jonas Hübotter, Georg Martius, Andreas Krause

Subjects: Machine Learning (cs.LG); Robotics (cs.RO)

[560] arXiv:2410.05050 [pdf, other]

Title: FreSh: Frequency Shifting for Accelerated Neural Representation Learning

Adam Kania, Marko Mihajlovic, Sergey Prokudin, Jacek Tabor, Przemysław Spurek

Comments: Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[561] arXiv:2410.05063 [pdf, other]

Title: Control-oriented Clustering of Visual Latent Representation

Han Qi, Haocheng Yin, Heng Yang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[562] arXiv:2410.05071 [pdf, html, other]

Title: Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications

Andrew Lamperski, Siddharth Salapaka

Comments: Under Review for American Control Conference, 2025

Subjects: Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC); Statistics Theory (math.ST)

[563] arXiv:2410.05076 [pdf, html, other]

Title: TidalDecode: Fast and Accurate LLM Decoding with Position Persistent Sparse Attention

Lijie Yang, Zhihao Zhang, Zhuofu Chen, Zikun Li, Zhihao Jia

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[564] arXiv:2410.05078 [pdf, html, other]

Title: Compression via Pre-trained Transformers: A Study on Byte-Level Multimodal Data

David Heurtel-Depeiges, Anian Ruoss, Joel Veness, Tim Genewein

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[565] arXiv:2410.05090 [pdf, html, other]

Title: HyperINF: Unleashing the HyperPower of the Schulz's Method for Data Influence Estimation

Xinyu Zhou, Simin Fan, Martin Jaggi

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[566] arXiv:2410.05107 [pdf, html, other]

Title: Hyper-Representations: Learning from Populations of Neural Networks

Konstantin Schürholt

Comments: PhD Dissertation accepted at University of St. Gallen

Subjects: Machine Learning (cs.LG)

[567] arXiv:2410.05116 [pdf, html, other]

Title: Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning

Ayano Hiranaka, Shang-Fu Chen, Chieh-Hsin Lai, Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao, Shao-Hua Sun, Yuki Mitsufuji

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

[568] arXiv:2410.05117 [pdf, html, other]

Title: Assouad, Fano, and Le Cam with Interaction: A Unifying Lower Bound Framework and Characterization for Bandit Learnability

Fan Chen, Dylan J. Foster, Yanjun Han, Jian Qian, Alexander Rakhlin, Yunbei Xu

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Statistics Theory (math.ST); Machine Learning (stat.ML)

[569] arXiv:2410.05136 [pdf, html, other]

Title: LOTOS: Layer-wise Orthogonalization for Training Robust Ensembles

Ali Ebrahimpour-Boroojeny, Hari Sundaram, Varun Chandrasekaran

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[570] arXiv:2410.05140 [pdf, other]

Title: Tuning-Free Bilevel Optimization: New Algorithms and Convergence Analysis

Yifan Yang, Hao Ban, Minhui Huang, Shiqian Ma, Kaiyi Ji

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[571] arXiv:2410.05163 [pdf, html, other]

Title: A Simulation-Free Deep Learning Approach to Stochastic Optimal Control

Mengjian Hua, Matthieu Laurière, Eric Vanden-Eijnden

Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)

[572] arXiv:2410.05192 [pdf, html, other]

Title: Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Kaiyue Wen, Zhiyuan Li, Jason Wang, David Hall, Percy Liang, Tengyu Ma

Comments: 45 pages,13 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[573] arXiv:2410.05218 [pdf, html, other]

Title: Density estimation with LLMs: a geometric investigation of in-context learning trajectories

Toni J.B. Liu, Nicolas Boullé, Raphaël Sarfati, Christopher J. Earls

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[574] arXiv:2410.05222 [pdf, html, other]

Title: Precise Model Benchmarking with Only a Few Observations

Riccardo Fogliato, Pratik Patil, Nil-Jana Akpinar, Mathew Monfort

Comments: To appear at EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Applications (stat.AP)

[575] arXiv:2410.05225 [pdf, html, other]

Title: ETGL-DDPG: A Deep Deterministic Policy Gradient Algorithm for Sparse Reward Continuous Control

Ehsan Futuhi, Shayan Karimi, Chao Gao, Martin Müller

Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Machine Learning (stat.ML)