Beyond Atoms: Enhancing Molecular Pretrained Representations with 3D Space Modeling
Lu et al. introduce SpaceFormer, a Transformer that models entire 3D molecular space—not just atoms—for superior …...
Transformers
Deconstructing Neural Networks for Time Series Forecasting
Ablation study of neural network components for forecasting, finding gating and attention improve RNNs while recurrence …...
Sarcasm Detection with Transformers: A Cautionary Tale
Learn how dataset bias can lead to misleading results in NLP: a sarcasm detection model that actually learned to …
PyConversations: Social Media Conversational Analysis
Undergraduate thesis exploring representation learning for social media text and developing tools for cross-platform …
CoQA Dataset: Advancing Conversational Question Answering
Analysis of CoQA, a conversational QA dataset with multi-turn dialogue, coreference resolution, and natural answers for …