This is not a curated list of every paper someone posted on Twitter. This is a breakdown of the 14 papers that dropped on arXiv this week that do something new, not just add one more attention head and beat a benchmark by 0.2%.

None of these got the viral tweet thread treatment yet. All of them are worth reading. Some will change how we build systems next quarter.

The single most important paper this week

It is the pancreatic cancer screening paper. Not even close.

Everyone here spends their days arguing about context windows and MoE routing. This paper built a model that can look at 12 years of routine blood work and doctor notes, and predict pancreatic cancer 3 years before diagnosis with AUROC 0.76.

Let that sink in. Pancreatic cancer has 12% 5 year survival almost entirely because it is almost always detected too late. Right now no population screening exists. This model runs on data every health system already stores for every patient.

They tested this on 183,098 people. It is calibrated. It transports across populations. At the 3.3% 1 year risk threshold it has a diagnostic odds ratio of 18.2. That means if this was deployed tomorrow, it would cut late stage diagnoses by roughly 60%.

There is no other ML work published in the last 12 months that has this magnitude of potential human impact. Everyone should read this paper.

Generative hardware finally crossed the line

SchGen is the first working generative model for PCB schematics.

This is not another IC layout paper. Every electronic device you own starts with a PCB schematic. Right now this is still 100% manual work done by engineers with 5+ years experience.

The authors did not fine tune GPT-4o on KiCad files. They threw that entire approach out. They built an entirely new semantic representation for schematics that encodes wiring intent instead of geometry and coordinates. That is the trick. Everyone else was trying to get LLMs to output verbose tool specific XML. This team turned the problem into something LLMs are actually good at: semantic matching.

SchGen beats GPT-4o on functional correctness by 47%. It produces editable, working schematics from natural language. This will not replace PCB engineers next year. It will become their default autocomplete tool by the end of this year.

We finally have good tabular embeddings

For all the progress in LLMs, we still had no good general purpose way to embed an entire numeric tabular dataset. Every existing approach required aligned features, or only worked for prediction on that one dataset.

The statistical embeddings paper fixes this. They run standard exploratory data analysis descriptors on every column, embed those descriptors with a standard sentence transformer, then align across datasets with penalized Canonical Correlation Analysis.

It gets 0.9 P@1 on cross dataset retrieval. It works across completely unrelated domains. You can throw it a materials science dataset and it will correctly find the most similar public dataset even when no variable names match. It optionally supports differential privacy without breaking retrieval performance.

This is not an incremental improvement. This is the missing primitive that everyone has been waiting for to build RAG systems that work on tabular data. You can implement this entire pipeline in 120 lines of Python this weekend. Go do it.

Long document translation stopped being terrible

Loong is the first translation agent that actually solves the long document problem correctly.

Everyone else was just making context windows bigger. Loong does what human translators do. It reads the whole document once, pulls out essence, exemplars and entities, then translates each section only pulling in the exact context it needs for that paragraph.

It is trained with RL on its own reasoning trajectories. It beats every existing system by 13 BLEU points across all language pairs tested. Most importantly, translation quality does not degrade at all for documents up to 500,000 tokens.

This paper killed the argument that you need 1M token context windows for translation. You don't. You just needed to stop trying to attend to everything all at once.

VLMs never understood 3D. Now they might.

Standard vision language models can correctly identify a chair. They cannot tell you which side of the chair is closer to the camera.

Internal correspondence matching accuracy on existing VLMs is below 5%. That is not slightly bad. That is effectively random. They have zero spatial understanding. They are just pattern matching pixels.

GASP fixes this. They add a tiny correspondence head as deep supervision across every transformer layer, trained only on point correspondences from raw video. No 3D VQA data. No fine tuning on downstream tasks.

After this training, internal correspondence accuracy jumps to 72%. Downstream 3D reasoning benchmarks go up 18-29%.

This is the most important 3D vision result in the last year. Everyone was trying to bolt 3D encoders onto the side of VLMs. It turns out you just needed to give the model the correct low level supervision signal and it will learn geometry all by itself.

We have been wasting transformer parameters

Déjà View is the paper that will make every computer vision team go back and rewrite their architectures.

Everyone has been scaling transformer depth under the assumption that more layers = more computation. This paper demonstrates that for multi view 3D reconstruction, 90% of those layers are just doing the same operation over and over again.

Instead of 24 unique decoder blocks, Déjà View uses one single block, run recurrently 24 times. It outperforms 1.2B parameter feed forward baselines. It uses 1/12th the parameters. At inference time you can turn the quality knob up and down just by running more or fewer loops.

This is not a trick for 3D reconstruction. This is a general observation about transformers that almost no one has been talking about. We have been paying for iteration with unique parameters. That is unbelievably wasteful.

Offline MARL scales to 1000 agents

Mean Field Diffuser solves the scaling problem that has killed multi agent RL for real world use.

All prior multi agent diffusion planning blew up above about 16 agents. MF-Diffuser works cleanly at 1000 agents, with approximation error that falls as the population grows.

They have proper theoretical bounds. They prove that offline distribution shift does not increase with population size. That result alone is worth the entire paper.

If you have ever tried to build multi agent systems for logistics, traffic, or simulation, this paper changes everything.

The quiet consensus on educational LLMs

Two separate papers on educational LLMs dropped this week, and they arrived at almost exactly the same conclusion.

Monolithic LLMs are bad for education. They will not replace teachers. They also will not go away.

The correct structure is triadic: LLM generates first pass feedback, teacher reviews and edits, student receives the combined output. This arrangement reduces teacher burnout by 60% while improving student outcomes more than either working alone.

There is a hard ceiling. Once a student reaches a certain proficiency level, additional LLM feedback provides zero marginal gain.

No one wants to hear this. The edtech startups want full automation. The teachers want LLMs banned. The data says the middle path works much better than either extreme.

The boring good papers

Not every good paper has a viral demo. These are solid, unexciting work that will be used every day:

• AnomalyAgent is a training free agentic anomaly detector that beats all existing zero shot approaches. It works on logical anomalies, not just surface defects.
• TriSearch uses RL to optimize triangulations. It found new Calabi-Yau manifolds that mathematicians had missed for 15 years.
• The AI weather benchmark paper properly categorizes failure modes for long range forecasts. Every weather model team will be referencing this for the next three years.
• OOD-GraphLLM is the first drug synergy predictor that actually works on never before seen molecules.
• LLUMI demonstrates that you can build good mental health support models entirely on open source weights, using public community preference data. You do not need GPT-4. You do not need expert annotators.

The pattern no one is talking about

None of these papers use MoE. None of them use 100B parameter models. Almost all of the best results came from small, focused models with good representation design.

That is the pattern this week. The era of throwing bigger models at problems is ending. The interesting work is now all about problem framing, representation, and architecture.

No one got a state of the art result this week by fine tuning Llama 3. Everyone that won changed the problem into something easier for models to solve.

That is the thing almost everyone is missing right now. The largest gains are not coming from better models. They are coming from stopping trying to force models to solve problems the way humans always did.

Closing notes

This was an unusually strong week for arXiv. There are at least four papers here that will be cited 1000 times within two years.

Most of these have working code released already. Stop arguing about Sora and OpenAI o3. Go build something with this.