From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search

arXiv:2610.01553 · cs.IR, cs.CL · Submitted 2026-10-01 · Read on arXiv

cs.IR, cs.CL

Submitted: 2026-10-01

Updated: 2026-10-01

Code: https://github.com/iprally/invention_graph_eval

Terminology

• Transformer — 15× in this paper · explained in 2 episodes
• Distillation — 6× in this paper · explained in 2 episodes
• Ablation — 4× in this paper · explained in 1 episode
• Embeddings — 4× in this paper · explained in 2 episodes
• Knowledge Distillation — 4× in this paper · explained in 11 episodes
• Sparse Attention — 3× in this paper · explained in 5 episodes
• Adaptive Strategy — 2× in this paper · explained in 1 episode
• Benchmark — 2× in this paper · explained in 2 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Generative AI — 2× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Consistency — 1× in this paper · explained in 3 episodes
• Core — 1× in this paper · explained in 2 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Representation Learning — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Systematic Bias — 1× in this paper · explained in 3 episodes
• Transformer Models — 1× in this paper · explained in 2 episodes

Sources

• Patent Search Using Triplet Networks Based Fine-Tuned SciBERT
• Longformer: The Long-Document Transformer
• A Generalization of Transformer Networks to Graphs
• BERT based patent novelty search by training claims to their own description
• PaECTER: Patent-level Representation Learning using Citation-informed Transformers
• Distilling the Knowledge in a Neural Network
• PatenTEB: A Comprehensive Benchmark and Model Family for Patent Text Embedding
• Do Transformers Really Perform Bad for Graph Representation?
• Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Related papers

• The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
• SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
• MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
• RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
• Right Family, Wrong Skill: Evaluating Risk Exposure in Agent Skill Retrieval
• UltRAG: a Universal Simple Scalable Recipe for Knowledge Graph RAG