See it to Place it: Evolving Macro Placements with Vision-Language Models

summary

Video file (mp4)

The gist

The gist: VeoPlace is a novel framework that uses a Vision-Language Model to guide low-level chip placement by constraining it to promising regions, achieving state-of-the-art results across both

In short

VeoPlace is a novel framework that uses a Vision-Language Model (VLM) to guide low-level chip placement by constraining it to promising regions, achieving state-of-the-art results across both learning and analytical placers without fine-tuning the VLM. It works by iteratively evolving placements using VLM region proposals as guidance, significantly reducing wirelength.

Key concepts

VeoPlace
A framework that uses a Vision-Language Model (VLM) to guide chip floorplanning. It iteratively evolves placement options by having the VLM suggest promising regions on the chip canvas, which then constrains the low-level placement algorithm to those areas, improving overall design quality.
VLM Guidance for Placement
The VLM generates region proposals based on prior placements to provide spatial guidance. This guidance is incorporated differently depending on the placement method: it acts as soft anchor constraints for analytical placers or masks the action space for learning-based policies, directing them toward better locations.
Evolutionary Search Strategy
VeoPlace uses an evolutionary search strategy where a population of placements is iteratively optimized. The VLM acts as a variation operator within this search, suggesting new placement regions that help the system explore the design space and converge on higher-quality floorplans over time.
Global Half-Perimeter Wirelength (gHPWL)
This is the primary evaluation metric used to measure placement quality. It calculates wirelength across the entire chip after standard cell placement and legalization. Lower gHPWL indicates a better, more compact physical arrangement of components.

Terminology used across episodes

This episode discusses

The paper

See it to Place it: Evolving Macro Placements with Vision-Language Models · Read on arXiv

Harvard University · Google DeepMind

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "See it to Place it".

Jane: The gist: VeoPlace is a novel framework that uses a Vision-Language Model to guide low-level chip placement by constraining it to promising regions,

Tom: First, who's behind it and why it matters.

Paper summary: Tom: So, wrapping up this look at "See it to Place it: Evolving Macro Placements with Vision-Language Models," the authors present VeoPlace as a way to use VLMs for macro placement by constraining the placer to subregions of the chip canvas.

Jane: It seems like they’ve successfully shown that you don't need to fine-tune these models to get good spatial guidance; you can use them out of the box with an evolutionary search strategy.

Lu: The authors show this framework outperforms prior learning-based approaches on nine of ten open-source benchmarks with peak wirelength reductions exceeding thirty-two percent <ref:2603.28733#pg1,benchmarks with peak wirelength reductions exceeding 32>. They also showed it improves DREAMPlace performance on all eight ICCAD two thousand fifteen Superblue benchmarks by up to four point three percent <ref:2603.28733#pg2,DREAMPlace performance on all eight ICCAD 2015 Superblue benchmarks>.

Meng: The paper also highlighted that the anchor weight lambda A controls how strongly the analytical placer is guided toward VLM-suggested positions, with lower weights performing better.

Lalam: The main contributions they list are the unified VLM-guided placement framework and their performance across different placement paradigms.

Tom: So, for anyone working on electronic design automation tools, this suggests a new way to leverage foundation models to tackle complex physical design problems by using them for high-level spatial reasoning.

Conclusion: Tom: So, VeoPlace is this new framework that uses a Vision-Language Model to guide where you put big components on a chip floorplan by telling the placer exactly which areas look good to place things in.

Jane: It’s about using those visual models—the VLMs—to give direction to the placement process without needing to retrain them, and it does that by letting them propose regions.

Lu: The authors are showing how this VLM proposal mechanism works iteratively through an evolutionary search strategy, where they keep testing different placements based on what the VLM suggests.

Meng: And they’re not just doing this for one type of placement tool; they proved it works whether you’re using a learning-based policy or an analytical placer.

Lalam: The core idea is that if you have a learning model, the VLM tells it where to focus its search, and if you have an analytical placer, the VLM suggestions become soft constraints in the math.

Tom: And on their numbers, they’re seeing big improvements. They're talking about peak reductions of over thirty-two percent in wirelength after standard placement and legalization steps.

Jane: That’s a lot of reduction for physical layout problems, especially when you look at how much better it is compared to the models they tested.

Lu: They showed that on nine out of ten benchmarks, the performance gains are massive, and they even improved an analytical placer called DREAMPlace by up to four point three percent on all eight Superblue tests.

Meng: But I want to know how much overhead this adds when you try to run this in a real design flow. How big is the context window size for these VLMs?

Lalam: The framework uses a structured prompt, which they found helps the VLM give better spatial reasoning, and they kept testing different ways to pick examples from their history buffer.

Jane: It sounds like the whole point is that you can leverage these large foundation models to solve complex physical design problems by just giving them a visual hint.

Tom: Exactly. We've seen how much these models can reason spatially, and now they are being used as an active guide in the optimization process itself.

Lu: The implication here is that we might see a shift where these models don't just analyze results after the fact, but actively influence the design choices made during the layout phase.

Jane: It opens up new possibilities for how electronic design automation tools can use these powerful vision-language capabilities to tackle those tricky spatial arrangement tasks.

More episodes

← Home